2024-06-06T02:11:37.894 INFO:root:teuthology version: 0.0.1.dev303+g861a8dc 2024-06-06T02:11:37.894 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} --name pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi --owner scheduled_pdonnell@vossi04.front.sepia.ceph.com --verbose -- /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/orig.config.yaml 2024-06-06T02:11:37.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T02:11:38.041 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666 branch: wip-pdonnell-testing-20240605.005022-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7743666' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240605.005022-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240605.005022-debug sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 owner: scheduled_pdonnell@vossi04.front.sepia.ceph.com priority: 80 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 175 sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-pdonnell-testing-20240605.005022-debug suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEuxa3PRgc7O78b/wjW6RvPjcuQag3MydnCo/oYwiehw+A+InfyqXvaS/7PPbfSMorTHvZ2x2U3cuS2qSlQEZOw= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCMlBX3c89zfgolkMPjtgDUqMVo0GFhRGDeaASZL3a+56KnMcTMQI25rPAGQtlFn7IaRyxX/PE+7VLocneTJDdc= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT9z/gYomVgN0btoNOiW5R8q4DGmjDmbwWKpOQ8jUBBxtpiFm3f5Hb3aHzb4kVF3zg29S4hsgUCgCV0VvY1aUU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 861a8dcf7aa816a26e13f039336f7ed0a9aec0fa timestamp: 2024-06-06_01:29:47 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-06T02:11:38.041 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa; will attempt to use it 2024-06-06T02:11:38.042 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa/tasks 2024-06-06T02:11:38.042 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-06T02:11:38.044 INFO:teuthology.task.internal:Checking packages... 2024-06-06T02:11:38.064 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8' 2024-06-06T02:11:38.064 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-06T02:11:38.064 INFO:teuthology.packaging:ref: None 2024-06-06T02:11:38.064 INFO:teuthology.packaging:tag: None 2024-06-06T02:11:38.064 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240605.005022-debug 2024-06-06T02:11:38.065 INFO:teuthology.packaging:sha1: 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:11:38.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240605.005022-debug 2024-06-06T02:11:38.203 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-4083.g3c55257c 2024-06-06T02:11:38.205 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-06T02:11:38.214 INFO:teuthology.task.internal:no buildpackages task found 2024-06-06T02:11:38.214 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-06T02:11:38.250 INFO:teuthology.task.internal:Saving configuration 2024-06-06T02:11:38.271 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-06T02:11:38.280 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-06T02:11:38.304 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:06:05.318028', 'locked_by': 'scheduled_pdonnell@vossi04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEuxa3PRgc7O78b/wjW6RvPjcuQag3MydnCo/oYwiehw+A+InfyqXvaS/7PPbfSMorTHvZ2x2U3cuS2qSlQEZOw='} 2024-06-06T02:11:38.325 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:06:05.320826', 'locked_by': 'scheduled_pdonnell@vossi04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCMlBX3c89zfgolkMPjtgDUqMVo0GFhRGDeaASZL3a+56KnMcTMQI25rPAGQtlFn7IaRyxX/PE+7VLocneTJDdc='} 2024-06-06T02:11:38.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-06 02:06:05.319533', 'locked_by': 'scheduled_pdonnell@vossi04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCT9z/gYomVgN0btoNOiW5R8q4DGmjDmbwWKpOQ8jUBBxtpiFm3f5Hb3aHzb4kVF3zg29S4hsgUCgCV0VvY1aUU='} 2024-06-06T02:11:38.348 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-06T02:11:38.356 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-06T02:11:38.356 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-06T02:11:38.357 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-06T02:11:38.357 INFO:teuthology.run_tasks:Running task console_log... 2024-06-06T02:11:38.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f06254b1000>, signals=[15]) 2024-06-06T02:11:38.502 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-06T02:11:38.508 INFO:teuthology.task.internal:Opening connections... 2024-06-06T02:11:38.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:11:38.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:11:38.583 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-06-06T02:11:38.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:11:38.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-06-06T02:11:38.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:11:38.732 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-06T02:11:38.738 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-06-06T02:11:38.756 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-06-06T02:11:38.756 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-06-06T02:11:38.812 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T02:11:38.813 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T02:11:38.814 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-06-06T02:11:38.836 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-06-06T02:11:38.854 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-06-06T02:11:38.854 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T02:11:38.911 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-06-06T02:11:38.912 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T02:11:38.912 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T02:11:38.912 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T02:11:38.912 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-06-06T02:11:38.936 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-06-06T02:11:38.953 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-06-06T02:11:38.954 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-06-06T02:11:39.010 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-06-06T02:11:39.010 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-06-06T02:11:39.010 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-06-06T02:11:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-06-06T02:11:39.012 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-06-06T02:11:39.108 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-06T02:11:39.117 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-06T02:11:39.192 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-06T02:11:39.192 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-06-06T02:11:39.195 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-06-06T02:11:39.197 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-06-06T02:11:39.214 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-06T02:11:39.221 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-06T02:11:39.222 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-06-06T02:11:39.251 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-06-06T02:11:39.254 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-06-06T02:11:39.362 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-06T02:11:39.437 INFO:teuthology.run_tasks:Running task kernel... 2024-06-06T02:11:39.452 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-06T02:11:39.452 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-06-06T02:11:39.452 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-06-06T02:11:39.453 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T02:11:39.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:11:39.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-06-06T02:11:39.624 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T02:11:39.624 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-06-06T02:11:39.625 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-06-06T02:11:39.642 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-06-06T02:11:39.642 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T02:11:39.642 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-06-06T02:11:39.643 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-06-06T02:11:41.899 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-06-06T02:11:43.959 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-06-06T02:11:48.242 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.2 MB 00:00 2024-06-06T02:11:50.225 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 17 kB 00:00 2024-06-06T02:11:51.570 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-06-06T02:11:56.742 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-06-06T02:11:58.843 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-06-06T02:11:58.844 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-06-06T02:11:58.845 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-06-06T02:11:58.956 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-06T02:11:58.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-06-06T02:11:59.102 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-06-06T02:11:59.102 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-06-06T02:11:59.104 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-06-06T02:12:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06 02:12:12 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-06-06T02:12:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-06-06 02:12:12-- 2024-06-06T02:12:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 14s 2024-06-06T02:12:12.696 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 340M in 13s (25.8 MB/s) 2024-06-06T02:12:12.699 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-06-06T02:12:12.699 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-06-06T02:12:14.796 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-06-06T02:12:14.934 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-06-06T02:12:15.029 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-06-06T02:12:22.970 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-06-06T02:13:02.050 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-06-06T02:13:02.050 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-06-06T02:13:02.131 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-gb9459a26b088 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-06-06T02:13:02.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-06-06T02:13:02.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-06-06T02:13:02.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-06-06T02:13:02.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-06-06T02:13:02.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-06-06T02:13:02.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-06-06T02:13:02.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-06-06T02:13:02.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-06-06T02:13:02.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-06-06T02:13:02.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-06-06T02:13:02.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-06-06T02:13:02.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-06-06T02:13:02.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-06-06T02:13:02.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-06-06T02:13:02.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-06-06T02:13:02.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-06-06T02:13:02.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-06-06T02:13:02.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-06-06T02:13:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-06-06T02:13:02.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-06-06T02:13:02.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-06-06T02:13:02.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-06-06T02:13:02.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-06-06T02:13:02.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-06-06T02:13:02.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-06-06T02:13:02.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-06-06T02:13:02.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-06-06T02:13:02.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-06-06T02:13:02.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-06-06T02:13:02.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-06-06T02:13:02.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-06-06T02:13:02.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-06-06T02:13:02.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-06-06T02:13:02.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-06-06T02:13:02.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-06-06T02:13:02.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-06-06T02:13:02.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-06-06T02:13:02.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-06-06T02:13:02.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-06-06T02:13:02.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-06-06T02:13:02.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-06-06T02:13:02.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-06-06T02:13:02.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-06-06T02:13:02.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-06-06T02:13:02.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-06-06T02:13:02.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-06-06T02:13:02.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-06-06T02:13:02.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-06-06T02:13:02.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-06-06T02:13:02.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-06-06T02:13:02.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-06-06T02:13:02.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-06-06T02:13:02.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-06-06T02:13:02.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-06-06T02:13:02.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-06-06T02:13:02.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-06-06T02:13:02.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-06-06T02:13:02.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-06-06T02:13:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-06-06T02:13:02.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-06-06T02:13:02.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-06-06T02:13:02.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-06-06T02:13:02.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-06-06T02:13:02.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-06-06T02:13:02.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-06-06T02:13:02.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-06-06T02:13:02.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-06-06T02:13:02.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-06-06T02:13:02.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-06-06T02:13:02.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-06-06T02:13:02.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-06-06T02:13:02.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-06-06T02:13:02.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-06-06T02:13:02.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-06-06T02:13:02.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-06-06T02:13:02.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-06-06T02:13:02.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-06-06T02:13:02.209 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-06-06T02:13:02.210 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-06-06T02:13:02.211 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-06-06T02:13:02.212 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-06-06T02:13:02.213 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-06-06T02:13:02.214 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-06-06T02:13:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-06-06T02:13:02.216 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-06-06T02:13:02.217 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-06-06T02:13:02.218 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-06-06T02:13:02.219 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-06-06T02:13:02.220 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-06-06T02:13:02.221 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-06-06T02:13:02.222 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-06-06T02:13:02.223 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-06-06T02:13:02.224 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-06-06T02:13:02.225 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-06-06T02:13:02.226 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-06-06T02:13:02.227 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-06-06T02:13:02.228 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-06-06T02:13:02.229 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-06-06T02:13:02.230 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-06-06T02:13:02.231 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-06-06T02:13:02.232 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-06-06T02:13:02.233 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-06-06T02:13:02.234 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-06-06T02:13:02.235 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-06-06T02:13:02.236 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-06-06T02:13:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-06-06T02:13:02.238 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-06-06T02:13:02.239 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-06-06T02:13:02.240 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-06-06T02:13:02.241 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-06-06T02:13:02.242 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-06-06T02:13:02.243 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-06-06T02:13:02.244 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-06-06T02:13:02.245 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-06-06T02:13:02.246 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-06-06T02:13:02.247 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-06-06T02:13:02.248 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-06-06T02:13:02.249 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-06-06T02:13:02.250 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-06-06T02:13:02.251 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-06-06T02:13:02.252 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-06-06T02:13:02.253 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-06-06T02:13:02.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-06-06T02:13:02.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-06-06T02:13:02.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-06-06T02:13:02.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-06-06T02:13:02.254 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-06-06T02:13:02.257 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-06-06T02:13:02.258 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-06-06T02:13:02.259 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-06-06T02:13:02.260 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-06-06T02:13:02.261 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-06-06T02:13:02.262 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-06-06T02:13:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-06-06T02:13:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-06-06T02:13:02.265 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-06-06T02:13:02.266 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-06-06T02:13:02.267 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-06-06T02:13:02.268 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-06-06T02:13:02.269 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-06-06T02:13:02.270 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-06-06T02:13:02.271 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-06-06T02:13:02.272 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-06-06T02:13:02.273 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-06-06T02:13:02.274 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-06-06T02:13:02.275 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-06-06T02:13:02.276 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-06-06T02:13:02.277 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-06-06T02:13:02.278 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-06-06T02:13:02.279 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-06-06T02:13:02.280 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-06-06T02:13:02.281 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-06T02:13:02.285 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-06-06T02:13:02.285 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-06-06T02:13:02.309 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-06-06T02:13:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-06-06T02:13:02.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-06-06T02:13:02.383 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-06-06T02:13:02.383 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-06-06T02:13:02.384 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:13:02.385 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-06-06T02:13:02.386 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-06-06T02:13:02.386 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-gb9459a26b088 2024-06-06T02:13:02.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-06-06T02:13:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-06-06T02:13:04.314 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-06-06T02:13:04.347 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-06-06T02:13:04.349 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-06-06T02:13:04.381 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.3higGux4va 2024-06-06T02:13:04.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3higGux4va 2024-06-06T02:13:04.445 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.3higGux4va 2024-06-06T02:13:04.580 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.3higGux4va is 6KB 2024-06-06T02:13:04.628 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.3higGux4va 2024-06-06T02:13:04.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-06-06T02:13:04.703 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-06-06T02:13:04.703 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-06-06T02:13:04.703 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-06-06T02:13:04.703 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-06-06T02:13:04.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-06-06T02:13:04.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-06-06T02:13:34.887 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-06-06T02:13:34.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:13:34.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:13:53.310 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-06T02:14:02.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:14:02.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:14:05.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-06T02:14:17.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:14:17.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:14:35.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-06-06T02:14:50.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:14:50.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:14:51.551 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-06-06T02:14:52.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:14:52.108 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-06-06T02:14:52.108 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-06-06T02:14:52.148 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-gb9459a26b088 2024-06-06T02:14:52.148 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-06-06T02:14:52.149 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-06-06T02:14:52.149 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-06-06T02:14:53.150 DEBUG:teuthology.parallel:result is None 2024-06-06T02:14:53.151 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-06T02:14:53.162 INFO:teuthology.task.internal:Creating test directory... 2024-06-06T02:14:53.163 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T02:14:53.167 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T02:14:53.170 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-06T02:14:53.207 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-06T02:14:53.214 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-06T02:14:53.257 INFO:teuthology.task.internal:Creating archive directory... 2024-06-06T02:14:53.257 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T02:14:53.263 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T02:14:53.265 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-06T02:14:53.343 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-06T02:14:53.350 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-06T02:14:53.350 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T02:14:53.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:14:53.367 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-06T02:14:53.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:14:53.384 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T02:14:53.391 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T02:14:53.409 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-06T02:14:53.442 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.472 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.473 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.492 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.518 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.586 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-06T02:14:53.590 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-06T02:14:53.597 INFO:teuthology.task.internal:Configuring sudo... 2024-06-06T02:14:53.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T02:14:53.601 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T02:14:53.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-06T02:14:53.658 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-06T02:14:53.667 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-06T02:14:53.667 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T02:14:53.671 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T02:14:53.674 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-06T02:14:53.704 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:53.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:53.887 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:53.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:54.041 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:14:54.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T02:14:54.146 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:54.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:54.243 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:54.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:54.369 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:14:54.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T02:14:54.434 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:54.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-06T02:14:54.534 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:54.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-06T02:14:54.660 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:14:54.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-06T02:14:54.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-06-06T02:14:54.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-06-06T02:14:54.736 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-06-06T02:14:54.776 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T02:14:54.804 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T02:14:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T02:14:55.189 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-06T02:14:55.197 INFO:teuthology.task.internal:Starting timer... 2024-06-06T02:14:55.197 INFO:teuthology.run_tasks:Running task pcp... 2024-06-06T02:14:55.228 INFO:teuthology.run_tasks:Running task selinux... 2024-06-06T02:14:55.276 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-06-06T02:14:55.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-06-06T02:14:55.398 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-06-06T02:14:55.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-06-06T02:14:55.471 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-06-06T02:14:55.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-06-06T02:14:55.569 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-06-06T02:14:55.574 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-06T02:14:55.574 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-06-06T02:14:55.625 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-06-06T02:14:55.625 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-06-06T02:14:55.656 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-06-06T02:14:55.656 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-06-06T02:14:55.685 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-06-06T02:14:55.685 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-06-06T02:14:55.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T02:14:55.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:14:55.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T02:14:55.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:14:55.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T02:14:55.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:14:55.810 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-06T02:14:55.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-06-06T02:14:55.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-06-06T02:14:55.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-06-06T02:14:55.940 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-06T02:14:55.950 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-06T02:14:55.961 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-06T02:14:55.962 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi103.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-06T02:21:11.367 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-06-06T02:21:11.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:21:11.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:21:11.477 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-06-06T02:21:11.626 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-06-06T02:21:11.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-06-06T02:21:11.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:21:11.704 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-06-06T02:21:11.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-06-06T02:21:11.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-06T02:21:11.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-06T02:21:11.860 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-06-06T02:21:11.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-06-06T02:21:11.939 INFO:teuthology.run_tasks:Running task clock... 2024-06-06T02:21:11.965 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-06T02:21:11.965 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T02:21:11.965 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T02:21:11.973 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T02:21:11.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T02:21:11.976 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-06T02:21:11.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T02:21:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T02:21:12.010 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T02:21:12.020 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T02:21:12.021 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T02:21:12.043 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-06-06T02:21:12.046 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-06-06T02:21:12.054 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-06-06T02:21:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-06T02:21:12.057 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-06-06T02:21:12.067 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T02:21:12.071 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T02:21:12.080 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T02:21:12.084 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T02:21:12.095 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-06T02:21:12.134 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.138 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.145 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-06-06T02:21:12.149 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T02:21:12.149 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-06-06T02:21:12.149 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.149 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.149 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.150 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.160 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-06-06T02:21:12.192 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-06-06T02:21:12.233 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-06T02:21:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-06T02:21:12.410 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.423 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T02:21:12.423 INFO:teuthology.run_tasks:Running task install... 2024-06-06T02:21:12.436 DEBUG:teuthology.task.install:project ceph 2024-06-06T02:21:12.437 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8'}} 2024-06-06T02:21:12.437 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8'} 2024-06-06T02:21:12.437 INFO:teuthology.task.install:Using flavor: default 2024-06-06T02:21:12.443 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-06T02:21:12.444 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-06-06T02:21:12.444 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'tag': None, 'wait_for_package': False} 2024-06-06T02:21:12.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:21:12.447 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'tag': None, 'wait_for_package': False} 2024-06-06T02:21:12.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:21:12.449 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'tag': None, 'wait_for_package': False} 2024-06-06T02:21:12.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:21:12.666 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/ 2024-06-06T02:21:12.666 INFO:teuthology.task.install.rpm:Package version is 19.0.0-4083.g3c55257c 2024-06-06T02:21:12.672 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/ 2024-06-06T02:21:12.672 INFO:teuthology.task.install.rpm:Package version is 19.0.0-4083.g3c55257c 2024-06-06T02:21:12.684 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/ 2024-06-06T02:21:12.684 INFO:teuthology.task.install.rpm:Package version is 19.0.0-4083.g3c55257c 2024-06-06T02:21:12.781 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T02:21:12.781 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:21:12.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T02:21:12.793 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T02:21:12.794 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:21:12.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T02:21:12.820 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T02:21:12.820 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T02:21:12.850 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-06T02:21:12.850 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:21:12.850 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-06T02:21:12.871 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T02:21:12.871 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T02:21:12.877 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-06T02:21:12.877 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-06T02:21:12.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T02:21:12.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T02:21:12.960 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T02:21:13.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-06T02:21:13.019 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T02:21:13.023 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-06-06T02:21:13.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-06-06T02:21:13.083 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-06-06T02:21:13.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-06-06T02:21:13.106 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-06T02:21:13.183 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-06-06T02:21:13.187 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-06-06T02:21:13.248 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-06-06T02:21:13.275 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T02:21:13.308 INFO:teuthology.orchestra.run.smithi184.stdout:45 files removed 2024-06-06T02:21:13.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T02:21:13.505 INFO:teuthology.orchestra.run.smithi082.stdout:45 files removed 2024-06-06T02:21:13.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-06T02:21:13.844 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 271 kB/s | 83 kB 00:00 2024-06-06T02:21:14.004 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 204 kB/s | 83 kB 00:00 2024-06-06T02:21:14.261 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 32 kB/s | 12 kB 00:00 2024-06-06T02:21:14.363 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 38 kB/s | 12 kB 00:00 2024-06-06T02:21:14.521 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 152 kB/s | 83 kB 00:00 2024-06-06T02:21:14.603 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-06-06T02:21:14.797 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-06-06T02:21:15.097 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-06-06T02:21:15.139 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-06-06T02:21:15.564 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-06-06T02:21:15.932 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.1 MB 00:01 2024-06-06T02:21:16.557 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 8.9 MB/s | 8.1 MB 00:00 2024-06-06T02:21:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-06-06T02:21:17.784 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-06-06T02:21:18.801 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-06-06T02:21:21.951 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-06-06T02:21:22.734 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.2 MB 00:02 2024-06-06T02:21:23.368 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 17 kB 00:00 2024-06-06T02:21:23.659 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.2 MB 00:00 2024-06-06T02:21:24.413 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-06-06T02:21:24.433 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 17 kB 00:00 2024-06-06T02:21:25.518 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 17 kB 00:00 2024-06-06T02:21:25.536 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-06-06T02:21:26.747 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:01 2024-06-06T02:21:29.585 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-06T02:21:30.685 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-06-06T02:21:31.912 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:31.913 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:31.924 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T02:21:31.925 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T02:21:31.926 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T02:21:31.927 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T02:21:31.928 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T02:21:31.931 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T02:21:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T02:21:31.995 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-06-06T02:21:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-06T02:21:32.017 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-06-06T02:21:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-06T02:21:32.017 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 6.6 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.4 M 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 866 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 147 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 1.5 M 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 143 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 3.5 M 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 7.4 M 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 49 k 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 10 M 2024-06-06T02:21:32.018 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 43 M 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 273 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 764 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 227 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 27 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 18 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 32 k 2024-06-06T02:21:32.019 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 759 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 127 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 162 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 321 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 300 k 2024-06-06T02:21:32.020 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 99 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 86 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.0 M 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 169 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T02:21:32.021 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.3 M 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.1 M 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 20 M 2024-06-06T02:21:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 34 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 2.3 M 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 274 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 4.9 M 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 18 M 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 16 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 25 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T02:21:32.023 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 157 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 501 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.2 M 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T02:21:32.024 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T02:21:32.025 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 45 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 136 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T02:21:32.026 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T02:21:32.027 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T02:21:32.028 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T02:21:32.029 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T02:21:32.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T02:21:32.031 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================= 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:Install 148 Packages 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 11 Packages 2024-06-06T02:21:32.032 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:21:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 220 M 2024-06-06T02:21:32.033 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-06-06T02:21:32.695 INFO:teuthology.orchestra.run.smithi184.stdout:(1/159): ceph-19.0.0-4083.g3c55257c.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-06-06T02:21:32.882 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-06-06T02:21:32.928 INFO:teuthology.orchestra.run.smithi184.stdout:(2/159): ceph-fuse-19.0.0-4083.g3c55257c.el9.x8 3.6 MB/s | 866 kB 00:00 2024-06-06T02:21:32.979 INFO:teuthology.orchestra.run.smithi184.stdout:(3/159): ceph-immutable-object-cache-19.0.0-408 2.9 MB/s | 147 kB 00:00 2024-06-06T02:21:33.011 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:33.012 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:33.023 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T02:21:33.024 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T02:21:33.024 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T02:21:33.025 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T02:21:33.027 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T02:21:33.029 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T02:21:33.030 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T02:21:33.095 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 6.6 k 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.4 M 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 866 k 2024-06-06T02:21:33.113 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 147 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 1.5 M 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 143 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 3.5 M 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 7.4 M 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 49 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 10 M 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 43 M 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 273 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 764 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 227 k 2024-06-06T02:21:33.114 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 27 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 18 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 32 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 759 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 127 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T02:21:33.115 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 162 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 321 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 300 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 99 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 86 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.0 M 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 169 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T02:21:33.116 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.3 M 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.1 M 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T02:21:33.117 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 20 M 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 34 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 2.3 M 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 274 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 4.9 M 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 18 M 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 16 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 25 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T02:21:33.118 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 157 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T02:21:33.119 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 501 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.2 M 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T02:21:33.120 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T02:21:33.121 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 45 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 136 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T02:21:33.122 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T02:21:33.123 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T02:21:33.124 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T02:21:33.125 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T02:21:33.126 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-06-06T02:21:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 11 Packages 2024-06-06T02:21:33.128 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:21:33.128 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 220 M 2024-06-06T02:21:33.128 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-06-06T02:21:33.237 INFO:teuthology.orchestra.run.smithi184.stdout:(4/159): ceph-mds-19.0.0-4083.g3c55257c.el9.x86 8.8 MB/s | 2.3 MB 00:00 2024-06-06T02:21:33.396 INFO:teuthology.orchestra.run.smithi184.stdout:(5/159): ceph-mgr-19.0.0-4083.g3c55257c.el9.x86 9.5 MB/s | 1.5 MB 00:00 2024-06-06T02:21:33.771 INFO:teuthology.orchestra.run.smithi184.stdout:(6/159): ceph-base-19.0.0-4083.g3c55257c.el9.x8 4.3 MB/s | 5.4 MB 00:01 2024-06-06T02:21:33.846 INFO:teuthology.orchestra.run.smithi184.stdout:(7/159): ceph-mon-19.0.0-4083.g3c55257c.el9.x86 11 MB/s | 4.9 MB 00:00 2024-06-06T02:21:34.302 INFO:teuthology.orchestra.run.smithi103.stdout:(1/159): ceph-19.0.0-4083.g3c55257c.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-06-06T02:21:34.805 INFO:teuthology.orchestra.run.smithi184.stdout:(8/159): ceph-radosgw-19.0.0-4083.g3c55257c.el9 11 MB/s | 10 MB 00:00 2024-06-06T02:21:34.846 INFO:teuthology.orchestra.run.smithi184.stdout:(9/159): ceph-selinux-19.0.0-4083.g3c55257c.el9 607 kB/s | 25 kB 00:00 2024-06-06T02:21:35.319 INFO:teuthology.orchestra.run.smithi103.stdout:(2/159): ceph-fuse-19.0.0-4083.g3c55257c.el9.x8 851 kB/s | 866 kB 00:01 2024-06-06T02:21:35.458 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:35.460 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-06-06T02:21:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-06-06T02:21:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-06-06T02:21:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-06-06T02:21:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-06-06T02:21:35.487 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-06-06T02:21:35.490 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-06-06T02:21:35.491 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-06-06T02:21:35.511 INFO:teuthology.orchestra.run.smithi103.stdout:(3/159): ceph-immutable-object-cache-19.0.0-408 767 kB/s | 147 kB 00:00 2024-06-06T02:21:35.563 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-06-06T02:21:35.584 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 6.6 k 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.4 M 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 866 k 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 147 k 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 1.5 M 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 143 k 2024-06-06T02:21:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 3.5 M 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 7.4 M 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 49 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 10 M 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 43 M 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 273 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 764 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 227 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 27 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 18 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-06-06T02:21:35.586 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 32 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 759 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 127 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 162 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 321 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 300 k 2024-06-06T02:21:35.587 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 99 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 86 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.0 M 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 169 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.91-1.el9 baseos 2.3 M 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.91-1.el9 baseos 1.8 M 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.91-1.el9 baseos 41 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.91-1.el9 baseos 248 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.3 M 2024-06-06T02:21:35.588 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 3.1 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 20 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 34 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 2.3 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 274 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 4.9 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 18 M 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-4083.g3c55257c.el9 ceph-noarch 16 k 2024-06-06T02:21:35.589 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 25 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 157 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-06-06T02:21:35.590 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 501 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 5.2 M 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-06-06T02:21:35.591 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 45 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-4083.g3c55257c.el9 ceph 136 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-06-06T02:21:35.592 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-06-06T02:21:35.593 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-06-06T02:21:35.594 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-06-06T02:21:35.595 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-06-06T02:21:35.596 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 11 Packages 2024-06-06T02:21:35.597 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:21:35.598 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 220 M 2024-06-06T02:21:35.598 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-06-06T02:21:35.688 INFO:teuthology.orchestra.run.smithi184.stdout:(10/159): ceph-common-19.0.0-4083.g3c55257c.el9 6.2 MB/s | 20 MB 00:03 2024-06-06T02:21:35.797 INFO:teuthology.orchestra.run.smithi184.stdout:(11/159): cephfs-mirror-19.0.0-4083.g3c55257c.e 2.1 MB/s | 227 kB 00:00 2024-06-06T02:21:35.889 INFO:teuthology.orchestra.run.smithi184.stdout:(12/159): cephfs-shell-19.0.0-4083.g3c55257c.el 295 kB/s | 27 kB 00:00 2024-06-06T02:21:35.998 INFO:teuthology.orchestra.run.smithi184.stdout:(13/159): libcephfs-devel-19.0.0-4083.g3c55257c 293 kB/s | 32 kB 00:00 2024-06-06T02:21:36.192 INFO:teuthology.orchestra.run.smithi082.stdout:(1/159): ceph-19.0.0-4083.g3c55257c.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-06-06T02:21:36.298 INFO:teuthology.orchestra.run.smithi184.stdout:(14/159): ceph-osd-19.0.0-4083.g3c55257c.el9.x8 7.0 MB/s | 18 MB 00:02 2024-06-06T02:21:36.332 INFO:teuthology.orchestra.run.smithi184.stdout:(15/159): libcephfs2-19.0.0-4083.g3c55257c.el9. 2.2 MB/s | 759 kB 00:00 2024-06-06T02:21:36.407 INFO:teuthology.orchestra.run.smithi184.stdout:(16/159): libcephsqlite-19.0.0-4083.g3c55257c.e 1.4 MB/s | 157 kB 00:00 2024-06-06T02:21:36.432 INFO:teuthology.orchestra.run.smithi184.stdout:(17/159): librados-devel-19.0.0-4083.g3c55257c. 1.2 MB/s | 127 kB 00:00 2024-06-06T02:21:36.541 INFO:teuthology.orchestra.run.smithi184.stdout:(18/159): libradosstriper1-19.0.0-4083.g3c55257 3.7 MB/s | 501 kB 00:00 2024-06-06T02:21:36.603 INFO:teuthology.orchestra.run.smithi103.stdout:(4/159): ceph-mds-19.0.0-4083.g3c55257c.el9.x86 2.1 MB/s | 2.3 MB 00:01 2024-06-06T02:21:36.641 INFO:teuthology.orchestra.run.smithi184.stdout:(19/159): python3-ceph-argparse-19.0.0-4083.g3c 451 kB/s | 45 kB 00:00 2024-06-06T02:21:36.741 INFO:teuthology.orchestra.run.smithi184.stdout:(20/159): python3-ceph-common-19.0.0-4083.g3c55 1.3 MB/s | 136 kB 00:00 2024-06-06T02:21:36.759 INFO:teuthology.orchestra.run.smithi082.stdout:(2/159): ceph-fuse-19.0.0-4083.g3c55257c.el9.x8 1.5 MB/s | 866 kB 00:00 2024-06-06T02:21:36.833 INFO:teuthology.orchestra.run.smithi184.stdout:(21/159): python3-cephfs-19.0.0-4083.g3c55257c. 1.7 MB/s | 162 kB 00:00 2024-06-06T02:21:36.851 INFO:teuthology.orchestra.run.smithi082.stdout:(3/159): ceph-immutable-object-cache-19.0.0-408 1.6 MB/s | 147 kB 00:00 2024-06-06T02:21:36.942 INFO:teuthology.orchestra.run.smithi184.stdout:(22/159): python3-rados-19.0.0-4083.g3c55257c.e 2.9 MB/s | 321 kB 00:00 2024-06-06T02:21:37.059 INFO:teuthology.orchestra.run.smithi184.stdout:(23/159): python3-rbd-19.0.0-4083.g3c55257c.el9 2.5 MB/s | 300 kB 00:00 2024-06-06T02:21:37.161 INFO:teuthology.orchestra.run.smithi103.stdout:(5/159): ceph-mgr-19.0.0-4083.g3c55257c.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-06-06T02:21:37.167 INFO:teuthology.orchestra.run.smithi184.stdout:(24/159): python3-rgw-19.0.0-4083.g3c55257c.el9 917 kB/s | 99 kB 00:00 2024-06-06T02:21:37.293 INFO:teuthology.orchestra.run.smithi184.stdout:(25/159): rbd-fuse-19.0.0-4083.g3c55257c.el9.x8 686 kB/s | 86 kB 00:00 2024-06-06T02:21:37.726 INFO:teuthology.orchestra.run.smithi082.stdout:(4/159): ceph-mds-19.0.0-4083.g3c55257c.el9.x86 2.6 MB/s | 2.3 MB 00:00 2024-06-06T02:21:37.960 INFO:teuthology.orchestra.run.smithi184.stdout:(26/159): rbd-mirror-19.0.0-4083.g3c55257c.el9. 4.6 MB/s | 3.0 MB 00:00 2024-06-06T02:21:38.077 INFO:teuthology.orchestra.run.smithi184.stdout:(27/159): rbd-nbd-19.0.0-4083.g3c55257c.el9.x86 1.4 MB/s | 169 kB 00:00 2024-06-06T02:21:38.177 INFO:teuthology.orchestra.run.smithi184.stdout:(28/159): ceph-grafana-dashboards-19.0.0-4083.g 341 kB/s | 34 kB 00:00 2024-06-06T02:21:38.268 INFO:teuthology.orchestra.run.smithi082.stdout:(5/159): ceph-mgr-19.0.0-4083.g3c55257c.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-06-06T02:21:38.277 INFO:teuthology.orchestra.run.smithi184.stdout:(29/159): ceph-mgr-cephadm-19.0.0-4083.g3c55257 1.4 MB/s | 143 kB 00:00 2024-06-06T02:21:38.886 INFO:teuthology.orchestra.run.smithi103.stdout:(6/159): ceph-mon-19.0.0-4083.g3c55257c.el9.x86 2.8 MB/s | 4.9 MB 00:01 2024-06-06T02:21:39.044 INFO:teuthology.orchestra.run.smithi184.stdout:(30/159): ceph-mgr-dashboard-19.0.0-4083.g3c552 4.6 MB/s | 3.5 MB 00:00 2024-06-06T02:21:39.226 INFO:teuthology.orchestra.run.smithi082.stdout:(6/159): ceph-base-19.0.0-4083.g3c55257c.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-06-06T02:21:39.336 INFO:teuthology.orchestra.run.smithi103.stdout:(7/159): ceph-base-19.0.0-4083.g3c55257c.el9.x8 1.0 MB/s | 5.4 MB 00:05 2024-06-06T02:21:39.737 INFO:teuthology.orchestra.run.smithi103.stdout:(8/159): ceph-common-19.0.0-4083.g3c55257c.el9. 3.4 MB/s | 20 MB 00:05 2024-06-06T02:21:39.804 INFO:teuthology.orchestra.run.smithi103.stdout:(9/159): ceph-selinux-19.0.0-4083.g3c55257c.el9 379 kB/s | 25 kB 00:00 2024-06-06T02:21:39.861 INFO:teuthology.orchestra.run.smithi184.stdout:(31/159): ceph-test-19.0.0-4083.g3c55257c.el9.x 8.6 MB/s | 43 MB 00:05 2024-06-06T02:21:39.968 INFO:teuthology.orchestra.run.smithi082.stdout:(7/159): ceph-mon-19.0.0-4083.g3c55257c.el9.x86 2.9 MB/s | 4.9 MB 00:01 2024-06-06T02:21:39.970 INFO:teuthology.orchestra.run.smithi184.stdout:(32/159): ceph-mgr-modules-core-19.0.0-4083.g3c 2.5 MB/s | 274 kB 00:00 2024-06-06T02:21:40.037 INFO:teuthology.orchestra.run.smithi184.stdout:(33/159): ceph-mgr-rook-19.0.0-4083.g3c55257c.e 742 kB/s | 49 kB 00:00 2024-06-06T02:21:40.095 INFO:teuthology.orchestra.run.smithi184.stdout:(34/159): ceph-prometheus-alerts-19.0.0-4083.g3 283 kB/s | 16 kB 00:00 2024-06-06T02:21:40.187 INFO:teuthology.orchestra.run.smithi184.stdout:(35/159): ceph-volume-19.0.0-4083.g3c55257c.el9 2.9 MB/s | 273 kB 00:00 2024-06-06T02:21:40.218 INFO:teuthology.orchestra.run.smithi082.stdout:(8/159): ceph-common-19.0.0-4083.g3c55257c.el9. 4.5 MB/s | 20 MB 00:04 2024-06-06T02:21:40.280 INFO:teuthology.orchestra.run.smithi184.stdout:(36/159): ceph-mgr-diskprediction-local-19.0.0- 6.0 MB/s | 7.4 MB 00:01 2024-06-06T02:21:40.285 INFO:teuthology.orchestra.run.smithi082.stdout:(9/159): ceph-selinux-19.0.0-4083.g3c55257c.el9 384 kB/s | 25 kB 00:00 2024-06-06T02:21:40.338 INFO:teuthology.orchestra.run.smithi184.stdout:(37/159): cephadm-19.0.0-4083.g3c55257c.el9.noa 5.0 MB/s | 764 kB 00:00 2024-06-06T02:21:40.355 INFO:teuthology.orchestra.run.smithi184.stdout:(38/159): cephfs-top-19.0.0-4083.g3c55257c.el9. 243 kB/s | 18 kB 00:00 2024-06-06T02:21:40.422 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.424 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.505 INFO:teuthology.orchestra.run.smithi184.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 481 kB/s | 80 kB 00:00 2024-06-06T02:21:40.506 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.555 INFO:teuthology.orchestra.run.smithi184.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-06-06T02:21:40.589 INFO:teuthology.orchestra.run.smithi184.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-06-06T02:21:40.615 INFO:teuthology.orchestra.run.smithi184.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-06-06T02:21:40.656 INFO:teuthology.orchestra.run.smithi184.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-06T02:21:40.682 INFO:teuthology.orchestra.run.smithi184.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-06-06T02:21:40.707 INFO:teuthology.orchestra.run.smithi184.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-06-06T02:21:40.732 INFO:teuthology.orchestra.run.smithi184.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-06-06T02:21:40.758 INFO:teuthology.orchestra.run.smithi184.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-06T02:21:40.758 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.761 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.933 INFO:teuthology.orchestra.run.smithi184.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-06-06T02:21:40.967 INFO:teuthology.orchestra.run.smithi184.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-06-06T02:21:40.967 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:40.970 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] elfutils-libelf-devel-0.191-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/elfutils-libelf-devel-0.191-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:41.025 INFO:teuthology.orchestra.run.smithi184.stdout:(50/159): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-06-06T02:21:41.075 INFO:teuthology.orchestra.run.smithi184.stdout:(51/159): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-06-06T02:21:41.126 INFO:teuthology.orchestra.run.smithi184.stdout:(52/159): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-06-06T02:21:41.143 INFO:teuthology.orchestra.run.smithi184.stdout:(53/159): boost-program-options-1.75.0-8.el9.x8 509 kB/s | 107 kB 00:00 2024-06-06T02:21:41.218 INFO:teuthology.orchestra.run.smithi184.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 243 kB/s | 18 kB 00:00 2024-06-06T02:21:41.269 INFO:teuthology.orchestra.run.smithi184.stdout:(55/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-06-06T02:21:41.319 INFO:teuthology.orchestra.run.smithi184.stdout:(56/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-06T02:21:41.344 INFO:teuthology.orchestra.run.smithi184.stdout:(57/159): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-06-06T02:21:41.370 INFO:teuthology.orchestra.run.smithi184.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-06-06T02:21:41.403 INFO:teuthology.orchestra.run.smithi184.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-06-06T02:21:41.454 INFO:teuthology.orchestra.run.smithi184.stdout:(60/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 508 kB/s | 25 kB 00:00 2024-06-06T02:21:41.495 INFO:teuthology.orchestra.run.smithi184.stdout:(61/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-06-06T02:21:41.579 INFO:teuthology.orchestra.run.smithi184.stdout:(62/159): libtool-2.4.6-45.el9.x86_64.rpm 2.7 MB/s | 582 kB 00:00 2024-06-06T02:21:41.604 INFO:teuthology.orchestra.run.smithi184.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-06-06T02:21:41.671 INFO:teuthology.orchestra.run.smithi184.stdout:(64/159): librgw2-19.0.0-4083.g3c55257c.el9.x86 1.0 MB/s | 5.2 MB 00:05 2024-06-06T02:21:41.697 INFO:teuthology.orchestra.run.smithi184.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 35 kB 00:00 2024-06-06T02:21:41.939 INFO:teuthology.orchestra.run.smithi184.stdout:(66/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-06-06T02:21:41.989 INFO:teuthology.orchestra.run.smithi184.stdout:(67/159): lua-5.4.4-4.el9.x86_64.rpm 460 kB/s | 188 kB 00:00 2024-06-06T02:21:42.081 INFO:teuthology.orchestra.run.smithi184.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-06-06T02:21:42.123 INFO:teuthology.orchestra.run.smithi184.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-06-06T02:21:42.149 INFO:teuthology.orchestra.run.smithi184.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-06-06T02:21:42.190 INFO:teuthology.orchestra.run.smithi184.stdout:(71/159): postgresql-13.14-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-06-06T02:21:42.224 INFO:teuthology.orchestra.run.smithi184.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-06-06T02:21:42.249 INFO:teuthology.orchestra.run.smithi184.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-06-06T02:21:42.416 INFO:teuthology.orchestra.run.smithi184.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 367 kB/s | 61 kB 00:00 2024-06-06T02:21:42.474 INFO:teuthology.orchestra.run.smithi184.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-06-06T02:21:42.550 INFO:teuthology.orchestra.run.smithi184.stdout:(76/159): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-06-06T02:21:42.575 INFO:teuthology.orchestra.run.smithi184.stdout:(77/159): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-06-06T02:21:42.600 INFO:teuthology.orchestra.run.smithi184.stdout:(78/159): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-06-06T02:21:42.625 INFO:teuthology.orchestra.run.smithi184.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-06-06T02:21:42.651 INFO:teuthology.orchestra.run.smithi082.stdout:(10/159): ceph-radosgw-19.0.0-4083.g3c55257c.el 3.8 MB/s | 10 MB 00:02 2024-06-06T02:21:42.667 INFO:teuthology.orchestra.run.smithi184.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-06-06T02:21:42.693 INFO:teuthology.orchestra.run.smithi184.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-06-06T02:21:42.743 INFO:teuthology.orchestra.run.smithi184.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-06-06T02:21:42.768 INFO:teuthology.orchestra.run.smithi082.stdout:(11/159): cephfs-mirror-19.0.0-4083.g3c55257c.e 1.9 MB/s | 227 kB 00:00 2024-06-06T02:21:42.794 INFO:teuthology.orchestra.run.smithi184.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-06-06T02:21:42.835 INFO:teuthology.orchestra.run.smithi082.stdout:(12/159): cephfs-shell-19.0.0-4083.g3c55257c.el 412 kB/s | 27 kB 00:00 2024-06-06T02:21:42.860 INFO:teuthology.orchestra.run.smithi184.stdout:(84/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-06-06T02:21:42.886 INFO:teuthology.orchestra.run.smithi184.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 841 kB/s | 77 kB 00:00 2024-06-06T02:21:42.902 INFO:teuthology.orchestra.run.smithi082.stdout:(13/159): libcephfs-devel-19.0.0-4083.g3c55257c 481 kB/s | 32 kB 00:00 2024-06-06T02:21:42.911 INFO:teuthology.orchestra.run.smithi184.stdout:(86/159): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-06-06T02:21:42.936 INFO:teuthology.orchestra.run.smithi184.stdout:(87/159): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-06-06T02:21:42.962 INFO:teuthology.orchestra.run.smithi184.stdout:(88/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T02:21:42.987 INFO:teuthology.orchestra.run.smithi184.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-06T02:21:43.012 INFO:teuthology.orchestra.run.smithi184.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-06T02:21:43.038 INFO:teuthology.orchestra.run.smithi184.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-06T02:21:43.080 INFO:teuthology.orchestra.run.smithi184.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-06-06T02:21:43.127 INFO:teuthology.orchestra.run.smithi082.stdout:(14/159): libcephfs2-19.0.0-4083.g3c55257c.el9. 3.3 MB/s | 759 kB 00:00 2024-06-06T02:21:43.147 INFO:teuthology.orchestra.run.smithi184.stdout:(93/159): postgresql-server-13.14-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-06-06T02:21:43.172 INFO:teuthology.orchestra.run.smithi184.stdout:(94/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-06-06T02:21:43.203 INFO:teuthology.orchestra.run.smithi082.stdout:(15/159): libcephsqlite-19.0.0-4083.g3c55257c.e 2.1 MB/s | 157 kB 00:00 2024-06-06T02:21:43.214 INFO:teuthology.orchestra.run.smithi184.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-06-06T02:21:43.264 INFO:teuthology.orchestra.run.smithi184.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-06-06T02:21:43.278 INFO:teuthology.orchestra.run.smithi082.stdout:(16/159): librados-devel-19.0.0-4083.g3c55257c. 1.7 MB/s | 127 kB 00:00 2024-06-06T02:21:43.315 INFO:teuthology.orchestra.run.smithi184.stdout:(97/159): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-06-06T02:21:43.340 INFO:teuthology.orchestra.run.smithi184.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-06-06T02:21:43.462 INFO:teuthology.orchestra.run.smithi082.stdout:(17/159): libradosstriper1-19.0.0-4083.g3c55257 2.7 MB/s | 501 kB 00:00 2024-06-06T02:21:43.609 INFO:teuthology.orchestra.run.smithi184.stdout:(99/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-06-06T02:21:43.632 INFO:teuthology.orchestra.run.smithi184.stdout:(100/159): uuid-1.6.2-55.el9.x86_64.rpm 182 kB/s | 58 kB 00:00 2024-06-06T02:21:43.657 INFO:teuthology.orchestra.run.smithi184.stdout:(101/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 295 kB/s | 94 kB 00:00 2024-06-06T02:21:43.683 INFO:teuthology.orchestra.run.smithi184.stdout:(102/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 869 kB/s | 64 kB 00:00 2024-06-06T02:21:43.683 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:43.686 INFO:teuthology.orchestra.run.smithi184.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:43.716 INFO:teuthology.orchestra.run.smithi184.stdout:(103/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2024-06-06T02:21:43.767 INFO:teuthology.orchestra.run.smithi184.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2024-06-06T02:21:43.809 INFO:teuthology.orchestra.run.smithi184.stdout:(105/159): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-06-06T02:21:43.867 INFO:teuthology.orchestra.run.smithi184.stdout:(106/159): abseil-cpp-20211102.0-3.el9.x86_64.r 3.6 MB/s | 548 kB 00:00 2024-06-06T02:21:43.892 INFO:teuthology.orchestra.run.smithi184.stdout:(107/159): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-06-06T02:21:43.917 INFO:teuthology.orchestra.run.smithi184.stdout:(108/159): grpc-data-1.46.7-10.el9.noarch.rpm 179 kB/s | 19 kB 00:00 2024-06-06T02:21:43.954 INFO:teuthology.orchestra.run.smithi184.stdout:(109/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 424 kB/s | 26 kB 00:00 2024-06-06T02:21:43.977 INFO:teuthology.orchestra.run.smithi184.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 823 kB/s | 49 kB 00:00 2024-06-06T02:21:44.002 INFO:teuthology.orchestra.run.smithi184.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-06-06T02:21:44.036 INFO:teuthology.orchestra.run.smithi184.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-06T02:21:44.137 INFO:teuthology.orchestra.run.smithi103.stdout:(10/159): ceph-radosgw-19.0.0-4083.g3c55257c.el 2.1 MB/s | 10 MB 00:04 2024-06-06T02:21:44.144 INFO:teuthology.orchestra.run.smithi184.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-06-06T02:21:44.178 INFO:teuthology.orchestra.run.smithi184.stdout:(114/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 839 kB 00:00 2024-06-06T02:21:44.203 INFO:teuthology.orchestra.run.smithi184.stdout:(115/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-06-06T02:21:44.229 INFO:teuthology.orchestra.run.smithi184.stdout:(116/159): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-06-06T02:21:44.254 INFO:teuthology.orchestra.run.smithi184.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-06-06T02:21:44.262 INFO:teuthology.orchestra.run.smithi103.stdout:(11/159): cephfs-mirror-19.0.0-4083.g3c55257c.e 1.8 MB/s | 227 kB 00:00 2024-06-06T02:21:44.287 INFO:teuthology.orchestra.run.smithi184.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-06-06T02:21:44.338 INFO:teuthology.orchestra.run.smithi184.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-06-06T02:21:44.354 INFO:teuthology.orchestra.run.smithi103.stdout:(12/159): cephfs-shell-19.0.0-4083.g3c55257c.el 295 kB/s | 27 kB 00:00 2024-06-06T02:21:44.363 INFO:teuthology.orchestra.run.smithi184.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-06-06T02:21:44.397 INFO:teuthology.orchestra.run.smithi184.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-06-06T02:21:44.421 INFO:teuthology.orchestra.run.smithi103.stdout:(13/159): libcephfs-devel-19.0.0-4083.g3c55257c 477 kB/s | 32 kB 00:00 2024-06-06T02:21:44.439 INFO:teuthology.orchestra.run.smithi184.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-06-06T02:21:44.464 INFO:teuthology.orchestra.run.smithi184.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-06-06T02:21:44.489 INFO:teuthology.orchestra.run.smithi184.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-06-06T02:21:44.515 INFO:teuthology.orchestra.run.smithi184.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 927 kB/s | 23 kB 00:00 2024-06-06T02:21:44.540 INFO:teuthology.orchestra.run.smithi184.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-06-06T02:21:44.557 INFO:teuthology.orchestra.run.smithi184.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-06-06T02:21:44.632 INFO:teuthology.orchestra.run.smithi184.stdout:(128/159): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-06-06T02:21:44.645 INFO:teuthology.orchestra.run.smithi082.stdout:(18/159): ceph-test-19.0.0-4083.g3c55257c.el9.x 9.9 MB/s | 43 MB 00:04 2024-06-06T02:21:44.658 INFO:teuthology.orchestra.run.smithi184.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-06T02:21:44.708 INFO:teuthology.orchestra.run.smithi184.stdout:(130/159): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-06-06T02:21:44.733 INFO:teuthology.orchestra.run.smithi184.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-06-06T02:21:44.758 INFO:teuthology.orchestra.run.smithi184.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-06-06T02:21:44.762 INFO:teuthology.orchestra.run.smithi082.stdout:(19/159): python3-ceph-argparse-19.0.0-4083.g3c 391 kB/s | 45 kB 00:00 2024-06-06T02:21:44.792 INFO:teuthology.orchestra.run.smithi184.stdout:(133/159): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-06-06T02:21:44.805 INFO:teuthology.orchestra.run.smithi103.stdout:(14/159): libcephfs2-19.0.0-4083.g3c55257c.el9. 1.9 MB/s | 759 kB 00:00 2024-06-06T02:21:44.817 INFO:teuthology.orchestra.run.smithi184.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-06-06T02:21:44.851 INFO:teuthology.orchestra.run.smithi184.stdout:(135/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-06-06T02:21:44.876 INFO:teuthology.orchestra.run.smithi184.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-06-06T02:21:44.902 INFO:teuthology.orchestra.run.smithi184.stdout:(137/159): python3-pyperclip-1.8.2-2.el9.noarch 336 kB/s | 28 kB 00:00 2024-06-06T02:21:44.904 INFO:teuthology.orchestra.run.smithi082.stdout:(20/159): python3-ceph-common-19.0.0-4083.g3c55 962 kB/s | 136 kB 00:00 2024-06-06T02:21:44.927 INFO:teuthology.orchestra.run.smithi184.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-06-06T02:21:44.952 INFO:teuthology.orchestra.run.smithi184.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-06-06T02:21:44.963 INFO:teuthology.orchestra.run.smithi103.stdout:(15/159): libcephsqlite-19.0.0-4083.g3c55257c.e 994 kB/s | 157 kB 00:00 2024-06-06T02:21:44.977 INFO:teuthology.orchestra.run.smithi184.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-06-06T02:21:45.003 INFO:teuthology.orchestra.run.smithi184.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-06T02:21:45.036 INFO:teuthology.orchestra.run.smithi184.stdout:(142/159): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-06-06T02:21:45.038 INFO:teuthology.orchestra.run.smithi082.stdout:(21/159): python3-cephfs-19.0.0-4083.g3c55257c. 1.2 MB/s | 162 kB 00:00 2024-06-06T02:21:45.062 INFO:teuthology.orchestra.run.smithi184.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-06-06T02:21:45.087 INFO:teuthology.orchestra.run.smithi184.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-06-06T02:21:45.112 INFO:teuthology.orchestra.run.smithi184.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-06-06T02:21:45.137 INFO:teuthology.orchestra.run.smithi184.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T02:21:45.163 INFO:teuthology.orchestra.run.smithi082.stdout:(22/159): librgw2-19.0.0-4083.g3c55257c.el9.x86 3.0 MB/s | 5.2 MB 00:01 2024-06-06T02:21:45.188 INFO:teuthology.orchestra.run.smithi184.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-06-06T02:21:45.196 INFO:teuthology.orchestra.run.smithi082.stdout:(23/159): python3-rados-19.0.0-4083.g3c55257c.e 2.0 MB/s | 321 kB 00:00 2024-06-06T02:21:45.238 INFO:teuthology.orchestra.run.smithi184.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-06-06T02:21:45.313 INFO:teuthology.orchestra.run.smithi082.stdout:(24/159): python3-rgw-19.0.0-4083.g3c55257c.el9 859 kB/s | 99 kB 00:00 2024-06-06T02:21:45.347 INFO:teuthology.orchestra.run.smithi082.stdout:(25/159): python3-rbd-19.0.0-4083.g3c55257c.el9 1.6 MB/s | 300 kB 00:00 2024-06-06T02:21:45.397 INFO:teuthology.orchestra.run.smithi184.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-06T02:21:45.439 INFO:teuthology.orchestra.run.smithi082.stdout:(26/159): rbd-fuse-19.0.0-4083.g3c55257c.el9.x8 688 kB/s | 86 kB 00:00 2024-06-06T02:21:45.464 INFO:teuthology.orchestra.run.smithi184.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-06-06T02:21:45.506 INFO:teuthology.orchestra.run.smithi184.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 998 kB/s | 41 kB 00:00 2024-06-06T02:21:45.522 INFO:teuthology.orchestra.run.smithi103.stdout:(16/159): ceph-osd-19.0.0-4083.g3c55257c.el9.x8 2.7 MB/s | 18 MB 00:06 2024-06-06T02:21:45.548 INFO:teuthology.orchestra.run.smithi184.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-06T02:21:45.564 INFO:teuthology.orchestra.run.smithi082.stdout:(27/159): rbd-nbd-19.0.0-4083.g3c55257c.el9.x86 1.3 MB/s | 169 kB 00:00 2024-06-06T02:21:45.590 INFO:teuthology.orchestra.run.smithi184.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 883 kB/s | 37 kB 00:00 2024-06-06T02:21:45.632 INFO:teuthology.orchestra.run.smithi184.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-06-06T02:21:45.656 INFO:teuthology.orchestra.run.smithi103.stdout:(17/159): librados-devel-19.0.0-4083.g3c55257c. 183 kB/s | 127 kB 00:00 2024-06-06T02:21:45.673 INFO:teuthology.orchestra.run.smithi184.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-06-06T02:21:45.732 INFO:teuthology.orchestra.run.smithi184.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-06T02:21:45.816 INFO:teuthology.orchestra.run.smithi184.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-06-06T02:21:45.881 INFO:teuthology.orchestra.run.smithi103.stdout:(18/159): libradosstriper1-19.0.0-4083.g3c55257 1.4 MB/s | 501 kB 00:00 2024-06-06T02:21:45.890 INFO:teuthology.orchestra.run.smithi082.stdout:(28/159): ceph-osd-19.0.0-4083.g3c55257c.el9.x8 2.7 MB/s | 18 MB 00:06 2024-06-06T02:21:45.915 INFO:teuthology.orchestra.run.smithi082.stdout:(29/159): ceph-grafana-dashboards-19.0.0-4083.g 98 kB/s | 34 kB 00:00 2024-06-06T02:21:45.990 INFO:teuthology.orchestra.run.smithi103.stdout:(19/159): python3-ceph-argparse-19.0.0-4083.g3c 417 kB/s | 45 kB 00:00 2024-06-06T02:21:46.099 INFO:teuthology.orchestra.run.smithi082.stdout:(30/159): ceph-mgr-cephadm-19.0.0-4083.g3c55257 689 kB/s | 143 kB 00:00 2024-06-06T02:21:46.524 INFO:teuthology.orchestra.run.smithi082.stdout:(31/159): rbd-mirror-19.0.0-4083.g3c55257c.el9. 2.6 MB/s | 3.0 MB 00:01 2024-06-06T02:21:46.691 INFO:teuthology.orchestra.run.smithi082.stdout:(32/159): ceph-mgr-modules-core-19.0.0-4083.g3c 1.6 MB/s | 274 kB 00:00 2024-06-06T02:21:46.758 INFO:teuthology.orchestra.run.smithi184.stdout:(158/159): librbd1-19.0.0-4083.g3c55257c.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-06-06T02:21:46.773 INFO:teuthology.orchestra.run.smithi103.stdout:(20/159): python3-ceph-common-19.0.0-4083.g3c55 173 kB/s | 136 kB 00:00 2024-06-06T02:21:46.783 INFO:teuthology.orchestra.run.smithi082.stdout:(33/159): ceph-mgr-rook-19.0.0-4083.g3c55257c.e 543 kB/s | 49 kB 00:00 2024-06-06T02:21:46.875 INFO:teuthology.orchestra.run.smithi082.stdout:(34/159): ceph-prometheus-alerts-19.0.0-4083.g3 181 kB/s | 16 kB 00:00 2024-06-06T02:21:46.982 INFO:teuthology.orchestra.run.smithi103.stdout:(21/159): python3-cephfs-19.0.0-4083.g3c55257c. 777 kB/s | 162 kB 00:00 2024-06-06T02:21:47.042 INFO:teuthology.orchestra.run.smithi082.stdout:(35/159): ceph-volume-19.0.0-4083.g3c55257c.el9 1.6 MB/s | 273 kB 00:00 2024-06-06T02:21:47.299 INFO:teuthology.orchestra.run.smithi103.stdout:(22/159): python3-rados-19.0.0-4083.g3c55257c.e 1.0 MB/s | 321 kB 00:00 2024-06-06T02:21:47.439 INFO:teuthology.orchestra.run.smithi082.stdout:(36/159): cephadm-19.0.0-4083.g3c55257c.el9.noa 1.9 MB/s | 764 kB 00:00 2024-06-06T02:21:47.508 INFO:teuthology.orchestra.run.smithi103.stdout:(23/159): python3-rbd-19.0.0-4083.g3c55257c.el9 1.4 MB/s | 300 kB 00:00 2024-06-06T02:21:47.542 INFO:teuthology.orchestra.run.smithi082.stdout:(37/159): ceph-mgr-dashboard-19.0.0-4083.g3c552 2.2 MB/s | 3.5 MB 00:01 2024-06-06T02:21:47.567 INFO:teuthology.orchestra.run.smithi082.stdout:(38/159): cephfs-top-19.0.0-4083.g3c55257c.el9. 143 kB/s | 18 kB 00:00 2024-06-06T02:21:47.608 INFO:teuthology.orchestra.run.smithi103.stdout:(24/159): python3-rgw-19.0.0-4083.g3c55257c.el9 996 kB/s | 99 kB 00:00 2024-06-06T02:21:47.693 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:47.699 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:47.708 INFO:teuthology.orchestra.run.smithi103.stdout:(25/159): rbd-fuse-19.0.0-4083.g3c55257c.el9.x8 857 kB/s | 86 kB 00:00 2024-06-06T02:21:47.826 INFO:teuthology.orchestra.run.smithi082.stdout:(39/159): fuse-2.9.9-15.el9.x86_64.rpm 284 kB/s | 80 kB 00:00 2024-06-06T02:21:47.831 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:47.901 INFO:teuthology.orchestra.run.smithi082.stdout:(40/159): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-06-06T02:21:47.943 INFO:teuthology.orchestra.run.smithi082.stdout:(41/159): libgfortran-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 803 kB 00:00 2024-06-06T02:21:47.993 INFO:teuthology.orchestra.run.smithi082.stdout:(42/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-06-06T02:21:48.136 INFO:teuthology.orchestra.run.smithi082.stdout:(43/159): python3-ply-3.11-14.el9.noarch.rpm 755 kB/s | 106 kB 00:00 2024-06-06T02:21:48.186 INFO:teuthology.orchestra.run.smithi082.stdout:(44/159): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-06-06T02:21:48.219 INFO:teuthology.orchestra.run.smithi082.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-06-06T02:21:48.253 INFO:teuthology.orchestra.run.smithi082.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-06-06T02:21:48.255 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T02:21:48.295 INFO:teuthology.orchestra.run.smithi082.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-06-06T02:21:48.297 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:48.370 INFO:teuthology.orchestra.run.smithi082.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-06-06T02:21:48.373 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:48.437 INFO:teuthology.orchestra.run.smithi082.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 6.5 MB/s | 943 kB 00:00 2024-06-06T02:21:48.471 INFO:teuthology.orchestra.run.smithi082.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-06-06T02:21:48.630 INFO:teuthology.orchestra.run.smithi082.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 113 kB/s | 22 kB 00:00 2024-06-06T02:21:48.663 INFO:teuthology.orchestra.run.smithi082.stdout:(52/159): flex-2.6.4-9.el9.x86_64.rpm 1.6 MB/s | 313 kB 00:00 2024-06-06T02:21:49.172 INFO:teuthology.orchestra.run.smithi082.stdout:(53/159): ceph-mgr-diskprediction-local-19.0.0- 2.4 MB/s | 7.4 MB 00:03 2024-06-06T02:21:49.256 INFO:teuthology.orchestra.run.smithi082.stdout:(54/159): flexiblas-openblas-openmp-3.0.4-8.el9 220 kB/s | 18 kB 00:00 2024-06-06T02:21:49.258 INFO:teuthology.orchestra.run.smithi103.stdout:(26/159): rbd-mirror-19.0.0-4083.g3c55257c.el9. 2.0 MB/s | 3.0 MB 00:01 2024-06-06T02:21:49.306 INFO:teuthology.orchestra.run.smithi082.stdout:(55/159): libaio-devel-0.3.111-13.el9.x86_64.rp 224 kB/s | 11 kB 00:00 2024-06-06T02:21:49.317 INFO:teuthology.orchestra.run.smithi103.stdout:(27/159): rbd-nbd-19.0.0-4083.g3c55257c.el9.x86 2.8 MB/s | 169 kB 00:00 2024-06-06T02:21:49.360 INFO:teuthology.orchestra.run.smithi082.stdout:(56/159): flexiblas-3.0.4-8.el9.x86_64.rpm 45 kB/s | 33 kB 00:00 2024-06-06T02:21:49.376 INFO:teuthology.orchestra.run.smithi103.stdout:(28/159): ceph-grafana-dashboards-19.0.0-4083.g 586 kB/s | 34 kB 00:00 2024-06-06T02:21:49.406 INFO:teuthology.orchestra.run.smithi082.stdout:(57/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 988 kB/s | 45 kB 00:00 2024-06-06T02:21:49.443 INFO:teuthology.orchestra.run.smithi103.stdout:(29/159): librgw2-19.0.0-4083.g3c55257c.el9.x86 1.4 MB/s | 5.2 MB 00:03 2024-06-06T02:21:49.448 INFO:teuthology.orchestra.run.smithi082.stdout:(58/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-06-06T02:21:49.468 INFO:teuthology.orchestra.run.smithi103.stdout:(30/159): ceph-mgr-cephadm-19.0.0-4083.g3c55257 1.5 MB/s | 143 kB 00:00 2024-06-06T02:21:49.541 INFO:teuthology.orchestra.run.smithi082.stdout:(59/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-06-06T02:21:49.574 INFO:teuthology.orchestra.run.smithi082.stdout:(60/159): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-06-06T02:21:49.599 INFO:teuthology.orchestra.run.smithi082.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-06-06T02:21:49.625 INFO:teuthology.orchestra.run.smithi082.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 959 kB/s | 47 kB 00:00 2024-06-06T02:21:49.658 INFO:teuthology.orchestra.run.smithi082.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-06-06T02:21:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:(64/159): libtool-2.4.6-45.el9.x86_64.rpm 2.3 MB/s | 582 kB 00:00 2024-06-06T02:21:49.726 INFO:teuthology.orchestra.run.smithi082.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 534 kB/s | 35 kB 00:00 2024-06-06T02:21:49.759 INFO:teuthology.orchestra.run.smithi082.stdout:(66/159): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-06-06T02:21:49.901 INFO:teuthology.orchestra.run.smithi082.stdout:(67/159): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-06-06T02:21:49.984 INFO:teuthology.orchestra.run.smithi082.stdout:(68/159): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-06-06T02:21:50.024 INFO:teuthology.orchestra.run.smithi184.stdout:(159/159): librados2-19.0.0-4083.g3c55257c.el9. 698 kB/s | 3.3 MB 00:04 2024-06-06T02:21:50.031 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-06-06T02:21:50.031 INFO:teuthology.orchestra.run.smithi184.stdout:Total 12 MB/s | 220 MB 00:18 2024-06-06T02:21:50.035 INFO:teuthology.orchestra.run.smithi082.stdout:(69/159): postgresql-private-libs-13.14-1.el9.x 2.6 MB/s | 133 kB 00:00 2024-06-06T02:21:50.102 INFO:teuthology.orchestra.run.smithi082.stdout:(70/159): postgresql-13.14-1.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2024-06-06T02:21:50.227 INFO:teuthology.orchestra.run.smithi082.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-06-06T02:21:50.486 INFO:teuthology.orchestra.run.smithi082.stdout:(72/159): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-06-06T02:21:50.678 INFO:teuthology.orchestra.run.smithi082.stdout:(73/159): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-06-06T02:21:50.728 INFO:teuthology.orchestra.run.smithi082.stdout:(74/159): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-06-06T02:21:50.778 INFO:teuthology.orchestra.run.smithi082.stdout:(75/159): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-06-06T02:21:50.837 INFO:teuthology.orchestra.run.smithi082.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-06-06T02:21:50.893 INFO:teuthology.orchestra.run.smithi103.stdout:(31/159): ceph-test-19.0.0-4083.g3c55257c.el9.x 3.9 MB/s | 43 MB 00:11 2024-06-06T02:21:50.912 INFO:teuthology.orchestra.run.smithi082.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 345 kB/s | 26 kB 00:00 2024-06-06T02:21:50.979 INFO:teuthology.orchestra.run.smithi082.stdout:(78/159): python3-attrs-20.3.0-7.el9.noarch.rpm 116 kB/s | 87 kB 00:00 2024-06-06T02:21:51.102 INFO:teuthology.orchestra.run.smithi103.stdout:(32/159): ceph-mgr-modules-core-19.0.0-4083.g3c 1.3 MB/s | 274 kB 00:00 2024-06-06T02:21:51.146 INFO:teuthology.orchestra.run.smithi082.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 82 kB/s | 19 kB 00:00 2024-06-06T02:21:51.169 INFO:teuthology.orchestra.run.smithi103.stdout:(33/159): ceph-mgr-rook-19.0.0-4083.g3c55257c.e 741 kB/s | 49 kB 00:00 2024-06-06T02:21:51.188 INFO:teuthology.orchestra.run.smithi082.stdout:(80/159): protobuf-3.14.0-13.el9.x86_64.rpm 952 kB/s | 1.0 MB 00:01 2024-06-06T02:21:51.221 INFO:teuthology.orchestra.run.smithi082.stdout:(81/159): python3-mako-1.1.4-6.el9.noarch.rpm 712 kB/s | 172 kB 00:00 2024-06-06T02:21:51.227 INFO:teuthology.orchestra.run.smithi103.stdout:(34/159): ceph-prometheus-alerts-19.0.0-4083.g3 282 kB/s | 16 kB 00:00 2024-06-06T02:21:51.246 INFO:teuthology.orchestra.run.smithi082.stdout:(82/159): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-06-06T02:21:51.252 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-06-06T02:21:51.297 INFO:teuthology.orchestra.run.smithi082.stdout:(83/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-06-06T02:21:51.320 INFO:teuthology.orchestra.run.smithi103.stdout:(35/159): ceph-mgr-dashboard-19.0.0-4083.g3c552 1.9 MB/s | 3.5 MB 00:01 2024-06-06T02:21:51.353 INFO:teuthology.orchestra.run.smithi103.stdout:(36/159): ceph-volume-19.0.0-4083.g3c55257c.el9 2.1 MB/s | 273 kB 00:00 2024-06-06T02:21:51.381 INFO:teuthology.orchestra.run.smithi082.stdout:(84/159): python3-packaging-20.9-5.el9.noarch.r 929 kB/s | 77 kB 00:00 2024-06-06T02:21:51.406 INFO:teuthology.orchestra.run.smithi082.stdout:(85/159): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-06-06T02:21:51.412 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-06-06T02:21:51.412 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-06-06T02:21:51.428 INFO:teuthology.orchestra.run.smithi103.stdout:(37/159): cephfs-top-19.0.0-4083.g3c55257c.el9. 243 kB/s | 18 kB 00:00 2024-06-06T02:21:51.472 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] fuse-2.9.9-15.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/fuse-2.9.9-15.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:51.506 INFO:teuthology.orchestra.run.smithi082.stdout:(86/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-06-06T02:21:51.557 INFO:teuthology.orchestra.run.smithi082.stdout:(87/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-06-06T02:21:51.562 INFO:teuthology.orchestra.run.smithi103.stdout:(38/159): fuse-2.9.9-15.el9.x86_64.rpm 603 kB/s | 80 kB 00:00 2024-06-06T02:21:51.563 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] libgfortran-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:51.607 INFO:teuthology.orchestra.run.smithi082.stdout:(88/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-06-06T02:21:51.612 INFO:teuthology.orchestra.run.smithi103.stdout:(39/159): cephadm-19.0.0-4083.g3c55257c.el9.noa 2.5 MB/s | 764 kB 00:00 2024-06-06T02:21:51.616 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] libquadmath-11.4.1-3.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.4.1-3.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:51.657 INFO:teuthology.orchestra.run.smithi082.stdout:(89/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-06T02:21:51.688 INFO:teuthology.orchestra.run.smithi103.stdout:(40/159): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 803 kB 00:00 2024-06-06T02:21:51.708 INFO:teuthology.orchestra.run.smithi082.stdout:(90/159): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-06-06T02:21:51.730 INFO:teuthology.orchestra.run.smithi103.stdout:(41/159): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-06-06T02:21:51.755 INFO:teuthology.orchestra.run.smithi103.stdout:(42/159): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-06-06T02:21:51.797 INFO:teuthology.orchestra.run.smithi103.stdout:(43/159): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-06-06T02:21:51.823 INFO:teuthology.orchestra.run.smithi103.stdout:(44/159): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-06-06T02:21:51.848 INFO:teuthology.orchestra.run.smithi103.stdout:(45/159): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-06-06T02:21:51.849 INFO:teuthology.orchestra.run.smithi082.stdout:(91/159): python3-prettytable-0.7.2-27.el9.noar 90 kB/s | 42 kB 00:00 2024-06-06T02:21:51.873 INFO:teuthology.orchestra.run.smithi103.stdout:(46/159): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-06-06T02:21:51.874 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] automake-1.16.2-8.el9.noarch.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/automake-1.16.2-8.el9.noarch.rpm (IP: 8.43.85.72) 2024-06-06T02:21:51.875 INFO:teuthology.orchestra.run.smithi082.stdout:(92/159): python3-protobuf-3.14.0-13.el9.noarch 576 kB/s | 269 kB 00:00 2024-06-06T02:21:51.899 INFO:teuthology.orchestra.run.smithi103.stdout:(47/159): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-06-06T02:21:51.902 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] bison-3.7.4-5.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/bison-3.7.4-5.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:52.066 INFO:teuthology.orchestra.run.smithi103.stdout:(48/159): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-06-06T02:21:52.068 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] boost-program-options-1.75.0-8.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/boost-program-options-1.75.0-8.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:52.116 INFO:teuthology.orchestra.run.smithi103.stdout:(49/159): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-06-06T02:21:52.117 INFO:teuthology.orchestra.run.smithi082.stdout:(93/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-06-06T02:21:52.133 INFO:teuthology.orchestra.run.smithi082.stdout:(94/159): python3-toml-0.10.2-6.el9.noarch.rpm 147 kB/s | 42 kB 00:00 2024-06-06T02:21:52.141 INFO:teuthology.orchestra.run.smithi103.stdout:(50/159): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-06-06T02:21:52.150 INFO:teuthology.orchestra.run.smithi082.stdout:(95/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 160 kB/s | 44 kB 00:00 2024-06-06T02:21:52.166 INFO:teuthology.orchestra.run.smithi103.stdout:(51/159): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-06-06T02:21:52.184 INFO:teuthology.orchestra.run.smithi082.stdout:(96/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-06-06T02:21:52.258 INFO:teuthology.orchestra.run.smithi103.stdout:(52/159): ceph-mgr-diskprediction-local-19.0.0- 2.7 MB/s | 7.4 MB 00:02 2024-06-06T02:21:52.259 INFO:teuthology.orchestra.run.smithi082.stdout:(97/159): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 305 kB 00:00 2024-06-06T02:21:52.276 INFO:teuthology.orchestra.run.smithi082.stdout:(98/159): qatlib-service-24.02.0-1.el9.x86_64.r 288 kB/s | 36 kB 00:00 2024-06-06T02:21:52.284 INFO:teuthology.orchestra.run.smithi103.stdout:(53/159): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-06-06T02:21:52.293 INFO:teuthology.orchestra.run.smithi082.stdout:(99/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 336 kB/s | 47 kB 00:00 2024-06-06T02:21:52.309 INFO:teuthology.orchestra.run.smithi103.stdout:(54/159): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-06-06T02:21:52.318 INFO:teuthology.orchestra.run.smithi082.stdout:(100/159): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-06-06T02:21:52.334 INFO:teuthology.orchestra.run.smithi103.stdout:(55/159): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-06-06T02:21:52.335 INFO:teuthology.orchestra.run.smithi082.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-06-06T02:21:52.360 INFO:teuthology.orchestra.run.smithi103.stdout:(56/159): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-06-06T02:21:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:(102/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-06-06T02:21:52.362 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:52.364 INFO:teuthology.orchestra.run.smithi082.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:52.385 INFO:teuthology.orchestra.run.smithi103.stdout:(57/159): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-06-06T02:21:52.386 INFO:teuthology.orchestra.run.smithi082.stdout:(103/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-06-06T02:21:52.410 INFO:teuthology.orchestra.run.smithi103.stdout:(58/159): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-06-06T02:21:52.411 INFO:teuthology.orchestra.run.smithi082.stdout:(104/159): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-06-06T02:21:52.452 INFO:teuthology.orchestra.run.smithi103.stdout:(59/159): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-06-06T02:21:52.461 INFO:teuthology.orchestra.run.smithi082.stdout:(105/159): gperftools-libs-2.9.1-2.el9.x86_64.r 6.1 MB/s | 309 kB 00:00 2024-06-06T02:21:52.486 INFO:teuthology.orchestra.run.smithi103.stdout:(60/159): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-06-06T02:21:52.486 INFO:teuthology.orchestra.run.smithi082.stdout:(106/159): grpc-data-1.46.7-10.el9.noarch.rpm 802 kB/s | 19 kB 00:00 2024-06-06T02:21:52.511 INFO:teuthology.orchestra.run.smithi103.stdout:(61/159): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-06-06T02:21:52.537 INFO:teuthology.orchestra.run.smithi103.stdout:(62/159): libzstd-devel-1.5.1-2.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-06-06T02:21:52.537 INFO:teuthology.orchestra.run.smithi082.stdout:(107/159): abseil-cpp-20211102.0-3.el9.x86_64.r 3.6 MB/s | 548 kB 00:00 2024-06-06T02:21:52.562 INFO:teuthology.orchestra.run.smithi103.stdout:(63/159): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-06-06T02:21:52.562 INFO:teuthology.orchestra.run.smithi082.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-06-06T02:21:52.579 INFO:teuthology.orchestra.run.smithi103.stdout:(64/159): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-06-06T02:21:52.596 INFO:teuthology.orchestra.run.smithi082.stdout:(109/159): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-06-06T02:21:52.612 INFO:teuthology.orchestra.run.smithi103.stdout:(65/159): openblas-0.3.21-2.el9.x86_64.rpm 699 kB/s | 35 kB 00:00 2024-06-06T02:21:52.621 INFO:teuthology.orchestra.run.smithi082.stdout:(110/159): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-06-06T02:21:52.663 INFO:teuthology.orchestra.run.smithi103.stdout:(66/159): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-06-06T02:21:52.671 INFO:teuthology.orchestra.run.smithi082.stdout:(111/159): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-06-06T02:21:52.763 INFO:teuthology.orchestra.run.smithi082.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-06-06T02:21:52.780 INFO:teuthology.orchestra.run.smithi103.stdout:(67/159): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-06-06T02:21:52.830 INFO:teuthology.orchestra.run.smithi082.stdout:(113/159): python3-asyncssh-2.13.2-5.el9.noarch 8.8 MB/s | 548 kB 00:00 2024-06-06T02:21:52.856 INFO:teuthology.orchestra.run.smithi082.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-06T02:21:52.881 INFO:teuthology.orchestra.run.smithi082.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T02:21:52.906 INFO:teuthology.orchestra.run.smithi082.stdout:(116/159): python3-certifi-2021.10.8-2.el9.noar 624 kB/s | 15 kB 00:00 2024-06-06T02:21:52.965 INFO:teuthology.orchestra.run.smithi082.stdout:(117/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.8 MB/s | 839 kB 00:00 2024-06-06T02:21:52.990 INFO:teuthology.orchestra.run.smithi082.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-06-06T02:21:53.041 INFO:teuthology.orchestra.run.smithi082.stdout:(119/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 6.0 MB/s | 303 kB 00:00 2024-06-06T02:21:53.074 INFO:teuthology.orchestra.run.smithi082.stdout:(120/159): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-06-06T02:21:53.116 INFO:teuthology.orchestra.run.smithi082.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-06-06T02:21:53.158 INFO:teuthology.orchestra.run.smithi082.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 3.5 MB/s | 144 kB 00:00 2024-06-06T02:21:53.201 INFO:teuthology.orchestra.run.smithi082.stdout:(123/159): python3-jaraco-8.2.1-3.el9.noarch.rp 266 kB/s | 11 kB 00:00 2024-06-06T02:21:53.234 INFO:teuthology.orchestra.run.smithi082.stdout:(124/159): python3-jaraco-classes-3.2.1-5.el9.n 536 kB/s | 18 kB 00:00 2024-06-06T02:21:53.259 INFO:teuthology.orchestra.run.smithi082.stdout:(125/159): python3-jaraco-collections-3.0.0-8.e 958 kB/s | 23 kB 00:00 2024-06-06T02:21:53.271 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-06-06T02:21:53.272 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-06-06T02:21:53.284 INFO:teuthology.orchestra.run.smithi082.stdout:(126/159): python3-jaraco-functools-3.5.0-2.el9 803 kB/s | 19 kB 00:00 2024-06-06T02:21:53.310 INFO:teuthology.orchestra.run.smithi082.stdout:(127/159): python3-jaraco-text-3.2.0-6.el9.noar 821 kB/s | 20 kB 00:00 2024-06-06T02:21:53.388 INFO:teuthology.orchestra.run.smithi103.stdout:(68/159): openblas-openmp-0.3.21-2.el9.x86_64.r 5.9 MB/s | 4.7 MB 00:00 2024-06-06T02:21:53.410 INFO:teuthology.orchestra.run.smithi082.stdout:(128/159): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-06-06T02:21:53.431 INFO:teuthology.orchestra.run.smithi103.stdout:(69/159): postgresql-contrib-13.14-1.el9.x86_64 1.4 MB/s | 911 kB 00:00 2024-06-06T02:21:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-06-06T02:21:53.456 INFO:teuthology.orchestra.run.smithi103.stdout:(70/159): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-06-06T02:21:53.469 INFO:teuthology.orchestra.run.smithi082.stdout:(130/159): python3-more-itertools-8.12.0-2.el9. 2.4 MB/s | 79 kB 00:00 2024-06-06T02:21:53.502 INFO:teuthology.orchestra.run.smithi082.stdout:(131/159): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-06-06T02:21:53.522 INFO:teuthology.orchestra.run.smithi103.stdout:(71/159): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-06-06T02:21:53.556 INFO:teuthology.orchestra.run.smithi103.stdout:(72/159): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-06-06T02:21:53.578 INFO:teuthology.orchestra.run.smithi082.stdout:(132/159): python3-grpcio-1.46.7-10.el9.x86_64. 4.1 MB/s | 2.0 MB 00:00 2024-06-06T02:21:53.581 INFO:teuthology.orchestra.run.smithi103.stdout:(73/159): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-06-06T02:21:53.603 INFO:teuthology.orchestra.run.smithi082.stdout:(133/159): python3-portend-3.1.0-2.el9.noarch.r 679 kB/s | 16 kB 00:00 2024-06-06T02:21:53.637 INFO:teuthology.orchestra.run.smithi082.stdout:(134/159): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-06-06T02:21:53.670 INFO:teuthology.orchestra.run.smithi082.stdout:(135/159): python3-pyperclip-1.8.2-2.el9.noarch 870 kB/s | 28 kB 00:00 2024-06-06T02:21:53.704 INFO:teuthology.orchestra.run.smithi082.stdout:(136/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 903 kB/s | 90 kB 00:00 2024-06-06T02:21:53.729 INFO:teuthology.orchestra.run.smithi082.stdout:(137/159): python3-repoze-lru-0.7-16.el9.noarch 533 kB/s | 31 kB 00:00 2024-06-06T02:21:53.754 INFO:teuthology.orchestra.run.smithi082.stdout:(138/159): python3-rsa-4.9-2.el9.noarch.rpm 2.4 MB/s | 59 kB 00:00 2024-06-06T02:21:53.765 INFO:teuthology.orchestra.run.smithi103.stdout:(74/159): postgresql-server-13.14-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-06-06T02:21:53.771 INFO:teuthology.orchestra.run.smithi082.stdout:(139/159): python3-tempora-5.0.0-2.el9.noarch.r 2.2 MB/s | 36 kB 00:00 2024-06-06T02:21:53.805 INFO:teuthology.orchestra.run.smithi082.stdout:(140/159): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-06-06T02:21:53.824 INFO:teuthology.orchestra.run.smithi103.stdout:(75/159): python3-colorama-0.4.6-3.el9.noarch.r 253 kB/s | 61 kB 00:00 2024-06-06T02:21:53.830 INFO:teuthology.orchestra.run.smithi082.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 887 kB/s | 51 kB 00:00 2024-06-06T02:21:53.864 INFO:teuthology.orchestra.run.smithi082.stdout:(142/159): python3-websocket-client-1.2.3-2.el9 2.7 MB/s | 90 kB 00:00 2024-06-06T02:21:53.891 INFO:teuthology.orchestra.run.smithi103.stdout:(76/159): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-06-06T02:21:53.898 INFO:teuthology.orchestra.run.smithi082.stdout:(143/159): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-06-06T02:21:53.941 INFO:teuthology.orchestra.run.smithi103.stdout:(77/159): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-06-06T02:21:53.998 INFO:teuthology.orchestra.run.smithi082.stdout:(144/159): libarrow-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-06-06T02:21:54.025 INFO:teuthology.orchestra.run.smithi103.stdout:(78/159): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-06-06T02:21:54.042 INFO:teuthology.orchestra.run.smithi103.stdout:(79/159): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-06-06T02:21:54.075 INFO:teuthology.orchestra.run.smithi103.stdout:(80/159): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-06-06T02:21:54.101 INFO:teuthology.orchestra.run.smithi103.stdout:(81/159): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-06-06T02:21:54.188 INFO:teuthology.orchestra.run.smithi082.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 69 kB/s | 20 kB 00:00 2024-06-06T02:21:54.249 INFO:teuthology.orchestra.run.smithi082.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 767 kB/s | 192 kB 00:00 2024-06-06T02:21:54.282 INFO:teuthology.orchestra.run.smithi082.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 1.0 MB/s | 427 kB 00:00 2024-06-06T02:21:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:(82/159): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 250 kB 00:00 2024-06-06T02:21:54.393 INFO:teuthology.orchestra.run.smithi103.stdout:(83/159): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-06-06T02:21:54.399 INFO:teuthology.orchestra.run.smithi082.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 7.5 MB/s | 1.6 MB 00:00 2024-06-06T02:21:54.460 INFO:teuthology.orchestra.run.smithi103.stdout:(84/159): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-06-06T02:21:54.485 INFO:teuthology.orchestra.run.smithi103.stdout:(85/159): python3-packaging-20.9-5.el9.noarch.r 839 kB/s | 77 kB 00:00 2024-06-06T02:21:54.636 INFO:teuthology.orchestra.run.smithi103.stdout:(86/159): python3-devel-3.9.18-3.el9.x86_64.rpm 281 kB/s | 244 kB 00:00 2024-06-06T02:21:54.769 INFO:teuthology.orchestra.run.smithi103.stdout:(87/159): python3-prettytable-0.7.2-27.el9.noar 137 kB/s | 42 kB 00:00 2024-06-06T02:21:54.795 INFO:teuthology.orchestra.run.smithi103.stdout:(88/159): python3-protobuf-3.14.0-13.el9.noarch 872 kB/s | 269 kB 00:00 2024-06-06T02:21:54.820 INFO:teuthology.orchestra.run.smithi103.stdout:(89/159): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-06-06T02:21:54.845 INFO:teuthology.orchestra.run.smithi103.stdout:(90/159): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-06-06T02:21:54.870 INFO:teuthology.orchestra.run.smithi103.stdout:(91/159): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-06-06T02:21:54.946 INFO:teuthology.orchestra.run.smithi103.stdout:(92/159): python3-toml-0.10.2-6.el9.noarch.rpm 556 kB/s | 42 kB 00:00 2024-06-06T02:21:55.021 INFO:teuthology.orchestra.run.smithi103.stdout:(93/159): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-06-06T02:21:55.033 INFO:teuthology.orchestra.run.smithi082.stdout:(149/159): librados2-19.0.0-4083.g3c55257c.el9. 4.3 MB/s | 3.3 MB 00:00 2024-06-06T02:21:55.088 INFO:teuthology.orchestra.run.smithi103.stdout:(94/159): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-06-06T02:21:55.116 INFO:teuthology.orchestra.run.smithi082.stdout:(150/159): librbd1-19.0.0-4083.g3c55257c.el9.x8 3.7 MB/s | 3.1 MB 00:00 2024-06-06T02:21:55.155 INFO:teuthology.orchestra.run.smithi103.stdout:(95/159): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-06-06T02:21:55.214 INFO:teuthology.orchestra.run.smithi103.stdout:(96/159): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-06-06T02:21:55.225 INFO:teuthology.orchestra.run.smithi082.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 384 kB/s | 41 kB 00:00 2024-06-06T02:21:55.347 INFO:teuthology.orchestra.run.smithi103.stdout:(97/159): python3-pyasn1-0.4.8-6.el9.noarch.rpm 223 kB/s | 159 kB 00:00 2024-06-06T02:21:55.350 INFO:teuthology.orchestra.run.smithi082.stdout:(152/159): NetworkManager-1.47.91-1.el9.x86_64. 2.4 MB/s | 2.3 MB 00:00 2024-06-06T02:21:55.409 INFO:teuthology.orchestra.run.smithi082.stdout:(153/159): NetworkManager-libnm-1.47.91-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-06-06T02:21:55.431 INFO:teuthology.orchestra.run.smithi103.stdout:(98/159): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-06-06T02:21:55.490 INFO:teuthology.orchestra.run.smithi103.stdout:(99/159): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-06-06T02:21:55.525 INFO:teuthology.orchestra.run.smithi082.stdout:(154/159): NetworkManager-tui-1.47.91-1.el9.x86 827 kB/s | 248 kB 00:00 2024-06-06T02:21:55.576 INFO:teuthology.orchestra.run.smithi082.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-06-06T02:21:55.601 INFO:teuthology.orchestra.run.smithi082.stdout:(156/159): elfutils-debuginfod-client-0.191-4.e 147 kB/s | 37 kB 00:00 2024-06-06T02:21:55.635 INFO:teuthology.orchestra.run.smithi082.stdout:(157/159): elfutils-libelf-0.191-4.el9.x86_64.r 918 kB/s | 207 kB 00:00 2024-06-06T02:21:55.682 INFO:teuthology.orchestra.run.smithi103.stdout:(100/159): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-06-06T02:21:55.693 INFO:teuthology.orchestra.run.smithi082.stdout:(158/159): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-06-06T02:21:55.707 INFO:teuthology.orchestra.run.smithi103.stdout:(101/159): xmlstarlet-1.6.1-20.el9.x86_64.rpm 294 kB/s | 64 kB 00:00 2024-06-06T02:21:55.711 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:55.740 INFO:teuthology.orchestra.run.smithi103.stdout:(102/159): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-06-06T02:21:55.774 INFO:teuthology.orchestra.run.smithi103.stdout:(103/159): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-06-06T02:21:55.775 INFO:teuthology.orchestra.run.smithi103.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Status code: 404 for https://download-cc-rdu01.fedoraproject.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm (IP: 8.43.85.72) 2024-06-06T02:21:55.824 INFO:teuthology.orchestra.run.smithi103.stdout:(104/159): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-06-06T02:21:55.892 INFO:teuthology.orchestra.run.smithi103.stdout:(105/159): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-06-06T02:21:55.917 INFO:teuthology.orchestra.run.smithi103.stdout:(106/159): uuid-1.6.2-55.el9.x86_64.rpm 102 kB/s | 58 kB 00:00 2024-06-06T02:21:55.942 INFO:teuthology.orchestra.run.smithi103.stdout:(107/159): grpc-data-1.46.7-10.el9.noarch.rpm 405 kB/s | 19 kB 00:00 2024-06-06T02:21:56.000 INFO:teuthology.orchestra.run.smithi103.stdout:(108/159): libarrow-doc-9.0.0-11.el9.noarch.rpm 852 kB/s | 26 kB 00:00 2024-06-06T02:21:56.026 INFO:teuthology.orchestra.run.smithi103.stdout:(109/159): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-06-06T02:21:56.051 INFO:teuthology.orchestra.run.smithi103.stdout:(110/159): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-06-06T02:21:56.076 INFO:teuthology.orchestra.run.smithi103.stdout:(111/159): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-06-06T02:21:56.110 INFO:teuthology.orchestra.run.smithi103.stdout:(112/159): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-06-06T02:21:56.160 INFO:teuthology.orchestra.run.smithi103.stdout:(113/159): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-06-06T02:21:56.186 INFO:teuthology.orchestra.run.smithi103.stdout:(114/159): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-06-06T02:21:56.211 INFO:teuthology.orchestra.run.smithi103.stdout:(115/159): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-06-06T02:21:56.236 INFO:teuthology.orchestra.run.smithi103.stdout:(116/159): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-06-06T02:21:56.262 INFO:teuthology.orchestra.run.smithi103.stdout:(117/159): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-06-06T02:21:56.287 INFO:teuthology.orchestra.run.smithi103.stdout:(118/159): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-06-06T02:21:56.321 INFO:teuthology.orchestra.run.smithi103.stdout:(119/159): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-06-06T02:21:56.354 INFO:teuthology.orchestra.run.smithi103.stdout:(120/159): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-06-06T02:21:56.380 INFO:teuthology.orchestra.run.smithi103.stdout:(121/159): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-06-06T02:21:56.413 INFO:teuthology.orchestra.run.smithi103.stdout:(122/159): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-06-06T02:21:56.489 INFO:teuthology.orchestra.run.smithi103.stdout:(123/159): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-06-06T02:21:56.506 INFO:teuthology.orchestra.run.smithi103.stdout:(124/159): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-06-06T02:21:56.531 INFO:teuthology.orchestra.run.smithi103.stdout:(125/159): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-06-06T02:21:56.556 INFO:teuthology.orchestra.run.smithi103.stdout:(126/159): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-06-06T02:21:56.582 INFO:teuthology.orchestra.run.smithi103.stdout:(127/159): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-06-06T02:21:56.607 INFO:teuthology.orchestra.run.smithi103.stdout:(128/159): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-06-06T02:21:56.641 INFO:teuthology.orchestra.run.smithi103.stdout:(129/159): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-06-06T02:21:56.691 INFO:teuthology.orchestra.run.smithi103.stdout:(130/159): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-06-06T02:21:56.716 INFO:teuthology.orchestra.run.smithi103.stdout:(131/159): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-06-06T02:21:56.741 INFO:teuthology.orchestra.run.smithi103.stdout:(132/159): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-06-06T02:21:56.767 INFO:teuthology.orchestra.run.smithi103.stdout:(133/159): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-06-06T02:21:56.785 INFO:teuthology.orchestra.run.smithi082.stdout:(159/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-06-06T02:21:56.792 INFO:teuthology.orchestra.run.smithi103.stdout:(134/159): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-06-06T02:21:56.796 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-06-06T02:21:56.796 INFO:teuthology.orchestra.run.smithi082.stdout:Total 10 MB/s | 220 MB 00:21 2024-06-06T02:21:56.826 INFO:teuthology.orchestra.run.smithi103.stdout:(135/159): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-06-06T02:21:56.851 INFO:teuthology.orchestra.run.smithi103.stdout:(136/159): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-06-06T02:21:56.877 INFO:teuthology.orchestra.run.smithi103.stdout:(137/159): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-06-06T02:21:56.902 INFO:teuthology.orchestra.run.smithi103.stdout:(138/159): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-06-06T02:21:56.944 INFO:teuthology.orchestra.run.smithi103.stdout:(139/159): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-06-06T02:21:56.969 INFO:teuthology.orchestra.run.smithi103.stdout:(140/159): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-06-06T02:21:56.994 INFO:teuthology.orchestra.run.smithi103.stdout:(141/159): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-06-06T02:21:57.020 INFO:teuthology.orchestra.run.smithi103.stdout:(142/159): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-06-06T02:21:57.045 INFO:teuthology.orchestra.run.smithi103.stdout:(143/159): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-06-06T02:21:57.070 INFO:teuthology.orchestra.run.smithi103.stdout:(144/159): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-06-06T02:21:57.095 INFO:teuthology.orchestra.run.smithi103.stdout:(145/159): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-06-06T02:21:57.121 INFO:teuthology.orchestra.run.smithi103.stdout:(146/159): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-06-06T02:21:57.154 INFO:teuthology.orchestra.run.smithi103.stdout:(147/159): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-06-06T02:21:57.229 INFO:teuthology.orchestra.run.smithi103.stdout:(148/159): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-06-06T02:21:57.380 INFO:teuthology.orchestra.run.smithi103.stdout:(149/159): NetworkManager-1.47.91-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-06-06T02:21:57.457 INFO:teuthology.orchestra.run.smithi103.stdout:(150/159): NetworkManager-libnm-1.47.91-1.el9.x 23 MB/s | 1.8 MB 00:00 2024-06-06T02:21:57.491 INFO:teuthology.orchestra.run.smithi103.stdout:(151/159): NetworkManager-team-1.47.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-06-06T02:21:57.533 INFO:teuthology.orchestra.run.smithi103.stdout:(152/159): NetworkManager-tui-1.47.91-1.el9.x86 5.8 MB/s | 248 kB 00:00 2024-06-06T02:21:57.566 INFO:teuthology.orchestra.run.smithi103.stdout:(153/159): elfutils-debuginfod-client-0.191-4.e 1.1 MB/s | 37 kB 00:00 2024-06-06T02:21:57.609 INFO:teuthology.orchestra.run.smithi103.stdout:(154/159): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-06-06T02:21:57.650 INFO:teuthology.orchestra.run.smithi103.stdout:(155/159): elfutils-libs-0.191-4.el9.x86_64.rpm 6.1 MB/s | 260 kB 00:00 2024-06-06T02:21:57.709 INFO:teuthology.orchestra.run.smithi103.stdout:(156/159): openssl-3.2.1-1.el9.x86_64.rpm 23 MB/s | 1.3 MB 00:00 2024-06-06T02:21:57.793 INFO:teuthology.orchestra.run.smithi103.stdout:(157/159): openssl-libs-3.2.1-1.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-06-06T02:21:57.927 INFO:teuthology.orchestra.run.smithi103.stdout:(158/159): librbd1-19.0.0-4083.g3c55257c.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-06-06T02:21:58.085 INFO:teuthology.orchestra.run.smithi103.stdout:(159/159): librados2-19.0.0-4083.g3c55257c.el9. 3.5 MB/s | 3.3 MB 00:00 2024-06-06T02:21:58.091 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-06-06T02:21:58.091 INFO:teuthology.orchestra.run.smithi103.stdout:Total 8.8 MB/s | 220 MB 00:24 2024-06-06T02:21:59.293 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-06-06T02:21:59.452 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-06-06T02:21:59.452 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-06-06T02:21:59.588 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-06-06T02:21:59.678 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T02:21:59.717 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T02:21:59.770 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T02:21:59.804 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T02:21:59.830 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T02:21:59.872 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T02:22:00.078 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-06-06T02:22:00.217 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T02:22:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-06-06T02:22:00.330 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-06-06T02:22:00.347 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:00.473 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:00.507 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:00.581 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:00.613 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:22:00.646 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T02:22:00.842 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T02:22:00.903 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T02:22:00.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:01.036 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:01.065 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:01.128 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:01.150 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:01.174 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:01.221 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-06-06T02:22:01.222 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-06-06T02:22:01.325 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:01.451 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:01.597 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:01.657 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:01.769 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:01.842 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:02.044 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:02.161 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T02:22:02.197 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T02:22:02.232 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-06-06T02:22:02.307 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-06-06T02:22:02.367 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-06-06T02:22:02.409 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/170 2024-06-06T02:22:02.451 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T02:22:02.483 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T02:22:02.511 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T02:22:02.581 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T02:22:02.642 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T02:22:02.672 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T02:22:02.708 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T02:22:02.785 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T02:22:02.819 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 34/170 2024-06-06T02:22:02.857 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-06-06T02:22:02.858 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-06-06T02:22:02.862 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 35/170 2024-06-06T02:22:02.891 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 36/170 2024-06-06T02:22:02.963 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T02:22:03.005 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T02:22:03.090 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T02:22:03.234 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T02:22:03.292 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T02:22:03.832 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T02:22:03.914 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T02:22:03.950 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T02:22:04.004 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T02:22:04.052 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T02:22:04.090 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 47/170 2024-06-06T02:22:04.140 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T02:22:04.296 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T02:22:04.351 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T02:22:04.444 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T02:22:04.516 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 52/170 2024-06-06T02:22:04.589 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/170 2024-06-06T02:22:04.619 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/170 2024-06-06T02:22:04.656 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/170 2024-06-06T02:22:04.702 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/170 2024-06-06T02:22:04.738 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/170 2024-06-06T02:22:04.782 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/170 2024-06-06T02:22:04.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/170 2024-06-06T02:22:04.967 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/170 2024-06-06T02:22:05.068 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/170 2024-06-06T02:22:05.109 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/170 2024-06-06T02:22:05.205 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/170 2024-06-06T02:22:05.251 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/170 2024-06-06T02:22:05.299 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/170 2024-06-06T02:22:05.324 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/170 2024-06-06T02:22:05.349 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/170 2024-06-06T02:22:05.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/170 2024-06-06T02:22:05.563 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/170 2024-06-06T02:22:05.598 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/170 2024-06-06T02:22:05.627 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/170 2024-06-06T02:22:05.661 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/170 2024-06-06T02:22:05.700 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/170 2024-06-06T02:22:05.732 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/170 2024-06-06T02:22:05.761 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/170 2024-06-06T02:22:05.796 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/170 2024-06-06T02:22:05.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/170 2024-06-06T02:22:05.871 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/170 2024-06-06T02:22:05.905 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/170 2024-06-06T02:22:05.994 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/170 2024-06-06T02:22:06.044 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/170 2024-06-06T02:22:06.084 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/170 2024-06-06T02:22:06.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/170 2024-06-06T02:22:06.244 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T02:22:06.986 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T02:22:07.032 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T02:22:07.065 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T02:22:07.166 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T02:22:07.221 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T02:22:07.266 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T02:22:07.355 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T02:22:07.393 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T02:22:07.511 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-06-06T02:22:07.570 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T02:22:07.599 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T02:22:07.606 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T02:22:07.644 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T02:22:07.677 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T02:22:07.705 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T02:22:07.740 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T02:22:07.766 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T02:22:07.807 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T02:22:08.138 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T02:22:08.267 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:08.341 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T02:22:08.384 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:08.417 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:08.457 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T02:22:08.509 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:08.539 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:22:08.571 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T02:22:08.780 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T02:22:08.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T02:22:08.857 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:08.961 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:08.991 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:09.053 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:09.075 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:09.095 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:09.283 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:09.410 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:09.510 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-06-06T02:22:09.555 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:09.599 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:09.633 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/170 2024-06-06T02:22:09.698 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T02:22:09.699 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:09.718 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/170 2024-06-06T02:22:09.776 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:09.779 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T02:22:09.806 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T02:22:09.827 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/170 2024-06-06T02:22:09.840 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T02:22:09.887 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/170 2024-06-06T02:22:09.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/170 2024-06-06T02:22:09.979 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:10.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/170 2024-06-06T02:22:10.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T02:22:10.122 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T02:22:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-06-06T02:22:10.160 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T02:22:10.211 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:10.213 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-06-06T02:22:10.266 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-06-06T02:22:10.298 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/170 2024-06-06T02:22:10.327 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:10.342 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T02:22:10.358 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 104/170 2024-06-06T02:22:10.375 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T02:22:10.394 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T02:22:10.402 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T02:22:10.467 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/170 2024-06-06T02:22:10.471 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T02:22:10.532 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T02:22:10.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T02:22:10.598 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:10.599 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T02:22:10.675 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T02:22:10.710 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 34/170 2024-06-06T02:22:10.753 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 35/170 2024-06-06T02:22:10.774 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:10.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 36/170 2024-06-06T02:22:10.800 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:10.867 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T02:22:10.882 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T02:22:10.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:10.914 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T02:22:10.922 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:10.957 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:22:10.978 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:10.990 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T02:22:11.008 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 108/170 2024-06-06T02:22:11.026 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/170 2024-06-06T02:22:11.120 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T02:22:11.175 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T02:22:11.321 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/170 2024-06-06T02:22:11.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/170 2024-06-06T02:22:11.430 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:11.597 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:11.631 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:11.695 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T02:22:11.725 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 15/170 2024-06-06T02:22:11.757 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:11.778 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T02:22:11.807 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T02:22:11.826 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/170 2024-06-06T02:22:11.835 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T02:22:11.876 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T02:22:11.914 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 47/170 2024-06-06T02:22:11.956 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T02:22:12.105 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T02:22:12.107 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:12.151 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T02:22:12.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T02:22:12.306 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 52/170 2024-06-06T02:22:12.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/170 2024-06-06T02:22:12.379 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/170 2024-06-06T02:22:12.410 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/170 2024-06-06T02:22:12.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/170 2024-06-06T02:22:12.494 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/170 2024-06-06T02:22:12.538 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/170 2024-06-06T02:22:12.580 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/170 2024-06-06T02:22:12.604 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:12.623 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/170 2024-06-06T02:22:12.693 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 18/170 2024-06-06T02:22:12.767 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/170 2024-06-06T02:22:12.808 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/170 2024-06-06T02:22:12.849 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/170 2024-06-06T02:22:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:12.945 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/170 2024-06-06T02:22:12.950 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:12.983 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/170 2024-06-06T02:22:13.022 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/170 2024-06-06T02:22:13.048 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/170 2024-06-06T02:22:13.073 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/170 2024-06-06T02:22:13.146 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/170 2024-06-06T02:22:13.232 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:13.253 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.91-1.el9.x86_64 19/170 2024-06-06T02:22:13.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:13.265 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/170 2024-06-06T02:22:13.305 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/170 2024-06-06T02:22:13.333 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/170 2024-06-06T02:22:13.368 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/170 2024-06-06T02:22:13.407 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/170 2024-06-06T02:22:13.432 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 20/170 2024-06-06T02:22:13.438 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/170 2024-06-06T02:22:13.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/170 2024-06-06T02:22:13.473 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/170 2024-06-06T02:22:13.502 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/170 2024-06-06T02:22:13.527 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/170 2024-06-06T02:22:13.536 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/170 2024-06-06T02:22:13.569 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/170 2024-06-06T02:22:13.604 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/170 2024-06-06T02:22:13.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/170 2024-06-06T02:22:13.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/170 2024-06-06T02:22:13.734 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/170 2024-06-06T02:22:13.742 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/170 2024-06-06T02:22:13.766 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/170 2024-06-06T02:22:13.788 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/170 2024-06-06T02:22:13.822 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:13.851 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/170 2024-06-06T02:22:13.866 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:13.869 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/170 2024-06-06T02:22:13.898 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/170 2024-06-06T02:22:13.916 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T02:22:13.938 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/170 2024-06-06T02:22:13.945 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:13.945 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T02:22:13.945 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T02:22:13.945 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:13.976 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:14.056 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/170 2024-06-06T02:22:14.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 30/170 2024-06-06T02:22:14.164 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/170 2024-06-06T02:22:14.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 32/170 2024-06-06T02:22:14.329 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 33/170 2024-06-06T02:22:14.369 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 34/170 2024-06-06T02:22:14.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 35/170 2024-06-06T02:22:14.467 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 36/170 2024-06-06T02:22:14.625 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/170 2024-06-06T02:22:14.645 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T02:22:14.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/170 2024-06-06T02:22:14.697 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T02:22:14.730 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T02:22:14.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/170 2024-06-06T02:22:14.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T02:22:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T02:22:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T02:22:14.975 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/170 2024-06-06T02:22:15.002 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T02:22:15.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T02:22:15.040 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/170 2024-06-06T02:22:15.214 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T02:22:15.499 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T02:22:15.634 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T02:22:15.739 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/170 2024-06-06T02:22:15.838 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/170 2024-06-06T02:22:15.882 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/170 2024-06-06T02:22:15.924 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/170 2024-06-06T02:22:15.981 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 46/170 2024-06-06T02:22:16.036 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 47/170 2024-06-06T02:22:16.109 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/170 2024-06-06T02:22:16.282 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T02:22:16.325 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/170 2024-06-06T02:22:16.395 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 50/170 2024-06-06T02:22:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T02:22:16.540 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 51/170 2024-06-06T02:22:16.619 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 52/170 2024-06-06T02:22:16.705 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 53/170 2024-06-06T02:22:16.746 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 54/170 2024-06-06T02:22:16.784 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 55/170 2024-06-06T02:22:16.849 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 56/170 2024-06-06T02:22:16.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 57/170 2024-06-06T02:22:16.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 58/170 2024-06-06T02:22:17.012 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/170 2024-06-06T02:22:17.211 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/170 2024-06-06T02:22:17.261 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/170 2024-06-06T02:22:17.314 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/170 2024-06-06T02:22:17.444 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/170 2024-06-06T02:22:17.485 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 64/170 2024-06-06T02:22:17.530 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/170 2024-06-06T02:22:17.567 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/170 2024-06-06T02:22:17.600 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 67/170 2024-06-06T02:22:17.639 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T02:22:17.726 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T02:22:17.754 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T02:22:17.767 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 68/170 2024-06-06T02:22:17.787 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T02:22:17.944 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 69/170 2024-06-06T02:22:18.007 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 70/170 2024-06-06T02:22:18.045 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 71/170 2024-06-06T02:22:18.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 72/170 2024-06-06T02:22:18.104 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T02:22:18.150 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 73/170 2024-06-06T02:22:18.150 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:18.201 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 74/170 2024-06-06T02:22:18.224 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:18.243 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 75/170 2024-06-06T02:22:18.255 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 104/170 2024-06-06T02:22:18.289 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 76/170 2024-06-06T02:22:18.291 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T02:22:18.369 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 77/170 2024-06-06T02:22:18.450 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 78/170 2024-06-06T02:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 79/170 2024-06-06T02:22:18.641 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 80/170 2024-06-06T02:22:18.708 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 81/170 2024-06-06T02:22:18.753 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 82/170 2024-06-06T02:22:18.782 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T02:22:18.820 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:18.891 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:18.907 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 83/170 2024-06-06T02:22:18.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 108/170 2024-06-06T02:22:18.974 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 84/170 2024-06-06T02:22:19.942 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 85/170 2024-06-06T02:22:19.998 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 86/170 2024-06-06T02:22:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 87/170 2024-06-06T02:22:20.158 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 88/170 2024-06-06T02:22:20.223 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 89/170 2024-06-06T02:22:20.300 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 90/170 2024-06-06T02:22:20.416 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/170 2024-06-06T02:22:20.466 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/170 2024-06-06T02:22:20.701 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/170 2024-06-06T02:22:20.738 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/170 2024-06-06T02:22:20.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/170 2024-06-06T02:22:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:21.227 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:21.681 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/170 2024-06-06T02:22:21.785 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:21.828 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/170 2024-06-06T02:22:21.830 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:21.909 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T02:22:21.910 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T02:22:21.910 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:21.939 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:23.460 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/170 2024-06-06T02:22:23.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/170 2024-06-06T02:22:23.607 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/170 2024-06-06T02:22:23.655 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 101/170 2024-06-06T02:22:24.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/170 2024-06-06T02:22:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:24.203 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 103/170 2024-06-06T02:22:24.229 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 104/170 2024-06-06T02:22:24.293 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/170 2024-06-06T02:22:24.851 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 106/170 2024-06-06T02:22:24.884 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:24.984 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 107/170 2024-06-06T02:22:25.011 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 108/170 2024-06-06T02:22:25.590 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:25.590 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-06-06T02:22:25.591 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:25.762 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:25.778 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:25.778 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T02:22:25.778 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:27.332 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:27.357 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:27.358 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:27.358 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T02:22:27.358 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:27.358 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:27.358 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:27.582 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:27.605 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:27.626 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:27.673 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:28.058 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:28.081 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:28.188 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T02:22:28.246 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T02:22:28.301 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T02:22:28.342 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 109/170 2024-06-06T02:22:28.385 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:28.486 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T02:22:28.542 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T02:22:28.555 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 110/170 2024-06-06T02:22:28.555 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-06-06T02:22:28.555 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-06-06T02:22:28.555 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:28.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:28.620 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T02:22:28.708 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T02:22:28.849 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T02:22:28.883 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T02:22:28.916 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T02:22:28.951 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T02:22:29.421 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:29.451 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:29.483 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 128/170 2024-06-06T02:22:29.545 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 129/170 2024-06-06T02:22:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:30.614 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:30.650 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:31.609 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:31.642 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:31.752 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:31.916 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 133/170 2024-06-06T02:22:31.944 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:31.967 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:32.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:32.022 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:32.123 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 136/170 2024-06-06T02:22:32.168 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 137/170 2024-06-06T02:22:33.142 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T02:22:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:33.196 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:33.196 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:33.196 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T02:22:33.196 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:33.197 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:33.197 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:33.239 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:33.262 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:33.262 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:33.262 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T02:22:33.262 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:33.307 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:33.329 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:33.329 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:33.329 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T02:22:33.330 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:33.330 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:33.330 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:33.640 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:33.663 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:33.663 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:33.663 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T02:22:33.663 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:33.663 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:33.664 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-06-06T02:22:33.665 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-06-06T02:22:33.666 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-06-06T02:22:33.666 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:33.832 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:33.848 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:33.848 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:33.848 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T02:22:33.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:35.444 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:35.470 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:35.695 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:35.717 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:35.717 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:35.717 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T02:22:35.718 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:35.718 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:35.718 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:36.179 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:36.201 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:36.301 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T02:22:36.358 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T02:22:36.414 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T02:22:36.608 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T02:22:36.655 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T02:22:36.733 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T02:22:36.822 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T02:22:36.970 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T02:22:37.014 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T02:22:37.046 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T02:22:37.074 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T02:22:37.535 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:37.564 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:37.596 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 128/170 2024-06-06T02:22:37.658 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 129/170 2024-06-06T02:22:37.687 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:37.894 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 143/170 2024-06-06T02:22:37.935 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 144/170 2024-06-06T02:22:37.976 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 145/170 2024-06-06T02:22:38.000 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T02:22:38.027 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T02:22:38.214 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 148/170 2024-06-06T02:22:38.265 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T02:22:38.297 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 150/170 2024-06-06T02:22:38.337 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T02:22:38.367 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T02:22:38.405 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:22:38.743 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:38.781 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:39.060 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:39.103 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:39.123 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:39.741 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:39.773 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:39.884 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:39.952 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 155/170 2024-06-06T02:22:40.041 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T02:22:40.057 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 133/170 2024-06-06T02:22:40.081 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T02:22:40.092 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:40.116 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:40.160 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:40.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T02:22:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:40.210 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T02:22:40.235 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:22:40.261 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T02:22:40.269 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 136/170 2024-06-06T02:22:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T02:22:40.287 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:22:40.317 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 137/170 2024-06-06T02:22:40.372 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:22:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T02:22:40.396 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:22:40.483 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:22:40.506 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T02:22:40.511 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:40.511 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:40.691 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:40.691 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:22:40.775 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:22:40.800 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T02:22:40.863 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:22:41.264 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T02:22:41.296 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:41.319 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:41.319 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:41.319 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T02:22:41.319 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:41.319 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:41.320 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:41.363 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:41.385 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:41.385 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:41.385 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T02:22:41.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:41.458 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:41.478 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:41.528 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 111/170 2024-06-06T02:22:41.528 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-06-06T02:22:41.528 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-06-06T02:22:41.528 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-06-06T02:22:41.529 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-06-06T02:22:41.529 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-06-06T02:22:41.529 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-06-06T02:22:41.529 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-06-06T02:22:41.529 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:41.798 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:41.799 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:41.820 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:41.820 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:41.820 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T02:22:41.820 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:41.820 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:41.821 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:41.844 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 112/170 2024-06-06T02:22:41.844 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:41.844 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-06-06T02:22:41.844 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:43.568 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:43.656 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 113/170 2024-06-06T02:22:43.656 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:43.656 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-06-06T02:22:43.656 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:43.656 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-06-06T02:22:43.657 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:43.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:43.979 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 114/170 2024-06-06T02:22:43.979 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:43.979 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-06-06T02:22:43.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:43.979 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-06-06T02:22:43.980 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:44.494 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:44.561 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 115/170 2024-06-06T02:22:44.561 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:44.561 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-06-06T02:22:44.562 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:44.562 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-06-06T02:22:44.562 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:44.694 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 116/170 2024-06-06T02:22:44.754 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/170 2024-06-06T02:22:44.830 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/170 2024-06-06T02:22:45.068 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/170 2024-06-06T02:22:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 120/170 2024-06-06T02:22:45.221 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/170 2024-06-06T02:22:45.327 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 122/170 2024-06-06T02:22:45.503 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/170 2024-06-06T02:22:45.547 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/170 2024-06-06T02:22:45.590 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/170 2024-06-06T02:22:45.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 126/170 2024-06-06T02:22:46.052 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 143/170 2024-06-06T02:22:46.093 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 144/170 2024-06-06T02:22:46.134 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 145/170 2024-06-06T02:22:46.167 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T02:22:46.194 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T02:22:46.237 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:46.281 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 127/170 2024-06-06T02:22:46.336 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 128/170 2024-06-06T02:22:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 148/170 2024-06-06T02:22:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T02:22:46.447 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 129/170 2024-06-06T02:22:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 150/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 1/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 3/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 4/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 5/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 6/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 7/170 2024-06-06T02:22:46.476 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 11/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 12/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 13/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 15/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 16/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 17/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 18/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 19/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 20/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 21/170 2024-06-06T02:22:46.477 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 22/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 23/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 24/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 25/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 26/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 27/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 28/170 2024-06-06T02:22:46.478 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 29/170 2024-06-06T02:22:46.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 30/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 31/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 32/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 33/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 34/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 35/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 36/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 37/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 38/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 39/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T02:22:46.491 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T02:22:46.492 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T02:22:46.493 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T02:22:46.494 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T02:22:46.495 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T02:22:46.496 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T02:22:46.497 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T02:22:46.498 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T02:22:46.499 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 149/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 151/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:22:46.500 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T02:22:46.501 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:46.505 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T02:22:46.535 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T02:22:46.581 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:22:47.187 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:47.230 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:47.250 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 130/170 2024-06-06T02:22:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:48.099 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 155/170 2024-06-06T02:22:48.186 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T02:22:48.260 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T02:22:48.343 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T02:22:48.390 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T02:22:48.414 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:22:48.440 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T02:22:48.466 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T02:22:48.466 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:22:48.542 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:22:48.584 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T02:22:48.584 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:22:48.677 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:22:48.702 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T02:22:48.707 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:48.707 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:48.887 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:22:48.887 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:22:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 131/170 2024-06-06T02:22:48.971 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:22:48.996 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T02:22:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:49.062 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:22:49.162 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 132/170 2024-06-06T02:22:49.277 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T02:22:49.277 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.278 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.280 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T02:22:49.281 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T02:22:49.282 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T02:22:49.283 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T02:22:49.284 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T02:22:49.285 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T02:22:49.286 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T02:22:49.287 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T02:22:49.288 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T02:22:49.289 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T02:22:49.290 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T02:22:49.291 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T02:22:49.292 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T02:22:49.292 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T02:22:49.292 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:22:49.292 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-06-06T02:22:49.337 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 133/170 2024-06-06T02:22:49.370 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 134/170 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-06-06T02:22:49.440 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:49.496 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:49.532 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 135/170 2024-06-06T02:22:49.639 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 136/170 2024-06-06T02:22:49.710 DEBUG:teuthology.parallel:result is None 2024-06-06T02:22:49.710 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 137/170 2024-06-06T02:22:50.724 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 138/170 2024-06-06T02:22:50.765 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:50.838 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 139/170 2024-06-06T02:22:50.838 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:50.839 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-06-06T02:22:50.839 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:50.839 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-06-06T02:22:50.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:50.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:50.962 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-4083.g3c552 140/170 2024-06-06T02:22:50.962 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:50.963 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-06-06T02:22:50.963 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:51.042 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 141/170 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-06-06T02:22:51.115 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:51.500 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 142/170 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-06-06T02:22:51.572 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:22:54.824 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 1/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 3/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 4/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 5/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 6/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 7/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 11/170 2024-06-06T02:22:54.825 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 12/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 13/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 15/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 16/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 17/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 18/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 19/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 20/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 21/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 22/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 23/170 2024-06-06T02:22:54.826 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 24/170 2024-06-06T02:22:54.827 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 25/170 2024-06-06T02:22:54.827 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 26/170 2024-06-06T02:22:54.827 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 27/170 2024-06-06T02:22:54.839 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 28/170 2024-06-06T02:22:54.839 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 29/170 2024-06-06T02:22:54.839 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 30/170 2024-06-06T02:22:54.839 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 31/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 32/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 33/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 34/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 35/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 36/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 37/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 38/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 39/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T02:22:54.840 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T02:22:54.841 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T02:22:54.842 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T02:22:54.843 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T02:22:54.844 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T02:22:54.845 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T02:22:54.846 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T02:22:54.847 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T02:22:54.848 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 149/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 151/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T02:22:54.849 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T02:22:54.850 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T02:22:54.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T02:22:54.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T02:22:54.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T02:22:54.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T02:22:54.851 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T02:22:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 143/170 2024-06-06T02:22:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 144/170 2024-06-06T02:22:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 145/170 2024-06-06T02:22:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 146/170 2024-06-06T02:22:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 147/170 2024-06-06T02:22:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 148/170 2024-06-06T02:22:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 149/170 2024-06-06T02:22:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 150/170 2024-06-06T02:22:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 151/170 2024-06-06T02:22:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.91-1.el9.x86_64 152/170 2024-06-06T02:22:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:22:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T02:22:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:57.492 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:57.493 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T02:22:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T02:22:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T02:22:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T02:22:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T02:22:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T02:22:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T02:22:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T02:22:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-06-06T02:22:57.505 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-06-06T02:22:57.952 DEBUG:teuthology.parallel:result is None 2024-06-06T02:22:57.971 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:58.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:58.077 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 154/170 2024-06-06T02:22:59.436 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 155/170 2024-06-06T02:22:59.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 156/170 2024-06-06T02:22:59.606 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 157/170 2024-06-06T02:22:59.738 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 158/170 2024-06-06T02:22:59.772 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 159/170 2024-06-06T02:22:59.805 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:22:59.840 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 161/170 2024-06-06T02:22:59.880 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 162/170 2024-06-06T02:22:59.881 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:23:00.036 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 163/170 2024-06-06T02:23:00.086 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 164/170 2024-06-06T02:23:00.086 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:23:00.214 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 165/170 2024-06-06T02:23:00.251 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 166/170 2024-06-06T02:23:00.276 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:23:00.277 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:23:00.616 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 167/170 2024-06-06T02:23:00.616 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:23:00.768 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 168/170 2024-06-06T02:23:00.815 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 169/170 2024-06-06T02:23:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:23:01.206 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 170/170 2024-06-06T02:23:01.206 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-06-06T02:23:01.206 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:23:06.906 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 1/170 2024-06-06T02:23:06.906 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 3/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 4/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-4083.g3c552 5/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 6/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 7/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 8/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 9/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 10/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 11/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 12/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 13/170 2024-06-06T02:23:06.907 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 14/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_ 15/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 16/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 17/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_6 18/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86 19/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 20/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el 21/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-4083.g3c55257c.el9. 22/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_6 23/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 24/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 25/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 26/170 2024-06-06T02:23:06.908 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 27/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 28/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 29/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c. 30/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noa 31/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.n 32/170 2024-06-06T02:23:06.909 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c5 33/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el 34/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 35/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.e 36/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 37/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 38/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 39/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/170 2024-06-06T02:23:06.921 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/170 2024-06-06T02:23:06.922 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/170 2024-06-06T02:23:06.923 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/170 2024-06-06T02:23:06.924 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/170 2024-06-06T02:23:06.925 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 99/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 101/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/170 2024-06-06T02:23:06.926 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 118/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/170 2024-06-06T02:23:06.927 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/170 2024-06-06T02:23:06.928 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/170 2024-06-06T02:23:06.929 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 149/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 151/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.91-1.el9.x86_64 153/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.91-1.el9.x86_64 155/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.91-1.el9.x86_64 157/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.91-1.el9.x86_64 159/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/170 2024-06-06T02:23:06.930 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 167/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/170 2024-06-06T02:23:06.931 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 169/170 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/170 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.91-1.el9.x86_64 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.91-1.el9.x86_64 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.91-1.el9.x86_64 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.91-1.el9.x86_64 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-06-06T02:23:09.147 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.148 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.149 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-4083.g3c55257c.el9.noarch 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-06-06T02:23:09.150 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.151 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-06-06T02:23:09.152 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-5.el9.noarch 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-06-06T02:23:09.153 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-06-06T02:23:09.154 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-06-06T02:23:09.155 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-06-06T02:23:09.156 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-06-06T02:23:09.157 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-06-06T02:23:09.158 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-4083.g3c55257c.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-06-06T02:23:09.159 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-06-06T02:23:09.160 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-06-06T02:23:09.160 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:23:09.160 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-06-06T02:23:09.861 DEBUG:teuthology.parallel:result is None 2024-06-06T02:23:09.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:10.011 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T02:23:10.068 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.069 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.069 INFO:teuthology.task.install:The correct ceph version 19.0.0-4083.g3c55257c is installed. 2024-06-06T02:23:10.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:10.217 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T02:23:10.243 INFO:teuthology.orchestra.run.smithi103.stdout:19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.243 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.243 INFO:teuthology.task.install:The correct ceph version 19.0.0-4083.g3c55257c is installed. 2024-06-06T02:23:10.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:10.404 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-06T02:23:10.430 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.430 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-4083.g3c55257c.el9 2024-06-06T02:23:10.431 INFO:teuthology.task.install:The correct ceph version 19.0.0-4083.g3c55257c is installed. 2024-06-06T02:23:10.432 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-06T02:23:10.433 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:23:10.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T02:23:10.498 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:23:10.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T02:23:10.529 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:23:10.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-06T02:23:10.561 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-06T02:23:10.562 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:23:10.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T02:23:10.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T02:23:10.724 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:23:10.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T02:23:10.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T02:23:10.820 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:23:10.820 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-06-06T02:23:10.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-06T02:23:10.919 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-06T02:23:10.919 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:23:10.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T02:23:10.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T02:23:11.085 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:23:11.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T02:23:11.109 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T02:23:11.175 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:23:11.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-06T02:23:11.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-06T02:23:11.264 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-06T02:23:11.264 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:23:11.264 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T02:23:11.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T02:23:11.435 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:23:11.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T02:23:11.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T02:23:11.522 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:23:11.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-06-06T02:23:11.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-06T02:23:11.611 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-06T02:23:11.857 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-06T02:23:11.857 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:11.858 INFO:tasks.cephadm:Cluster fsid is b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:23:11.858 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-06T02:23:11.858 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.103', 'mon.c': '172.21.15.184'} 2024-06-06T02:23:11.858 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-06-06T02:23:11.858 INFO:tasks.cephadm:First mgr is x 2024-06-06T02:23:11.858 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-06T02:23:11.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-06-06T02:23:11.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-06-06T02:23:11.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-06-06T02:23:11.971 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-06T02:23:11.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:12.208 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79944/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-4083-g3c55257c', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-4083.g3c55257c'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-06-05 02:46:08.481951', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240605.005022-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-06-06T02:23:12.431 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-pdonnell-testing-20240605.005022-debug, sha1 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:23:12.432 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/x86_64/flavors/default/cephadm 2024-06-06T02:23:12.433 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/x86_64/flavors/default/cephadm 2024-06-06T02:23:12.433 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:12.939 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 Jun 6 02:23 /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:12.940 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:13.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 Jun 6 02:23 /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:13.546 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240605.005022-debug/3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:14.145 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r--. 1 ubuntu ubuntu 782843 Jun 6 02:23 /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:14.146 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:14.205 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:14.225 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-06T02:23:14.268 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 on all hosts... 2024-06-06T02:23:14.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 pull 2024-06-06T02:23:14.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 pull 2024-06-06T02:23:14.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 pull 2024-06-06T02:23:15.114 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8... 2024-06-06T02:23:15.269 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8... 2024-06-06T02:23:15.416 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8... 2024-06-06T02:23:42.624 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-06-06T02:23:42.624 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev)", 2024-06-06T02:23:42.625 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be", 2024-06-06T02:23:42.625 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-06-06T02:23:42.625 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067" 2024-06-06T02:23:42.625 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-06-06T02:23:42.625 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev)", 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be", 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067" 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-06-06T02:23:47.184 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-06T02:23:59.870 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:23:59.870 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev)", 2024-06-06T02:23:59.870 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be", 2024-06-06T02:23:59.870 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-06-06T02:23:59.870 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067" 2024-06-06T02:23:59.871 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:23:59.871 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:23:59.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-06-06T02:24:00.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-06-06T02:24:00.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-06-06T02:24:00.077 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-06-06T02:24:00.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-06-06T02:24:00.191 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-06-06T02:24:00.219 INFO:tasks.cephadm:Writing seed config... 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-06T02:24:00.221 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-06T02:24:00.222 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-06T02:24:00.223 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-06-06T02:24:00.223 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-06T02:24:00.223 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-06T02:24:00.223 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-06-06T02:24:00.223 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:24:00.223 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-06T02:24:00.279 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = b8ccb8a2-23ab-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-06-06T02:24:00.279 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service 2024-06-06T02:24:00.328 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-06T02:24:00.374 INFO:tasks.cephadm:Bootstrapping... 2024-06-06T02:24:00.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 -v bootstrap --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:24:00.643 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-06-06T02:24:00.643 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', '-v', 'bootstrap', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-06-06T02:24:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-06T02:24:00.643 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-06-06T02:24:00.698 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 5.0.2 2024-06-06T02:24:00.698 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-06-06T02:24:00.698 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-06-06T02:24:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T02:24:00.713 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T02:24:00.727 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T02:24:00.727 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:24:00.741 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-06-06T02:24:00.755 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-06-06T02:24:00.755 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-06-06T02:24:00.755 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-06-06T02:24:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 5.0.2 2024-06-06T02:24:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 5.0.2 is present 2024-06-06T02:24:00.804 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-06-06T02:24:00.805 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-06-06T02:24:00.819 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-06T02:24:00.819 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-06T02:24:00.836 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-06T02:24:00.836 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:24:00.857 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-06-06T02:24:00.873 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 140484916216592 on /run/cephadm/b8ccb8a2-23ab-11ef-bc9b-c7b262605968.lock 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 140484916216592 acquired on /run/cephadm/b8ccb8a2-23ab-11ef-bc9b-c7b262605968.lock 2024-06-06T02:24:00.874 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-06-06T02:24:00.875 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-06-06T02:24:00.875 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-06-06T02:24:00.882 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-06-06T02:24:00.882 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-06-06T02:24:00.889 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-06T02:24:00.889 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-06-06T02:24:00.889 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1786sec hoplimit 64 pref medium 2024-06-06T02:24:00.895 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-06T02:24:00.895 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-06T02:24:00.895 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T02:24:00.895 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-06-06T02:24:00.895 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-06T02:24:00.896 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-06T02:24:00.896 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-06-06T02:24:00.896 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-06-06T02:24:00.896 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-06T02:24:00.897 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-06T02:24:00.898 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8... 2024-06-06T02:24:01.550 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be 2024-06-06T02:24:01.551 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8... 2024-06-06T02:24:01.551 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-06-06T02:24:01.551 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:45d28712cb9f2793e3b2a7effa8cacdf0af7e108a33ce7961590f1e7009c7650 2024-06-06T02:24:01.551 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:36850128dbaa55a7fd38bf12640a70ab57c121fdc76af02f72b423e059979691 2024-06-06T02:24:01.551 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be 2024-06-06T02:24:01.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-06T02:24:02.801 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev) 2024-06-06T02:24:02.802 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev) 2024-06-06T02:24:02.802 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-06-06T02:24:03.974 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-06-06T02:24:03.974 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-06-06T02:24:05.080 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDEHWFmZyisGxAABuElwQUw+ODVQCHHwtvhRQ== 2024-06-06T02:24:06.204 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDFHWFmg5hWIxAA+Em8LbJ7RiWqt5dTmvCBaQ== 2024-06-06T02:24:07.399 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQDGHWFmzNkmKhAAHPShUfdUytvBG3/J/vbiig== 2024-06-06T02:24:07.402 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-06-06T02:24:08.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T02:24:08.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-06-06T02:24:08.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:08.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:24:08.519 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-06-06T02:24:09.686 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-06-06T02:24:10.072 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-06-06T02:24:10.307 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-06T02:24:10.606 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target. 2024-06-06T02:24:10.606 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target. 2024-06-06T02:24:10.982 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a 2024-06-06T02:24:10.982 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-06T02:24:11.261 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target.wants/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@.service. 2024-06-06T02:24:11.894 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:11 smithi082 podman[31198]: 2024-06-06 02:24:11.883009357 +0000 UTC m=+0.367344072 container init 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:24:11.894 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:11 smithi082 podman[31198]: 2024-06-06 02:24:11.893832242 +0000 UTC m=+0.378166977 container start 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:24:12.016 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T02:24:12.016 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-06-06T02:24:12.031 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T02:24:12.031 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:24:12.032 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-06-06T02:24:12.032 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T02:24:12.032 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-06-06T02:24:12.032 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-06-06T02:24:12.179 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:11 smithi082 bash[31198]: 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 2024-06-06T02:24:12.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:11 smithi082 systemd[1]: Started Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:24:12.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:12 smithi082 ceph-mon[31217]: mkfs b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:12.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:12 smithi082 ceph-mon[31217]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: monmap epoch 1 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: last_changed 2024-06-06T02:24:07.948041+0000 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: min_mon_release 19 (squid) 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: election_strategy: 1 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: fsmap 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: osdmap e1: 0 total, 0 up, 0 in 2024-06-06T02:24:13.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: mgrmap e1: no daemons active 2024-06-06T02:24:13.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:13 smithi082 ceph-mon[31217]: from='client.? 172.21.15.82:0/1571786267' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-06T02:24:13.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-06-06T02:24:13.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:13.403 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.682806s) 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-06T02:24:13.404 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-06T02:24:13.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-06-06T02:24:13.405 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:13.405 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-06-06T02:24:13.405 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-06-06T02:24:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:14 smithi082 ceph-mon[31217]: from='client.? 172.21.15.82:0/4140492976' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T02:24:14.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:14 smithi082 ceph-mon[31217]: from='client.? 172.21.15.82:0/4140492976' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-06T02:24:14.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:14.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T02:24:14.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-06-06T02:24:14.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T02:24:14.783 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T02:24:14.783 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T02:24:14.783 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T02:24:14.783 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T02:24:14.783 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-06-06T02:24:15.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:15 smithi082 ceph-mon[31217]: from='client.? 172.21.15.82:0/242731738' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:24:16.127 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-06-06T02:24:16.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:16 smithi082 systemd[1]: Stopping Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:24:17.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a[31213]: 2024-06-06T02:24:16.649+0000 7f2ba4400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:24:17.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a[31213]: 2024-06-06T02:24:16.649+0000 7f2ba4400640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-06T02:24:17.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:16 smithi082 podman[31455]: 2024-06-06 02:24:16.711450013 +0000 UTC m=+0.199550532 container died 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:24:17.362 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 podman[31455]: 2024-06-06 02:24:17.111569126 +0000 UTC m=+0.599669643 container cleanup 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-06T02:24:17.362 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 bash[31455]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a 2024-06-06T02:24:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 podman[31467]: 2024-06-06 02:24:17.362187412 +0000 UTC m=+0.636531427 container remove 431971e34e1d265c41a1a4e8fda4b36da915b1a19202d54233ecd6d3bd550341 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-06-06T02:24:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 systemd[1]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-06-06T02:24:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 systemd[1]: Stopped Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:24:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 systemd[1]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service: Consumed 1.889s CPU time. 2024-06-06T02:24:17.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 systemd[1]: Starting Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:24:18.323 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:17 smithi082 podman[31560]: 2024-06-06 02:24:17.900263571 +0000 UTC m=+0.036570946 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:24:18.323 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 podman[31560]: 2024-06-06 02:24:18.004663231 +0000 UTC m=+0.140970636 container create 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-06-06T02:24:18.323 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 podman[31560]: 2024-06-06 02:24:18.233438081 +0000 UTC m=+0.369745469 container init 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:24:18.323 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 podman[31560]: 2024-06-06 02:24:18.243283538 +0000 UTC m=+0.379590920 container start 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528) 2024-06-06T02:24:18.334 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-06T02:24:18.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 bash[31560]: 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 systemd[1]: Started Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev), process ceph-mon, pid 2 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: pidfile_write: ignore empty --pid-file 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: load: jerasure load: lrc 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: RocksDB version: 7.9.2 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Git sha 0 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Compile date 2024-06-05 01:48:04 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: DB SUMMARY 2024-06-06T02:24:18.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: DB Session ID: PVL3FXNUFE7VKP7N14B7 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: CURRENT file: CURRENT 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95561 ; 2024-06-06T02:24:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.error_if_exists: 0 2024-06-06T02:24:18.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.create_if_missing: 0 2024-06-06T02:24:18.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.paranoid_checks: 1 2024-06-06T02:24:18.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T02:24:18.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T02:24:18.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.env: 0x5561387955e0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.info_log: 0x556164cb6fc0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.statistics: (nil) 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.use_fsync: 0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_log_file_size: 0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_fallocate: 1 2024-06-06T02:24:18.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T02:24:18.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T02:24:18.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.use_direct_reads: 0 2024-06-06T02:24:18.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T02:24:18.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T02:24:18.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.db_log_dir: 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.wal_dir: 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T02:24:18.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T02:24:18.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T02:24:18.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T02:24:18.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T02:24:18.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.write_buffer_manager: 0x556164cba1e0 2024-06-06T02:24:18.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.unordered_write: 0 2024-06-06T02:24:18.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.row_cache: None 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.wal_filter: None 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.two_write_queues: 0 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.wal_compression: 0 2024-06-06T02:24:18.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.atomic_flush: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.log_readahead_size: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_background_jobs: 2 2024-06-06T02:24:18.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_background_compactions: -1 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_subcompactions: 1 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_open_files: -1 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T02:24:18.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_background_flushes: -1 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Compression algorithms supported: 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kZSTD supported: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kXpressCompression supported: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kBZip2Compression supported: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kLZ4Compression supported: 1 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kZlibCompression supported: 1 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T02:24:18.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: kSnappyCompression supported: 1 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.merge_operator: 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_filter: None 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556164cb6c40) 2024-06-06T02:24:18.634 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-06-06T02:24:18.635 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x556160c7d610 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-06-06T02:24:18.636 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-06-06T02:24:18.637 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression: NoCompression 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T02:24:18.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.num_levels: 7 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T02:24:18.639 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T02:24:18.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T02:24:18.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T02:24:18.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T02:24:18.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T02:24:18.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T02:24:18.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.inplace_update_support: 0 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T02:24:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.bloom_locality: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.max_successive_merges: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.ttl: 2592000 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T02:24:18.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enable_blob_files: false 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.min_blob_size: 0 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-06T02:24:18.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c62ad81f-f5b8-4db3-97da-f16c9eca0eed 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640658370418, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640658371942, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91678, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89725, "index_size": 273, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11760, "raw_average_key_size": 48, "raw_value_size": 83103, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717640658, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c62ad81f-f5b8-4db3-97da-f16c9eca0eed", "db_session_id": "PVL3FXNUFE7VKP7N14B7", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640658372207, "job": 1, "event": "recovery_finished"} 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556164cdca80 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: DB pointer 0x556165a7e000 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T02:24:18.647 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 91.39 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 91.39 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 93.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.648 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 93.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T02:24:18.649 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 12.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 12.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x556160c7d610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???) e1 preinit fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).mds e1 new map 2024-06-06T02:24:18.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).mds e1 print_map 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: monmap epoch 1 2024-06-06T02:24:18.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: last_changed 2024-06-06T02:24:07.948041+0000 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: min_mon_release 19 (squid) 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: election_strategy: 1 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: fsmap 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: osdmap e1: 0 total, 0 up, 0 in 2024-06-06T02:24:18.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:18 smithi082 ceph-mon[31579]: mgrmap e1: no daemons active 2024-06-06T02:24:20.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:20 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1799719603' entity='client.admin' 2024-06-06T02:24:25.321 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-06T02:24:25.349 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:24:25.349 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-06-06T02:24:25.351 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-06T02:24:25.352 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-06T02:24:25.795 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T02:24:25.795 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-06T02:24:26.058 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968.target.wants/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@.service. 2024-06-06T02:24:26.747 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:26 smithi082 podman[31793]: 2024-06-06 02:24:26.486258013 +0000 UTC m=+0.160157403 container create a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux ) 2024-06-06T02:24:26.748 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:26 smithi082 podman[31793]: 2024-06-06 02:24:26.74766012 +0000 UTC m=+0.421559537 container init a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3) 2024-06-06T02:24:26.900 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T02:24:26.900 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-06-06T02:24:26.914 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T02:24:26.914 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:24:26.914 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-06-06T02:24:26.914 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-06-06T02:24:26.932 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T02:24:26.932 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-06-06T02:24:26.947 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T02:24:26.947 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:24:26.947 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-06-06T02:24:26.948 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-06T02:24:26.948 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-06-06T02:24:26.948 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-06-06T02:24:27.055 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:26 smithi082 podman[31793]: 2024-06-06 02:24:26.757655036 +0000 UTC m=+0.431554452 container start a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-06T02:24:27.055 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:26 smithi082 bash[31793]: a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e 2024-06-06T02:24:27.055 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:26 smithi082 systemd[1]: Started Ceph mgr.x for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:24:27.328 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:27.055+0000 7f3a03c63040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T02:24:27.328 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:27.240+0000 7f3a03c63040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:24:27.329 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:27.328+0000 7f3a03c63040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T02:24:28.055 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2317443826' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T02:24:28.055 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:27.647+0000 7f3a03c63040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T02:24:28.055 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:27 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:27.723+0000 7f3a03c63040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T02:24:28.380 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:28.381 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T02:24:28.383 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T02:24:28.384 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T02:24:12.041834+0000", 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T02:24:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:24:28.386 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-06-06T02:24:29.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:28 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:28.995+0000 7f3a03c63040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T02:24:29.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.133+0000 7f3a03c63040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T02:24:29.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.201+0000 7f3a03c63040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T02:24:29.777 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.453+0000 7f3a03c63040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T02:24:29.777 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.526+0000 7f3a03c63040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T02:24:29.778 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.606+0000 7f3a03c63040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T02:24:29.778 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:29.777+0000 7f3a03c63040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:24:30.561 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:30 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:30.305+0000 7f3a03c63040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T02:24:30.561 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:30 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:30.518+0000 7f3a03c63040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-06T02:24:31.155 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:30 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:30.904+0000 7f3a03c63040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T02:24:31.156 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:30 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:30.986+0000 7f3a03c63040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T02:24:31.530 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:31 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1751188496' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T02:24:31.531 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:31 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:31.171+0000 7f3a03c63040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T02:24:31.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:31 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:31.571+0000 7f3a03c63040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T02:24:31.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:31 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:31.646+0000 7f3a03c63040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T02:24:31.902 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-06-06T02:24:31.903 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:31.904 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T02:24:31.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T02:24:31.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T02:24:31.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T02:24:31.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T02:24:31.905 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T02:24:31.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T02:24:31.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T02:24:31.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T02:24:12.041834+0000", 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:24:31.911 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-06-06T02:24:32.144 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:31 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:31.872+0000 7f3a03c63040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T02:24:32.145 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:32.067+0000 7f3a03c63040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T02:24:32.145 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:32.144+0000 7f3a03c63040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T02:24:32.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:32.242+0000 7f3a03c63040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T02:24:32.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:32.314+0000 7f3a03c63040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T02:24:33.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:32.941+0000 7f3a03c63040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:33.125+0000 7f3a03c63040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: Activating manager daemon x 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: mgrmap e2: x(active, starting, since 0.0137445s) 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: Manager daemon x is now available 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T02:24:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T02:24:33.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' 2024-06-06T02:24:33.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' 2024-06-06T02:24:33.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:33 smithi082 ceph-mon[31579]: from='mgr.14100 172.21.15.82:0/967611499' entity='mgr.x' 2024-06-06T02:24:35.479 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:35 smithi082 ceph-mon[31579]: mgrmap e3: x(active, since 1.02461s) 2024-06-06T02:24:35.480 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:35 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4153518946' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-06T02:24:35.490 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:35.493 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-06T02:24:35.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-06T02:24:35.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-06T02:24:35.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-06T02:24:35.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-06T02:24:35.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-06T02:24:35.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-06T02:24:35.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-06T02:24:35.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-06T02:24:35.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-06-06T02:24:12.041834+0000", 2024-06-06T02:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-06T02:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-06-06T02:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-06T02:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-06-06T02:24:36.433 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:36 smithi082 ceph-mon[31579]: mgrmap e4: x(active, since 2s) 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-06T02:24:37.055 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-06T02:24:37.056 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-06T02:24:37.057 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-06-06T02:24:37.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:37 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2092342451' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-06T02:24:38.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1382164830' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-06T02:24:38.477 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ignoring --setuser ceph since I am not root 2024-06-06T02:24:38.477 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ignoring --setgroup ceph since I am not root 2024-06-06T02:24:38.477 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:38.476+0000 7f97804bc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T02:24:38.738 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:38.655+0000 7f97804bc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:24:38.739 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:38.738+0000 7f97804bc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T02:24:39.283 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:39 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1382164830' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-06T02:24:39.283 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:39 smithi082 ceph-mon[31579]: mgrmap e5: x(active, since 5s) 2024-06-06T02:24:39.283 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:39 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:39.047+0000 7f97804bc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T02:24:39.283 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:39 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:39.127+0000 7f97804bc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T02:24:40.489 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/148221844' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T02:24:40.489 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:40.371+0000 7f97804bc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T02:24:40.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-06-06T02:24:40.500 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-06-06T02:24:40.810 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:40.517+0000 7f97804bc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T02:24:40.810 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:40.591+0000 7f97804bc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T02:24:41.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:40.857+0000 7f97804bc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T02:24:41.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:40.932+0000 7f97804bc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T02:24:41.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:41.016+0000 7f97804bc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T02:24:41.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:41.197+0000 7f97804bc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:24:42.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:41.723+0000 7f97804bc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T02:24:42.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:41.917+0000 7f97804bc040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-06T02:24:42.537 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:42 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:42.285+0000 7f97804bc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T02:24:42.538 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:42 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:42.364+0000 7f97804bc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T02:24:42.538 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:42 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:42.537+0000 7f97804bc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T02:24:43.196 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:42 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:42.902+0000 7f97804bc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T02:24:43.196 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:42 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:42.975+0000 7f97804bc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T02:24:43.196 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:43.195+0000 7f97804bc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T02:24:43.455 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:43.378+0000 7f97804bc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T02:24:43.455 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:43.454+0000 7f97804bc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T02:24:43.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:43.552+0000 7f97804bc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T02:24:43.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:43.622+0000 7f97804bc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T02:24:44.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:44.242+0000 7f97804bc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T02:24:44.620 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:44.425+0000 7f97804bc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T02:24:44.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: Active manager daemon x restarted 2024-06-06T02:24:44.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: Activating manager daemon x 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: osdmap e2: 0 total, 0 up, 0 in 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: mgrmap e6: x(active, starting, since 0.0101054s) 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: Manager daemon x is now available 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:44 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:45.823 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: Found migration_current of "None". Setting to last migration. 2024-06-06T02:24:45.823 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:45.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:45 smithi082 ceph-mon[31579]: mgrmap e7: x(active, since 1.0126s) 2024-06-06T02:24:46.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:24:46.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-06T02:24:46.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T02:24:46.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:24:46.138 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-06-06T02:24:46.138 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-06-06T02:24:46.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:46.142+0000 7f96d9000640 -1 log_channel(cephadm) log [ERR] : [06/Jun/2024:02:24:46] ENGINE Error in HTTPServer.serve 2024-06-06T02:24:46.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: Traceback (most recent call last): 2024-06-06T02:24:46.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._connections.run(self.expiration_interval) 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._run(expiration_interval) 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: new_conn = self._from_server_socket(self.server.socket) 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: s = self.context.wrap_socket( 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: return self.sslsocket_class._create( 2024-06-06T02:24:46.372 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-06T02:24:46.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self.do_handshake() 2024-06-06T02:24:46.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-06T02:24:46.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._sslobj.do_handshake() 2024-06-06T02:24:46.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-06T02:24:46.373 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:24:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-06T02:24:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-06T02:24:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: [06/Jun/2024:02:24:45] ENGINE Bus STARTING 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: [06/Jun/2024:02:24:46] ENGINE Serving on http://172.21.15.82:8765 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: [06/Jun/2024:02:24:46] ENGINE Serving on https://172.21.15.82:7150 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: [06/Jun/2024:02:24:46] ENGINE Bus STARTED 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:46 smithi082 ceph-mon[31579]: [06/Jun/2024:02:24:46] ENGINE Error in HTTPServer.serve 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: Traceback (most recent call last): 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._run(expiration_interval) 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-06T02:24:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: s = self.context.wrap_socket( 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: return self.sslsocket_class._create( 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: self.do_handshake() 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._sslobj.do_handshake() 2024-06-06T02:24:46.690 INFO:journalctl@ceph.mon.a.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-06T02:24:47.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:47 smithi082 ceph-mon[31579]: mgrmap e8: x(active, since 2s) 2024-06-06T02:24:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:47 smithi082 ceph-mon[31579]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:24:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:47 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:47.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:47 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:24:49.335 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-06T02:24:49.336 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-06-06T02:24:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:49 smithi082 ceph-mon[31579]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:24:50.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: Generating public/private rsa key pair. 2024-06-06T02:24:50.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: Your identification has been saved in /tmp/tmpb7kfss4u/key 2024-06-06T02:24:50.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: Your public key has been saved in /tmp/tmpb7kfss4u/key.pub 2024-06-06T02:24:50.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: The key fingerprint is: 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: SHA256:jKrYfB6PXMTsuIqe2MGHcbOpjQUQD3GVWVoY2Jd4DiA ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: The key's randomart image is: 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: +---[RSA 3072]----+ 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: |E.o=oBo. | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: | *. Bo+ | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: |. . .= | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: | . o.o | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: | o o = S | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: | . = O | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: | + O o | 2024-06-06T02:24:50.622 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: |.*.X.* | 2024-06-06T02:24:50.623 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: |=oO+* . | 2024-06-06T02:24:50.623 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:24:50 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: +----[SHA256]-----+ 2024-06-06T02:24:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:51 smithi082 ceph-mon[31579]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:24:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:51 smithi082 ceph-mon[31579]: Generating ssh key... 2024-06-06T02:24:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:51 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:51 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:52.543 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:52 smithi082 ceph-mon[31579]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:24:52.556 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:24:52.557 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-06T02:24:52.557 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-06-06T02:24:52.558 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-06-06T02:24:54.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:54 smithi082 ceph-mon[31579]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:24:55.744 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:55 smithi082 ceph-mon[31579]: Deploying cephadm binary to smithi082 2024-06-06T02:24:58.983 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-06-06T02:24:58.983 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-06-06T02:24:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:59 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:24:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:59 smithi082 ceph-mon[31579]: Added host smithi082 2024-06-06T02:24:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:24:59 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:00.733 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-06T02:25:00.734 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-06-06T02:25:00.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:00 smithi082 ceph-mon[31579]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:00.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:00 smithi082 ceph-mon[31579]: Saving service mon spec with placement count:5 2024-06-06T02:25:00.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:00 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:03.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-06T02:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:02 smithi082 ceph-mon[31579]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:02 smithi082 ceph-mon[31579]: Saving service mgr spec with placement count:2 2024-06-06T02:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:02 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:02 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:04.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:04 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:04.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:04 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3074114594' entity='client.admin' 2024-06-06T02:25:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:06 smithi082 ceph-mon[31579]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:06 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:06 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1909637631' entity='client.admin' 2024-06-06T02:25:06.767 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-06-06T02:25:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:07 smithi082 ceph-mon[31579]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:07 smithi082 ceph-mon[31579]: from='mgr.14118 172.21.15.82:0/1851789209' entity='mgr.x' 2024-06-06T02:25:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:07 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2244786298' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-06T02:25:08.738 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ignoring --setuser ceph since I am not root 2024-06-06T02:25:08.739 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ignoring --setgroup ceph since I am not root 2024-06-06T02:25:08.739 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:08.544+0000 7ff1cdecb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T02:25:08.739 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:08.737+0000 7ff1cdecb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:25:09.003 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:08.821+0000 7ff1cdecb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T02:25:09.322 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:09 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2244786298' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-06T02:25:09.322 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:09 smithi082 ceph-mon[31579]: mgrmap e9: x(active, since 23s) 2024-06-06T02:25:09.322 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:09.129+0000 7ff1cdecb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T02:25:09.323 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:09.208+0000 7ff1cdecb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T02:25:10.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:10 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2755241301' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-06T02:25:10.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:25:10.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-06T02:25:10.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-06T02:25:10.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-06T02:25:10.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-06T02:25:10.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:25:10.487 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-06-06T02:25:10.488 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-06-06T02:25:10.821 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:10 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:10.477+0000 7ff1cdecb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T02:25:10.822 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:10 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:10.627+0000 7ff1cdecb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T02:25:10.822 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:10 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:10.699+0000 7ff1cdecb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T02:25:11.115 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:10 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:10.960+0000 7ff1cdecb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T02:25:11.116 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:11.067+0000 7ff1cdecb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T02:25:11.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:11.161+0000 7ff1cdecb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T02:25:11.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:11.336+0000 7ff1cdecb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:25:12.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:11.866+0000 7ff1cdecb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T02:25:12.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:12 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:12.062+0000 7ff1cdecb040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-06T02:25:12.683 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:12 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:12.430+0000 7ff1cdecb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T02:25:12.683 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:12 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:12.509+0000 7ff1cdecb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T02:25:12.683 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:12 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:12.683+0000 7ff1cdecb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T02:25:13.342 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.049+0000 7ff1cdecb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T02:25:13.343 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.122+0000 7ff1cdecb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T02:25:13.343 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.343+0000 7ff1cdecb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T02:25:13.604 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.528+0000 7ff1cdecb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T02:25:13.604 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.605+0000 7ff1cdecb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T02:25:13.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.702+0000 7ff1cdecb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T02:25:13.870 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:13.774+0000 7ff1cdecb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T02:25:14.768 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:14.394+0000 7ff1cdecb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T02:25:14.768 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:14.580+0000 7ff1cdecb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: Active manager daemon x restarted 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: Activating manager daemon x 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: osdmap e3: 0 total, 0 up, 0 in 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: mgrmap e10: x(active, starting, since 0.00639624s) 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-06T02:25:14.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-06T02:25:14.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: Manager daemon x is now available 2024-06-06T02:25:14.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-06T02:25:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-06T02:25:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:15 smithi082 ceph-mon[31579]: mgrmap e11: x(active, since 1.0103s) 2024-06-06T02:25:16.523 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:16.144+0000 7ff124c00640 -1 log_channel(cephadm) log [ERR] : [06/Jun/2024:02:25:16] ENGINE Error in HTTPServer.serve 2024-06-06T02:25:16.523 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: Traceback (most recent call last): 2024-06-06T02:25:16.523 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-06T02:25:16.523 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._connections.run(self.expiration_interval) 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._run(expiration_interval) 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: new_conn = self._from_server_socket(self.server.socket) 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: s = self.context.wrap_socket( 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: return self.sslsocket_class._create( 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-06T02:25:16.524 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self.do_handshake() 2024-06-06T02:25:16.525 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-06T02:25:16.525 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: self._sslobj.do_handshake() 2024-06-06T02:25:16.525 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-06T02:25:16.525 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: [06/Jun/2024:02:25:15] ENGINE Bus STARTING 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: [06/Jun/2024:02:25:16] ENGINE Serving on http://172.21.15.82:8765 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: [06/Jun/2024:02:25:16] ENGINE Serving on https://172.21.15.82:7150 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: [06/Jun/2024:02:25:16] ENGINE Bus STARTED 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: [06/Jun/2024:02:25:16] ENGINE Error in HTTPServer.serve 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout: Traceback (most recent call last): 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._connections.run(self.expiration_interval) 2024-06-06T02:25:16.864 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._run(expiration_interval) 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: s = self.context.wrap_socket( 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: return self.sslsocket_class._create( 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: self.do_handshake() 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: self._sslobj.do_handshake() 2024-06-06T02:25:16.865 INFO:journalctl@ceph.mon.a.smithi082.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1129) 2024-06-06T02:25:16.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:16.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-06-06T02:25:16.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-06T02:25:16.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-06T02:25:16.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-06-06T02:25:16.873 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-06-06T02:25:16.873 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-06-06T02:25:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:17 smithi082 ceph-mon[31579]: mgrmap e12: x(active, since 2s) 2024-06-06T02:25:18.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-06T02:25:18.484 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-06-06T02:25:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:18 smithi082 ceph-mon[31579]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:19.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:19 smithi082 ceph-mon[31579]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:19 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:20.419 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$f4vE8eTCeuegujUF9xNCuOsqbDFKl8HfKynfnYADFV4bQGhwoyKEi", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717640719, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-06T02:25:20.419 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-06-06T02:25:22.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:21 smithi082 ceph-mon[31579]: mgrmap e13: x(active, since 6s) 2024-06-06T02:25:22.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:21 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3536601717' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-06T02:25:22.029 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-06-06T02:25:22.059 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-06T02:25:22.059 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-06-06T02:25:22.083 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-06T02:25:22.083 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-06-06T02:25:22.084 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-06-06T02:25:22.084 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout: Password: jg0gk2g2j9 2024-06-06T02:25:22.091 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:22.092 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config directory 2024-06-06T02:25:22.094 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-06-06T02:25:25.269 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-06T02:25:25.270 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:25.271 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-06-06T02:25:25.367 INFO:tasks.cephadm:Fetching config... 2024-06-06T02:25:25.367 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:25:25.367 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-06T02:25:25.418 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-06T02:25:25.418 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:25:25.418 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-06T02:25:25.501 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-06T02:25:25.501 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:25:25.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-06T02:25:25.616 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-06T02:25:25.616 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:25:25.616 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-06T02:25:25.709 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-06T02:25:25.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T02:25:25.816 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:25 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2782607926' entity='client.admin' 2024-06-06T02:25:25.856 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:25:25.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T02:25:25.927 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:25:25.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-06T02:25:25.995 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyRTiH+rydlQsmciADrlez7RaroAo4pUUtk0PLhARFCXlXxraAKhXQw1vtLNPkO8wlNPZCrSy2tyq3QsOnc0qH3r5tfsk0KIHJr1ZY2x/y6t3hhkaSEo8I46qXPDl7X/+MMQdEJkTJaOGyF+SIhAb5tr22hmylHgXA+ZnWwLz+dS7r/cVk6lK1elBErOpi8JqtvHC0nTnELWPZD1l17V+jpwBt6579/Qgl3RcYyadXAaK2+1gLmEmypfGKK1B3IgFjtvBVHSq5Q49r2sykvSnCH8EgzIdT/rkBd++F+bjJbaQBR2KDvGBjZcnyf4gMmgHQpuFRg366tx/Dd8pyMaxUb3L9TXOCo1XkTwMGYj2diaCYIHw94ivjRSG8j+6IYjMx7hKTSiRRVElrmAaE4qaHu635d2WSlNAX0mk9oRh4Dt9aXAaLJQ2exGwY0VNdfkpAgfN8RJe6dB86tdW93z4tVeG7VRyTC22kblY0eSQ89bUZU+doW206zsC8YipWZH0= ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:25:26.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-06T02:25:26.447 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:29.290 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:29.989 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-06T02:25:29.989 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-06T02:25:30.519 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:30 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4024235210' entity='client.admin' 2024-06-06T02:25:30.519 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:30.520 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:30.902 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:33.880 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi103 2024-06-06T02:25:33.880 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:25:33.880 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.conf 2024-06-06T02:25:33.899 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:25:33.899 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:33.957 INFO:tasks.cephadm:Adding host smithi103 to orchestrator... 2024-06-06T02:25:33.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch host add smithi103 2024-06-06T02:25:34.354 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:25:34.509 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:34 smithi082 ceph-mon[31579]: Updating smithi082:/etc/ceph/ceph.conf 2024-06-06T02:25:35.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:35 smithi082 ceph-mon[31579]: Updating smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:25:35.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:35 smithi082 ceph-mon[31579]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:36.289 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:36 smithi082 ceph-mon[31579]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:36.289 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:36 smithi082 ceph-mon[31579]: Updating smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T02:25:36.289 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:36.289 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:36.289 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:38 smithi082 ceph-mon[31579]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:38 smithi082 ceph-mon[31579]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:39 smithi082 ceph-mon[31579]: Deploying cephadm binary to smithi103 2024-06-06T02:25:40.506 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi103' with addr '172.21.15.103' 2024-06-06T02:25:40.506 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:40 smithi082 ceph-mon[31579]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:41.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T02:25:41.675 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:41.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:41.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: Added host smithi103 2024-06-06T02:25:41.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:41.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:41.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:41.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:43.110 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:43.837 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:43.837 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}] 2024-06-06T02:25:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:43 smithi082 ceph-mon[31579]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:44.577 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2024-06-06T02:25:44.577 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:25:44.578 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2024-06-06T02:25:44.596 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:25:44.596 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:44.653 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2024-06-06T02:25:44.654 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch host add smithi184 2024-06-06T02:25:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:25:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: Updating smithi103:/etc/ceph/ceph.conf 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: Updating smithi103:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: Updating smithi103:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T02:25:46.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:46.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:46.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:47 smithi082 ceph-mon[31579]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:49.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:48 smithi082 ceph-mon[31579]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:25:50.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:49 smithi082 ceph-mon[31579]: Deploying cephadm binary to smithi184 2024-06-06T02:25:50.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:49 smithi082 ceph-mon[31579]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:51.144 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi184' with addr '172.21.15.184' 2024-06-06T02:25:51.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-06T02:25:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:52.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:52.516 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:52.517 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: Added host smithi184 2024-06-06T02:25:52.517 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:25:52.517 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:52.517 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:53.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:53 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:53.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:53 smithi082 ceph-mon[31579]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:54.676 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:25:54.676 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2024-06-06T02:25:55.373 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-06T02:25:55.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-06T02:25:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:56.476 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:56.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:56.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:25:56.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:25:56.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:25:56.477 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:56 smithi082 ceph-mon[31579]: Updating smithi184:/etc/ceph/ceph.conf 2024-06-06T02:25:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: Updating smithi184:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:25:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:25:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: Updating smithi184:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T02:25:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:57.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:25:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-06-06T02:25:58.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:58 smithi082 ceph-mon[31579]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:25:58.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:58 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2220224001' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T02:25:59.181 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-06-06T02:25:59.181 INFO:tasks.cephadm:Adding mon.b on smithi103 2024-06-06T02:25:59.181 INFO:tasks.cephadm:Adding mon.c on smithi184 2024-06-06T02:25:59.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c' 2024-06-06T02:25:59.416 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:25:59.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2220224001' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T02:25:59.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:59 smithi082 ceph-mon[31579]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:25:59.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:25:59 smithi082 ceph-mon[31579]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:01.142 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2024-06-06T02:26:01.682 DEBUG:teuthology.orchestra.run.smithi103:mon.b> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.b.service 2024-06-06T02:26:01.684 DEBUG:teuthology.orchestra.run.smithi184:mon.c> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.c.service 2024-06-06T02:26:01.687 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T02:26:01.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T02:26:02.397 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c;count:3 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:02.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:02 smithi082 ceph-mon[31579]: Deploying daemon mon.c on smithi184 2024-06-06T02:26:04.507 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:26:04.508 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","modified":"2024-06-06T02:24:07.948041Z","created":"2024-06-06T02:24:07.948041Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-06T02:26:04.508 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-06-06T02:26:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:04 smithi082 ceph-mon[31579]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:05.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:05 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/238980938' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T02:26:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:06 smithi082 ceph-mon[31579]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.631 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 podman[36902]: 2024-06-06 02:26:06.500225888 +0000 UTC m=+0.116019444 container create ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 podman[36902]: 2024-06-06 02:26:06.719604544 +0000 UTC m=+0.335398115 container init ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 podman[36902]: 2024-06-06 02:26:06.722736684 +0000 UTC m=+0.338530249 container start ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2) 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: set uid:gid to 167:167 (ceph:ceph) 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: ceph version 19.0.0-4083-g3c55257c (3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8) squid (dev), process ceph-mon, pid 2 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pidfile_write: ignore empty --pid-file 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: load: jerasure load: lrc 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: RocksDB version: 7.9.2 2024-06-06T02:26:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Git sha 0 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Compile date 2024-06-05 01:48:04 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: DB SUMMARY 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: DB Session ID: 3OE1AIIZS2AFX1SW2DSI 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: CURRENT file: CURRENT 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: IDENTITY file: IDENTITY 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.error_if_exists: 0 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.create_if_missing: 0 2024-06-06T02:26:06.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.paranoid_checks: 1 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.env: 0x5648a3f975e0 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.fs: PosixFileSystem 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.info_log: 0x5648a9910fe0 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_file_opening_threads: 16 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.statistics: (nil) 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.use_fsync: 0 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_log_file_size: 0 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-06T02:26:06.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.keep_log_file_num: 1000 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.recycle_log_file_num: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_fallocate: 1 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_mmap_reads: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_mmap_writes: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.use_direct_reads: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.create_missing_column_families: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.db_log_dir: 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.wal_dir: 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-06T02:26:06.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.advise_random_on_open: 1 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.db_write_buffer_size: 0 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.write_buffer_manager: 0x5648a99141e0 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.rate_limiter: (nil) 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.wal_recovery_mode: 2 2024-06-06T02:26:06.902 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enable_thread_tracking: 0 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enable_pipelined_write: 0 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.unordered_write: 0 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.row_cache: None 2024-06-06T02:26:06.903 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.wal_filter: None 2024-06-06T02:26:06.904 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_ingest_behind: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.two_write_queues: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.manual_wal_flush: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.wal_compression: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.atomic_flush: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.log_readahead_size: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.best_efforts_recovery: 0 2024-06-06T02:26:06.905 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.allow_data_in_errors: 0 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.db_host_id: __hostname__ 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_background_jobs: 2 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_background_compactions: -1 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_subcompactions: 1 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_total_wal_size: 0 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-06T02:26:06.906 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_open_files: -1 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bytes_per_sync: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_readahead_size: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_background_flushes: -1 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Compression algorithms supported: 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kZSTD supported: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kXpressCompression supported: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kBZip2Compression supported: 0 2024-06-06T02:26:06.907 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kLZ4Compression supported: 1 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kZlibCompression supported: 1 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kLZ4HCCompression supported: 1 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: kSnappyCompression supported: 1 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.merge_operator: 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_filter: None 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_filter_factory: None 2024-06-06T02:26:06.908 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.sst_partitioner_factory: None 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5648a9910c00) 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_type: 0 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_index_type: 0 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_shortening: 1 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: checksum: 4 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: no_block_cache: 0 2024-06-06T02:26:06.909 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache: 0x5648a58d7610 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_options: 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: capacity : 536870912 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_shard_bits : 4 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: strict_capacity_limit : 0 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_compressed: (nil) 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: persistent_cache: (nil) 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size: 4096 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size_deviation: 10 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_restart_interval: 16 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_block_restart_interval: 1 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: metadata_block_size: 4096 2024-06-06T02:26:06.910 INFO:journalctl@ceph.mon.c.smithi184.stdout: partition_filters: 0 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: use_delta_encoding: 1 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: filter_policy: bloomfilter 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: whole_key_filtering: 1 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: verify_compression: 0 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: format_version: 5 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_index_compression: 1 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_align: 0 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: max_auto_readahead_size: 262144 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: prepopulate_block_cache: 0 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: initial_auto_readahead_size: 8192 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.write_buffer_size: 33554432 2024-06-06T02:26:06.911 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_write_buffer_number: 2 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression: NoCompression 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression: Disabled 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.prefix_extractor: nullptr 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.num_levels: 7 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-06T02:26:06.912 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.level: 32767 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.strategy: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.enabled: false 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-06T02:26:06.913 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.target_file_size_base: 67108864 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-06T02:26:06.914 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.arena_block_size: 1048576 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.disable_auto_compactions: 0 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-06T02:26:06.915 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.inplace_update_support: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.bloom_locality: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.max_successive_merges: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.paranoid_file_checks: 0 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.force_consistency_checks: 1 2024-06-06T02:26:06.916 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.report_bg_io_stats: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.ttl: 2592000 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enable_blob_files: false 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.min_blob_size: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_file_size: 268435456 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-06T02:26:06.917 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.blob_file_starting_level: 0 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6410e618-6298-4318-b18c-5fd28abd4897 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640766759845, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640766760430, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717640766, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6410e618-6298-4318-b18c-5fd28abd4897", "db_session_id": "3OE1AIIZS2AFX1SW2DSI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717640766760560, "job": 1, "event": "recovery_finished"} 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5648a9934a80 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: DB pointer 0x5648aa6d6000 2024-06-06T02:26:06.918 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** DB Stats ** 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-06T02:26:06.919 INFO:journalctl@ceph.mon.c.smithi184.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-06T02:26:06.920 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache BinnedLRUCache@0x5648a58d7610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: using public_addr v2:172.21.15.184:0/0 -> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: starting mon.c rank -1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(???) e0 preinit fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:06.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 bash[36902]: ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).mds e1 new map 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).mds e1 print_map 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: e1 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: legacy client fscid: -1 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout: No filesystems configured 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-06T02:26:06.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:06.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi103:/etc/ceph/ceph.conf 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi103:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi103:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Deploying cephadm binary to smithi184 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.924 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Added host smithi184 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:26:06.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi184:/etc/ceph/ceph.conf 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi184:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Updating smithi184:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2220224001' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2220224001' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:06.926 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c;count:3 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: Deploying daemon mon.c on smithi184 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/238980938' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T02:26:06.927 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:06.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 systemd[1]: Started Ceph mon.c for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:26:06.928 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:06 smithi184 ceph-mon[36922]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-06T02:26:06.942 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T02:26:06.942 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T02:26:07.171 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: mon.a calling monitor election 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: mon.c calling monitor election 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: monmap epoch 2 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: last_changed 2024-06-06T02:26:06.803084+0000 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: min_mon_release 19 (squid) 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: election_strategy: 1 2024-06-06T02:26:12.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: fsmap 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: mgrmap e13: x(active, since 57s) 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: overall HEALTH_OK 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:12.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:12.358 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:26:12.358 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","modified":"2024-06-06T02:26:06.803084Z","created":"2024-06-06T02:24:07.948041Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T02:26:12.358 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: mon.a calling monitor election 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: mon.c calling monitor election 2024-06-06T02:26:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: monmap epoch 2 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: last_changed 2024-06-06T02:26:06.803084+0000 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: min_mon_release 19 (squid) 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: election_strategy: 1 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:12.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: fsmap 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: mgrmap e13: x(active, since 57s) 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: overall HEALTH_OK 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:12.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:13.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:12 smithi082 ceph-mon[31579]: Deploying daemon mon.b on smithi103 2024-06-06T02:26:13.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:12 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/937270030' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T02:26:13.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:13.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:12 smithi184 ceph-mon[36922]: Deploying daemon mon.b on smithi103 2024-06-06T02:26:13.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:12 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/937270030' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-06T02:26:13.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:13.947 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-06T02:26:13.948 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-06T02:26:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:13 smithi082 ceph-mon[31579]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:14.120 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:26:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:26:13.804+0000 7ff16c000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-06-06T02:26:14.190 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:26:14.311 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:13 smithi184 ceph-mon[36922]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:15.495 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:15 smithi103 ceph-mon[36349]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-06T02:26:15.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:15 smithi103 bash[36331]: 4c2c3bd7abfb2e319f96cb86340730aa2a949c36e5f7374b48d7cbbf7f8fce92 2024-06-06T02:26:15.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:15 smithi103 systemd[1]: Started Ceph mon.b for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:26:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: mon.c calling monitor election 2024-06-06T02:26:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:26:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: mon.a calling monitor election 2024-06-06T02:26:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: monmap epoch 3 2024-06-06T02:26:20.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: min_mon_release 19 (squid) 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: election_strategy: 1 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: fsmap 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: mgrmap e13: x(active, since 65s) 2024-06-06T02:26:20.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: mon.b (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: mon.c calling monitor election 2024-06-06T02:26:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: mon.a calling monitor election 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: monmap epoch 3 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: min_mon_release 19 (squid) 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: election_strategy: 1 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: fsmap 2024-06-06T02:26:20.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: mgrmap e13: x(active, since 65s) 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: mon.b (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:20.900 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:21 smithi184 ceph-mon[36922]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:21 smithi082 ceph-mon[31579]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:21.878 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-06-06T02:26:21.878 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":3,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","modified":"2024-06-06T02:26:15.497155Z","created":"2024-06-06T02:24:07.948041Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-06T02:26:21.878 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 3 2024-06-06T02:26:22.555 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-06T02:26:22.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-06T02:26:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: mon.c calling monitor election 2024-06-06T02:26:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:26:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: mon.a calling monitor election 2024-06-06T02:26:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: monmap epoch 3 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: min_mon_release 19 (squid) 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: election_strategy: 1 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: fsmap 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: mgrmap e13: x(active, since 65s) 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: mon.b (rank 2) addr [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] is down (out of quorum) 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:22.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:22.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:22.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:22.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:22.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:22.955 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mon.b calling monitor election 2024-06-06T02:26:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mon.b calling monitor election 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mon.c calling monitor election 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mon.a calling monitor election 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: monmap epoch 3 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: min_mon_release 19 (squid) 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: election_strategy: 1 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:23.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: fsmap 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: mgrmap e13: x(active, since 67s) 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: Cluster is now healthy 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: overall HEALTH_OK 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mon.b calling monitor election 2024-06-06T02:26:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mon.b calling monitor election 2024-06-06T02:26:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mon.c calling monitor election 2024-06-06T02:26:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mon.a calling monitor election 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: monmap epoch 3 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: min_mon_release 19 (squid) 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: election_strategy: 1 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: fsmap 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: mgrmap e13: x(active, since 67s) 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: Cluster is now healthy 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: overall HEALTH_OK 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.620 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.620 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.620 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:23.620 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:23.620 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:23.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mon.b calling monitor election 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mon.b calling monitor election 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mon.c calling monitor election 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mon.a calling monitor election 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: monmap epoch 3 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: last_changed 2024-06-06T02:26:15.497155+0000 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: created 2024-06-06T02:24:07.948041+0000 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: min_mon_release 19 (squid) 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: election_strategy: 1 2024-06-06T02:26:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: 1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: 2: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: fsmap 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: osdmap e4: 0 total, 0 up, 0 in 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: mgrmap e13: x(active, since 67s) 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: Cluster is now healthy 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: overall HEALTH_OK 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:23.650 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:24.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:24 smithi082 ceph-mon[31579]: Updating smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:24.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:24 smithi082 ceph-mon[31579]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:24.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:24 smithi082 ceph-mon[31579]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T02:26:24.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:24 smithi082 ceph-mon[31579]: Reconfiguring daemon mon.a on smithi082 2024-06-06T02:26:24.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:24 smithi103 ceph-mon[36349]: Updating smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:24 smithi103 ceph-mon[36349]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:24 smithi103 ceph-mon[36349]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T02:26:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:24 smithi103 ceph-mon[36349]: Reconfiguring daemon mon.a on smithi082 2024-06-06T02:26:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:24 smithi184 ceph-mon[36922]: Updating smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-06T02:26:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:24 smithi184 ceph-mon[36922]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:24 smithi184 ceph-mon[36922]: Reconfiguring mon.a (unknown last config time)... 2024-06-06T02:26:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:24 smithi184 ceph-mon[36922]: Reconfiguring daemon mon.a on smithi082 2024-06-06T02:26:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:26:25.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:25 smithi082 ceph-mon[31579]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:25.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:25.864 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:25.864 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-06-06T02:26:25.864 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:26:25.864 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-06-06T02:26:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:25 smithi103 ceph-mon[36349]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:26.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:25 smithi184 ceph-mon[36922]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:26.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:26.569 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-06T02:26:26.570 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:26:26.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T02:26:26.662 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:26:26.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:26:26.777 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:26:26.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T02:26:26.805 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:26:26.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:26:26.870 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:26:26.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-06-06T02:26:26.897 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:26:26.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-06T02:26:26.960 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-06-06T02:26:26.960 INFO:tasks.cephadm:Adding mgr.y on smithi103 2024-06-06T02:26:26.960 INFO:tasks.cephadm:Adding mgr.z on smithi184 2024-06-06T02:26:26.961 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi082=x;smithi103=y;smithi184=z' 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: Reconfiguring mon.b (monmap changed)... 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: Reconfiguring daemon mon.b on smithi103 2024-06-06T02:26:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:26 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3036314304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: Reconfiguring mon.b (monmap changed)... 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: Reconfiguring daemon mon.b on smithi103 2024-06-06T02:26:27.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:26 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3036314304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: Reconfiguring mon.b (monmap changed)... 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: Reconfiguring daemon mon.b on smithi103 2024-06-06T02:26:27.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:26 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3036314304' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:27.238 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:26:28.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:28.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: Reconfiguring mon.c (monmap changed)... 2024-06-06T02:26:28.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:28.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:28.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:28.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:28 smithi184 ceph-mon[36922]: Reconfiguring daemon mon.c on smithi184 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: Reconfiguring mon.c (monmap changed)... 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:28.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:28 smithi103 ceph-mon[36349]: Reconfiguring daemon mon.c on smithi184 2024-06-06T02:26:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: Reconfiguring mon.c (monmap changed)... 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:28 smithi082 ceph-mon[31579]: Reconfiguring daemon mon.c on smithi184 2024-06-06T02:26:29.744 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mgr update... 2024-06-06T02:26:30.332 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:30.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:30.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:30.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.361 DEBUG:teuthology.orchestra.run.smithi103:mgr.y> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-06T02:26:30.363 DEBUG:teuthology.orchestra.run.smithi184:mgr.z> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-06T02:26:30.366 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-06-06T02:26:30.366 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-06-06T02:26:30.371 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-06-06T02:26:30.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set client debug_client 20 2024-06-06T02:26:30.417 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-06-06T02:26:30.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set client debug_ms 1 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:30.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.441 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-06-06T02:26:30.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-06-06T02:26:30.486 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-06-06T02:26:30.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-06-06T02:26:30.534 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-06-06T02:26:30.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds debug_mds 20 2024-06-06T02:26:30.579 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-06-06T02:26:30.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:30.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:30.626 INFO:tasks.cephadm:setting config [mds] debug_ms = 1 2024-06-06T02:26:30.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds debug_ms 1 2024-06-06T02:26:30.674 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-06-06T02:26:30.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-06-06T02:26:30.726 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-06-06T02:26:30.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-06-06T02:26:30.776 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-06-06T02:26:30.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-06-06T02:26:30.825 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-06-06T02:26:30.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-06-06T02:26:30.882 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-06-06T02:26:30.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-06-06T02:26:30.943 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-06-06T02:26:30.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-06-06T02:26:31.001 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-06-06T02:26:31.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-06-06T02:26:31.053 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-06-06T02:26:31.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-06-06T02:26:31.058 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:31.075 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-06-06T02:26:31.075 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-06-06T02:26:31.140 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-06-06T02:26:31.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-06-06T02:26:31.180 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:31.204 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-06-06T02:26:31.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-06-06T02:26:31.205 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:31.275 INFO:tasks.cephadm:setting config [mon] mon_down_mkfs_grace = 300 2024-06-06T02:26:31.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mon mon_down_mkfs_grace 300 2024-06-06T02:26:31.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:31 smithi082 ceph-mon[31579]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi103=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:31.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:31 smithi082 ceph-mon[31579]: Saving service mgr spec with placement smithi082=x;smithi103=y;smithi184=z;count:3 2024-06-06T02:26:31.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:31 smithi082 ceph-mon[31579]: Deploying daemon mgr.z on smithi184 2024-06-06T02:26:31.328 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-06-06T02:26:31.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-06-06T02:26:31.393 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-06-06T02:26:31.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-06-06T02:26:31.446 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-06-06T02:26:31.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-06-06T02:26:31.505 DEBUG:tasks.cephadm:set 23 configs 2024-06-06T02:26:31.506 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi082') 2024-06-06T02:26:31.512 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:31 smithi184 ceph-mon[36922]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi103=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:31.512 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:31 smithi184 ceph-mon[36922]: Saving service mgr spec with placement smithi082=x;smithi103=y;smithi184=z;count:3 2024-06-06T02:26:31.512 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:31 smithi184 ceph-mon[36922]: Deploying daemon mgr.z on smithi184 2024-06-06T02:26:31.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:31 smithi103 ceph-mon[36349]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi103=y;smithi184=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:26:31.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:31 smithi103 ceph-mon[36349]: Saving service mgr spec with placement smithi082=x;smithi103=y;smithi184=z;count:3 2024-06-06T02:26:31.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:31 smithi103 ceph-mon[36349]: Deploying daemon mgr.z on smithi184 2024-06-06T02:26:31.869 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:31 smithi184 systemd[1]: Starting Ceph mgr.z for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:26:32.147 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 podman[38555]: 2024-06-06 02:26:32.075520538 +0000 UTC m=+0.102707287 container create 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True) 2024-06-06T02:26:32.147 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 podman[38555]: 2024-06-06 02:26:31.989607189 +0000 UTC m=+0.016793947 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:26:32.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:32 smithi082 ceph-mon[31579]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:32.441 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-mon[36922]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:32.442 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 podman[38555]: 2024-06-06 02:26:32.286260854 +0000 UTC m=+0.313447603 container init 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.35.3) 2024-06-06T02:26:32.442 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 podman[38555]: 2024-06-06 02:26:32.288928352 +0000 UTC m=+0.316115102 container start 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True) 2024-06-06T02:26:32.442 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-mgr[38574]: -- 172.21.15.184:0/173465147 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9232f70e0 con 0x55c927499a80 2024-06-06T02:26:32.442 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 bash[38555]: 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 2024-06-06T02:26:32.442 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 systemd[1]: Started Ceph mgr.z for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:26:32.518 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:32 smithi103 ceph-mon[36349]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:32.897 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:32.442+0000 7f1b1a20e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T02:26:32.897 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:32.593+0000 7f1b1a20e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:26:32.897 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:32.662+0000 7f1b1a20e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T02:26:33.393 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:33.397 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:32.908+0000 7f1b1a20e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T02:26:33.397 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:32.968+0000 7f1b1a20e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T02:26:33.397 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:33.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: Deploying daemon mgr.y on smithi103 2024-06-06T02:26:33.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:33 smithi082 ceph-mon[31579]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:33.748 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:33.749 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: Deploying daemon mgr.y on smithi103 2024-06-06T02:26:33.749 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:33 smithi103 ceph-mon[36349]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:33.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: Deploying daemon mgr.y on smithi103 2024-06-06T02:26:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-mon[36922]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:34.305 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:33 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:33.916+0000 7f1b1a20e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T02:26:34.305 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.033+0000 7f1b1a20e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T02:26:34.305 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.091+0000 7f1b1a20e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T02:26:34.305 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.305+0000 7f1b1a20e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T02:26:34.367 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 systemd[1]: Starting Ceph mgr.y for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:26:34.582 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.368+0000 7f1b1a20e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T02:26:34.582 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.435+0000 7f1b1a20e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T02:26:34.582 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:34.582+0000 7f1b1a20e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:26:34.700 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 podman[37519]: 2024-06-06 02:26:34.347253132 +0000 UTC m=+0.016895058 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:26:34.700 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 podman[37519]: 2024-06-06 02:26:34.465824326 +0000 UTC m=+0.135466251 container create 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-06T02:26:34.700 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 podman[37519]: 2024-06-06 02:26:34.70130834 +0000 UTC m=+0.370950267 container init 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:26:34.727 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 podman[37519]: 2024-06-06 02:26:34.703889762 +0000 UTC m=+0.373531692 container start 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, ceph=True) 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 ceph-mgr[37540]: -- 172.21.15.103:0/1418997668 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d277cad0e0 con 0x55d27ca4a000 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 bash[37519]: 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 systemd[1]: Started Ceph mgr.y for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:34.842+0000 7f94fe7f1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-06T02:26:34.998 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:34 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:34.998+0000 7f94fe7f1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:26:35.336 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:35.070+0000 7f94fe7f1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-06T02:26:35.397 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:35.013+0000 7f1b1a20e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T02:26:35.397 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:35.197+0000 7f1b1a20e040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-06T02:26:35.617 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:35.336+0000 7f94fe7f1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-06T02:26:35.617 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:35.404+0000 7f94fe7f1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-06T02:26:35.829 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:35.544+0000 7f1b1a20e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T02:26:35.829 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:35.614+0000 7f1b1a20e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T02:26:35.829 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:35.781+0000 7f1b1a20e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.059 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:36.371 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.114+0000 7f1b1a20e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T02:26:36.371 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.179+0000 7f1b1a20e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T02:26:36.371 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.371+0000 7f1b1a20e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T02:26:36.647 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.521+0000 7f1b1a20e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T02:26:36.647 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.585+0000 7f1b1a20e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T02:26:36.807 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.414+0000 7f94fe7f1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-06T02:26:36.808 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.532+0000 7f94fe7f1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-06T02:26:36.808 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.591+0000 7f94fe7f1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-06T02:26:36.808 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.807+0000 7f94fe7f1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-06T02:26:37.068 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.668+0000 7f1b1a20e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T02:26:37.068 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:36.728+0000 7f1b1a20e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T02:26:37.068 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.870+0000 7f94fe7f1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-06T02:26:37.069 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:36.937+0000 7f94fe7f1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-06T02:26:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:37 smithi082 ceph-mon[31579]: Reconfiguring daemon mgr.x on smithi082 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:37.088+0000 7f94fe7f1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:37.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-mon[36349]: Reconfiguring daemon mgr.x on smithi082 2024-06-06T02:26:37.397 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:37.278+0000 7f1b1a20e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: Reconfiguring mgr.x (unknown last config time)... 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-06T02:26:37.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:37.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-mon[36922]: Reconfiguring daemon mgr.x on smithi082 2024-06-06T02:26:37.867 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:37.516+0000 7f94fe7f1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-06T02:26:37.867 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:37 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:37.690+0000 7f94fe7f1040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-06-06T02:26:37.897 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:26:37 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z[38570]: 2024-06-06T02:26:37.444+0000 7f1b1a20e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T02:26:38.367 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.014+0000 7f94fe7f1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-06T02:26:38.367 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.082+0000 7f94fe7f1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-06T02:26:38.367 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.234+0000 7f94fe7f1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-06T02:26:38.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:38.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:38.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T02:26:38.582 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:38.583 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: Standby manager daemon z started 2024-06-06T02:26:38.583 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T02:26:38.583 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:38 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:38.809 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.554+0000 7f94fe7f1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-06T02:26:38.810 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.617+0000 7f94fe7f1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-06T02:26:38.810 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.806+0000 7f94fe7f1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-06T02:26:38.811 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:38.812 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:38.812 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T02:26:38.813 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:38.813 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: Standby manager daemon z started 2024-06-06T02:26:38.813 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T02:26:38.814 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:38.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-06T02:26:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: Standby manager daemon z started 2024-06-06T02:26:38.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-06T02:26:38.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:38 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.184:0/1524862201' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:39.105 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:38.956+0000 7f94fe7f1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-06T02:26:39.106 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:39.020+0000 7f94fe7f1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-06T02:26:39.106 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:39.105+0000 7f94fe7f1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-06T02:26:39.368 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:39.166+0000 7f94fe7f1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-06T02:26:39.541 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.552 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.552 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.552 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.719 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-mon[36349]: mgrmap e14: x(active, since 83s), standbys: z 2024-06-06T02:26:39.719 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T02:26:39.719 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-mon[36349]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:39.720 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:39.726 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:39 smithi082 ceph-mon[31579]: mgrmap e14: x(active, since 83s), standbys: z 2024-06-06T02:26:39.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T02:26:39.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:39 smithi082 ceph-mon[31579]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:39.738 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:39 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.747 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.751 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:39.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:39 smithi184 ceph-mon[36922]: mgrmap e14: x(active, since 83s), standbys: z 2024-06-06T02:26:39.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-06T02:26:39.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:39 smithi184 ceph-mon[36922]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:39.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:39 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:40.117 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:39.719+0000 7f94fe7f1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-06T02:26:40.117 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:26:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y[37536]: 2024-06-06T02:26:39.882+0000 7f94fe7f1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-06T02:26:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:40.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:40.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: Standby manager daemon y started 2024-06-06T02:26:40.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T02:26:40.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:40.929 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T02:26:40.929 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:40 smithi082 ceph-mon[31579]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: Standby manager daemon y started 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T02:26:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:40 smithi103 ceph-mon[36349]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: Standby manager daemon y started 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-06T02:26:41.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:40 smithi184 ceph-mon[36922]: from='mgr.? 172.21.15.103:0/3466534401' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-06T02:26:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:41.994 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:41.999 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:42.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:41 smithi082 ceph-mon[31579]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:42.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:41 smithi082 ceph-mon[31579]: mgrmap e15: x(active, since 86s), standbys: z, y 2024-06-06T02:26:42.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T02:26:42.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:41 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4030165562' entity='client.admin' 2024-06-06T02:26:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:41 smithi103 ceph-mon[36349]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:41 smithi103 ceph-mon[36349]: mgrmap e15: x(active, since 86s), standbys: z, y 2024-06-06T02:26:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:41 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T02:26:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:41 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4030165562' entity='client.admin' 2024-06-06T02:26:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:41 smithi184 ceph-mon[36922]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:41 smithi184 ceph-mon[36922]: mgrmap e15: x(active, since 86s), standbys: z, y 2024-06-06T02:26:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:41 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-06T02:26:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:41 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4030165562' entity='client.admin' 2024-06-06T02:26:43.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:43 smithi184 ceph-mon[36922]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:43.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:43 smithi082 ceph-mon[31579]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:44.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:43 smithi103 ceph-mon[36349]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:45.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:45 smithi082 ceph-mon[31579]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:45.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:45 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:46.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:45 smithi103 ceph-mon[36349]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:46.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:45 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:45 smithi184 ceph-mon[36922]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:45 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:47.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:26:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:26:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:48 smithi103 ceph-mon[36349]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:48.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:48 smithi082 ceph-mon[31579]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:48 smithi184 ceph-mon[36922]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:49.753 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi082') 2024-06-06T02:26:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:50 smithi103 ceph-mon[36349]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:50 smithi082 ceph-mon[31579]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:50 smithi184 ceph-mon[36922]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:51.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.810+0000 7f28a8c00640 1 -- 172.21.15.82:0/1335944955 <== mon.1 v2:172.21.15.184:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v14)=0 v14) ==== 109+0+0 (secure 0 0 0) 0x7f28a40ca520 con 0x7f28ac102c60 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f28900b2760 msgr2=0x7f28900b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f28900b2760 0x7f28900b4c70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f28ac19c5c0 tx=0x7f2898005f90 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102c60 msgr2=0x7f28ac19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102c60 0x7f28ac19b510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009b30 tx=0x7f28a4030bc0 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 shutdown_connections 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28ac1046e0 0x7f28ac1a29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28ac103d90 0x7f28ac19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f28900b2760 0x7f28900b4c70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 --2- 172.21.15.82:0/1335944955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28ac102c60 0x7f28ac19b510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 >> 172.21.15.82:0/1335944955 conn(0x7f28ac0fe490 msgr2=0x7f28ac074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 shutdown_connections 2024-06-06T02:26:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:51.813+0000 7f28b3200640 1 -- 172.21.15.82:0/1335944955 wait complete. 2024-06-06T02:26:52.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:52 smithi082 ceph-mon[31579]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:52.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:52 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:52 smithi103 ceph-mon[36349]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:52 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:52.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:52 smithi184 ceph-mon[36922]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:52.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:52 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:54.363 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:54 smithi082 ceph-mon[31579]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:54 smithi103 ceph-mon[36349]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:54 smithi184 ceph-mon[36922]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 -- 172.21.15.82:0/396227174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc102a70 msgr2=0x7f2cfc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 --2- 172.21.15.82:0/396227174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc102a70 0x7f2cfc102e80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009ca0 tx=0x7f2cec02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 -- 172.21.15.82:0/396227174 shutdown_connections 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 --2- 172.21.15.82:0/396227174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 --2- 172.21.15.82:0/396227174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 0x7f2cfc103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 --2- 172.21.15.82:0/396227174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc102a70 0x7f2cfc102e80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 -- 172.21.15.82:0/396227174 >> 172.21.15.82:0/396227174 conn(0x7f2cfc0fe2a0 msgr2=0x7f2cfc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:54.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.656+0000 7f2d02200640 1 -- 172.21.15.82:0/396227174 shutdown_connections 2024-06-06T02:26:54.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.657+0000 7f2d02200640 1 -- 172.21.15.82:0/396227174 wait complete. 2024-06-06T02:26:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.659+0000 7f2d02200640 1 Processor -- start 2024-06-06T02:26:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.659+0000 7f2d02200640 1 -- start start 2024-06-06T02:26:54.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc102a70 0x7f2cfc19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 0x7f2cfc19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc10e550 con 0x7f2cfc103ba0 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc10e3d0 con 0x7f2cfc1044f0 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d02200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc10e6d0 con 0x7f2cfc102a70 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d01800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2cf3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 0x7f2cfc19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:54.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d00e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc102a70 0x7f2cfc19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d01800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49446/0 (socket says 172.21.15.82:49446) 2024-06-06T02:26:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.660+0000 7f2d01800640 1 -- 172.21.15.82:0/1491794360 learned_addr learned my addr 172.21.15.82:0/1491794360 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:26:54.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 -- 172.21.15.82:0/1491794360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc102a70 msgr2=0x7f2cfc19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc102a70 0x7f2cfc19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 -- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 msgr2=0x7f2cfc19b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 0x7f2cfc19b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 -- 172.21.15.82:0/1491794360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc1a2ea0 con 0x7f2cfc1044f0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2d01800640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400e970 tx=0x7f2cf400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.661+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400ccc0 con 0x7f2cfc1044f0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.662+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cf400ce60 con 0x7f2cfc1044f0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.662+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4010430 con 0x7f2cfc1044f0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.662+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc1a3190 con 0x7f2cfc1044f0 2024-06-06T02:26:54.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.662+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc1a3680 con 0x7f2cfc1044f0 2024-06-06T02:26:54.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.664+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd8005290 con 0x7f2cfc1044f0 2024-06-06T02:26:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.666+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f2cf40105d0 con 0x7f2cfc1044f0 2024-06-06T02:26:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.668+0000 7f2cfa000640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 0x7f2ce00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.668+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2cf40e0940 con 0x7f2cfc1044f0 2024-06-06T02:26:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.668+0000 7f2d00e00640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 0x7f2ce00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.669+0000 7f2d00e00640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 0x7f2ce00b4c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0094e0 tx=0x7f2cec004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.672+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2cf40aa290 con 0x7f2cfc1044f0 2024-06-06T02:26:54.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.885+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f2cd8005580 con 0x7f2cfc1044f0 2024-06-06T02:26:54.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.894+0000 7f2cfa000640 1 -- 172.21.15.82:0/1491794360 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f2cf40a9b90 con 0x7f2cfc1044f0 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 msgr2=0x7f2ce00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 0x7f2ce00b4c70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0094e0 tx=0x7f2cec004a40 comp rx=0 tx=0).stop 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 msgr2=0x7f2cfc1a2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400e970 tx=0x7f2cf400ed70 comp rx=0 tx=0).stop 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 shutdown_connections 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cfc1044f0 0x7f2cfc1a2860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cfc103ba0 0x7f2cfc19b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ce00b2760 0x7f2ce00b4c70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 --2- 172.21.15.82:0/1491794360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2cfc102a70 0x7f2cfc19b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:54.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 >> 172.21.15.82:0/1491794360 conn(0x7f2cfc0fe2a0 msgr2=0x7f2cfc074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:54.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 shutdown_connections 2024-06-06T02:26:54.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:54.898+0000 7f2d02200640 1 -- 172.21.15.82:0/1491794360 wait complete. 2024-06-06T02:26:56.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:55 smithi082 ceph-mon[31579]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:56.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:55 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:55 smithi184 ceph-mon[36922]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:55 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:55 smithi103 ceph-mon[36349]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:55 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 -- 172.21.15.82:0/4203158067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6806bcb0 msgr2=0x7f8a681079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:56.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 --2- 172.21.15.82:0/4203158067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6806bcb0 0x7f8a681079f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a58009900 tx=0x7f8a5802a480 comp rx=0 tx=0).stop 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 -- 172.21.15.82:0/4203158067 shutdown_connections 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 --2- 172.21.15.82:0/4203158067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6810a910 0x7f8a6810ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 --2- 172.21.15.82:0/4203158067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6810a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 --2- 172.21.15.82:0/4203158067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6806bcb0 0x7f8a681079f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 -- 172.21.15.82:0/4203158067 >> 172.21.15.82:0/4203158067 conn(0x7f8a680fd170 msgr2=0x7f8a680ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 -- 172.21.15.82:0/4203158067 shutdown_connections 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.396+0000 7f8a6d000640 1 -- 172.21.15.82:0/4203158067 wait complete. 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.397+0000 7f8a6d000640 1 Processor -- start 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 -- start start 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:56.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 0x7f8a681a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681107b0 con 0x7f8a6806bcb0 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68110630 con 0x7f8a68107f30 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a6d000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68110930 con 0x7f8a6810a910 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a67400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a67400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50576/0 (socket says 172.21.15.82:50576) 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a67400640 1 -- 172.21.15.82:0/3502963116 learned_addr learned my addr 172.21.15.82:0/3502963116 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a67e00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 0x7f8a681a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.398+0000 7f8a66a00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 -- 172.21.15.82:0/3502963116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 msgr2=0x7f8a681a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 0x7f8a681a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 -- 172.21.15.82:0/3502963116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 msgr2=0x7f8a6819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:56.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 -- 172.21.15.82:0/3502963116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a681a2ee0 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67e00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 0x7f8a681a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a66a00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.399+0000 7f8a67400640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a58031440 tx=0x7f8a58003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.400+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5803f070 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.400+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a58031c50 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.400+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a681a3170 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.400+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58035030 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.400+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a681a3650 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.401+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a680fec90 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.404+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f8a58042070 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.405+0000 7f8a5fe00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 0x7f8a4c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.405+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a581014b0 con 0x7f8a6806bcb0 2024-06-06T02:26:56.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.405+0000 7f8a66a00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 0x7f8a4c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.406+0000 7f8a66a00640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 0x7f8a4c0b4c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a6819c470 tx=0x7f8a54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:56.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.411+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8a580ca7b0 con 0x7f8a6806bcb0 2024-06-06T02:26:56.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.626+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f8a6802dd00 con 0x7f8a6806bcb0 2024-06-06T02:26:56.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.632+0000 7f8a5fe00640 1 -- 172.21.15.82:0/3502963116 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f8a580ceab0 con 0x7f8a6806bcb0 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 msgr2=0x7f8a4c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 0x7f8a4c0b4c70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a6819c470 tx=0x7f8a54005f90 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 msgr2=0x7f8a6819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a58031440 tx=0x7f8a58003c10 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 shutdown_connections 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8a4c0b2760 0x7f8a4c0b4c70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a6810a910 0x7f8a681a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a68107f30 0x7f8a6819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 --2- 172.21.15.82:0/3502963116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a6806bcb0 0x7f8a6819b3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.635+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 >> 172.21.15.82:0/3502963116 conn(0x7f8a680fd170 msgr2=0x7f8a68108b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.636+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 shutdown_connections 2024-06-06T02:26:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:56.636+0000 7f8a6d000640 1 -- 172.21.15.82:0/3502963116 wait complete. 2024-06-06T02:26:57.324 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:26:57.373 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi082') 2024-06-06T02:26:57.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 -- 172.21.15.82:0/2001954133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 msgr2=0x7f1520104180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 --2- 172.21.15.82:0/2001954133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520104180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f150c009900 tx=0x7f150c02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 -- 172.21.15.82:0/2001954133 shutdown_connections 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 --2- 172.21.15.82:0/2001954133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f152010afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 --2- 172.21.15.82:0/2001954133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520104180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 --2- 172.21.15.82:0/2001954133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 -- 172.21.15.82:0/2001954133 >> 172.21.15.82:0/2001954133 conn(0x7f15200fe450 msgr2=0x7f1520100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 -- 172.21.15.82:0/2001954133 shutdown_connections 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.625+0000 7f1527800640 1 -- 172.21.15.82:0/2001954133 wait complete. 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.626+0000 7f1527800640 1 Processor -- start 2024-06-06T02:26:57.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.626+0000 7f1527800640 1 -- start start 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520076400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f1520074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f152010e750 con 0x7f1520103d70 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f152010e5d0 con 0x7f15201046c0 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1527800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f152010e8d0 con 0x7f1520102c40 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f151fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f151fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520074ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50598/0 (socket says 172.21.15.82:50598) 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f151fe00640 1 -- 172.21.15.82:0/850201987 learned_addr learned my addr 172.21.15.82:0/850201987 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:26:57.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f1520074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1524e00640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520076400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 -- 172.21.15.82:0/850201987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 msgr2=0x7f1520076400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520076400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 -- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 msgr2=0x7f1520074ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520074ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.627+0000 7f1525800640 1 -- 172.21.15.82:0/850201987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520075720 con 0x7f15201046c0 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f1524e00640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520076400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f1525800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f1520074ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f151800ec50 tx=0x7f151800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518003b70 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15201a3460 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1518003d10 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1518010830 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15201a38c0 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.629+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1520109e40 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.632+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f1518003ec0 con 0x7f15201046c0 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.633+0000 7f151d600640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 0x7f15080b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:26:57.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.634+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f15180e0ad0 con 0x7f15201046c0 2024-06-06T02:26:57.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.634+0000 7f1524e00640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 0x7f15080b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:26:57.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.634+0000 7f1524e00640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 0x7f15080b4c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1520103c70 tx=0x7f1514005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:26:57.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.639+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f15180e2e20 con 0x7f15201046c0 2024-06-06T02:26:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.854+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f152002dd00 con 0x7f15201046c0 2024-06-06T02:26:57.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.861+0000 7f151d600640 1 -- 172.21.15.82:0/850201987 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) ==== 120+0+0 (secure 0 0 0) 0x7f15180aa420 con 0x7f15201046c0 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 msgr2=0x7f15080b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 0x7f15080b4c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1520103c70 tx=0x7f1514005f90 comp rx=0 tx=0).stop 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 msgr2=0x7f1520074ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f1520074ff0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f151800ec50 tx=0x7f151800c6a0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 shutdown_connections 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15201046c0 0x7f1520074ff0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1520103d70 0x7f1520074ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15080b2760 0x7f15080b4c70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 --2- 172.21.15.82:0/850201987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1520102c40 0x7f1520076400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:26:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 >> 172.21.15.82:0/850201987 conn(0x7f15200fe450 msgr2=0x7f1520107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:26:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 shutdown_connections 2024-06-06T02:26:57.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:26:57.864+0000 7f1527800640 1 -- 172.21.15.82:0/850201987 wait complete. 2024-06-06T02:26:57.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:57 smithi082 ceph-mon[31579]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:57.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:57 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3502963116' entity='client.admin' 2024-06-06T02:26:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:57 smithi184 ceph-mon[36922]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:57 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3502963116' entity='client.admin' 2024-06-06T02:26:58.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:57 smithi103 ceph-mon[36349]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:26:58.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:57 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3502963116' entity='client.admin' 2024-06-06T02:26:59.103 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:58 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:26:59.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:58 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:26:59.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:58 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:26:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:27:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:26:59 smithi082 ceph-mon[31579]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:26:59 smithi184 ceph-mon[36922]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:00.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:26:59 smithi103 ceph-mon[36349]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:02.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:01 smithi082 ceph-mon[31579]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:02.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:01 smithi184 ceph-mon[36922]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:02.169 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:01 smithi103 ceph-mon[36349]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:02.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 -- 172.21.15.82:0/726275812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0104e70 msgr2=0x7f2ee0105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 --2- 172.21.15.82:0/726275812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0104e70 0x7f2ee0105280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0009ca0 tx=0x7f2ed002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 -- 172.21.15.82:0/726275812 shutdown_connections 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 --2- 172.21.15.82:0/726275812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee01068f0 0x7f2ee010d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 --2- 172.21.15.82:0/726275812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee0105fa0 0x7f2ee01063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 --2- 172.21.15.82:0/726275812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0104e70 0x7f2ee0105280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.289+0000 7f2ee5600640 1 -- 172.21.15.82:0/726275812 >> 172.21.15.82:0/726275812 conn(0x7f2ee01006e0 msgr2=0x7f2ee0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.290+0000 7f2ee5600640 1 -- 172.21.15.82:0/726275812 shutdown_connections 2024-06-06T02:27:02.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.290+0000 7f2ee5600640 1 -- 172.21.15.82:0/726275812 wait complete. 2024-06-06T02:27:02.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 Processor -- start 2024-06-06T02:27:02.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 -- start start 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0105fa0 0x7f2ee019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 0x7f2ee01a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0110950 con 0x7f2ee01068f0 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee01107d0 con 0x7f2ee0105fa0 2024-06-06T02:27:02.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2ee5600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0110ad0 con 0x7f2ee0104e70 2024-06-06T02:27:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.292+0000 7f2edea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50260/0 (socket says 172.21.15.82:50260) 2024-06-06T02:27:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 -- 172.21.15.82:0/3044076834 learned_addr learned my addr 172.21.15.82:0/3044076834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:02.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2ed6000640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0105fa0 0x7f2ee019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 -- 172.21.15.82:0/3044076834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0105fa0 msgr2=0x7f2ee019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0105fa0 0x7f2ee019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edf400640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 0x7f2ee01a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 -- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 msgr2=0x7f2ee01a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 0x7f2ee01a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edea00640 1 -- 172.21.15.82:0/3044076834 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee01a30b0 con 0x7f2ee0104e70 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.293+0000 7f2edf400640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 0x7f2ee01a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2edea00640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ed002ade0 tx=0x7f2ed00317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0003c30 con 0x7f2ee0104e70 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ed0003dd0 con 0x7f2ee0104e70 2024-06-06T02:27:02.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee01a3340 con 0x7f2ee0104e70 2024-06-06T02:27:02.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed002fb60 con 0x7f2ee0104e70 2024-06-06T02:27:02.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.294+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee01a38d0 con 0x7f2ee0104e70 2024-06-06T02:27:02.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.296+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee010c0d0 con 0x7f2ee0104e70 2024-06-06T02:27:02.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.298+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f2ed002fd00 con 0x7f2ee0104e70 2024-06-06T02:27:02.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.301+0000 7f2ed7e00640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 0x7f2ec40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:02.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.301+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2ed0101c50 con 0x7f2ee0104e70 2024-06-06T02:27:02.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.301+0000 7f2ed6000640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 0x7f2ec40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:02.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.302+0000 7f2ed6000640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 0x7f2ec40b4cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ee019c640 tx=0x7f2ec8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:02.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.302+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2ed00cb5a0 con 0x7f2ee0104e70 2024-06-06T02:27:02.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.559+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f2ee0063360 con 0x7f2ee0104e70 2024-06-06T02:27:02.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.565+0000 7f2ed7e00640 1 -- 172.21.15.82:0/3044076834 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f2ed00caea0 con 0x7f2ee0104e70 2024-06-06T02:27:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.567+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 msgr2=0x7f2ec40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.567+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 0x7f2ec40b4cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ee019c640 tx=0x7f2ec8005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.567+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 msgr2=0x7f2ee019b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.567+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ed002ade0 tx=0x7f2ed00317c0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 shutdown_connections 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ee01068f0 0x7f2ee01a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0105fa0 0x7f2ee019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2ec40b27e0 0x7f2ec40b4cf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 --2- 172.21.15.82:0/3044076834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ee0104e70 0x7f2ee019b590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 >> 172.21.15.82:0/3044076834 conn(0x7f2ee01006e0 msgr2=0x7f2ee01092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 shutdown_connections 2024-06-06T02:27:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.568+0000 7f2ee5600640 1 -- 172.21.15.82:0/3044076834 wait complete. 2024-06-06T02:27:03.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 -- 172.21.15.82:0/4155984003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c81089f0 msgr2=0x7f17c810ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 --2- 172.21.15.82:0/4155984003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c81089f0 0x7f17c810ae10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009ca0 tx=0x7f17c002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 -- 172.21.15.82:0/4155984003 shutdown_connections 2024-06-06T02:27:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 --2- 172.21.15.82:0/4155984003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c81089f0 0x7f17c810ae10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 --2- 172.21.15.82:0/4155984003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c8106090 0x7f17c81084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 --2- 172.21.15.82:0/4155984003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 -- 172.21.15.82:0/4155984003 >> 172.21.15.82:0/4155984003 conn(0x7f17c80fd340 msgr2=0x7f17c80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 -- 172.21.15.82:0/4155984003 shutdown_connections 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.199+0000 7f17cce00640 1 -- 172.21.15.82:0/4155984003 wait complete. 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 Processor -- start 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 -- start start 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 0x7f17c8101640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 0x7f17c8101b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f17c810e7a0 con 0x7f17c8106090 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17c810e620 con 0x7f17c81089f0 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.200+0000 7f17cce00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f17c810e920 con 0x7f17c8103730 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 0x7f17c8101640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:03.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50254/0 (socket says 172.21.15.82:50254) 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 0x7f17c8101640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46582/0 (socket says 172.21.15.82:46582) 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5e00640 1 -- 172.21.15.82:0/3391684917 learned_addr learned my addr 172.21.15.82:0/3391684917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 0x7f17c8101b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 -- 172.21.15.82:0/3391684917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 msgr2=0x7f17c8102f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 -- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 msgr2=0x7f17c8101640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 0x7f17c8101640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c6800640 1 -- 172.21.15.82:0/3391684917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c81022b0 con 0x7f17c81089f0 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.201+0000 7f17c5e00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17c6800640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 0x7f17c8101b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17c002aeb0 tx=0x7f17c00316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0003b70 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c81a3430 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c00318e0 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c002f970 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.202+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c81a3880 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.204+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c81064a0 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.206+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f17c002fb10 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.207+0000 7f17bea00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 0x7f17ac0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.208+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17c01017d0 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.208+0000 7f17c5e00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 0x7f17ac0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.208+0000 7f17c5e00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 0x7f17ac0b4c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17b80058c0 tx=0x7f17b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.212+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f17c00cb160 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.437+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f17c80fee60 con 0x7f17c81089f0 2024-06-06T02:27:03.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.445+0000 7f17bea00640 1 -- 172.21.15.82:0/3391684917 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v18)=0 v18) ==== 117+0+0 (secure 0 0 0) 0x7f17c00caa60 con 0x7f17c81089f0 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 msgr2=0x7f17ac0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 0x7f17ac0b4c70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f17b80058c0 tx=0x7f17b8005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 msgr2=0x7f17c8101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 0x7f17c8101b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f17c002aeb0 tx=0x7f17c00316f0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 shutdown_connections 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17c81089f0 0x7f17c8101b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c8106090 0x7f17c8101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f17ac0b2760 0x7f17ac0b4c70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.449+0000 7f17cce00640 1 --2- 172.21.15.82:0/3391684917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c8103730 0x7f17c8102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.450+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 >> 172.21.15.82:0/3391684917 conn(0x7f17c80fd340 msgr2=0x7f17c8104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.450+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 shutdown_connections 2024-06-06T02:27:03.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:02.450+0000 7f17cce00640 1 -- 172.21.15.82:0/3391684917 wait complete. 2024-06-06T02:27:03.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:03 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:03 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:03 smithi103 ceph-mon[36349]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:03 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:03 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:03 smithi082 ceph-mon[31579]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:03 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:03 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:03 smithi184 ceph-mon[36922]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:04.743 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-06-06T02:27:04.744 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-06-06T02:27:04.744 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi082') 2024-06-06T02:27:04.744 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi082') 2024-06-06T02:27:05.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:05 smithi082 ceph-mon[31579]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:05 smithi103 ceph-mon[36349]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:05 smithi184 ceph-mon[36922]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 -- 172.21.15.82:0/2652670662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 msgr2=0x7fd19010a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 --2- 172.21.15.82:0/2652670662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19010a520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd178009900 tx=0x7fd17802a480 comp rx=0 tx=0).stop 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 -- 172.21.15.82:0/2652670662 shutdown_connections 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 --2- 172.21.15.82:0/2652670662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 0x7fd19010cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 --2- 172.21.15.82:0/2652670662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19010a520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 --2- 172.21.15.82:0/2652670662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 0x7fd190107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 -- 172.21.15.82:0/2652670662 >> 172.21.15.82:0/2652670662 conn(0x7fd1900fd340 msgr2=0x7fd1900ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 -- 172.21.15.82:0/2652670662 shutdown_connections 2024-06-06T02:27:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.377+0000 7fd194e00640 1 -- 172.21.15.82:0/2652670662 wait complete. 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 Processor -- start 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 -- start start 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 0x7fd19019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 0x7fd1901a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1901109a0 con 0x7fd19006b2f0 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd190110820 con 0x7fd190108100 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.378+0000 7fd194e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd190110b20 con 0x7fd19010aae0 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd18de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 0x7fd19019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60564/0 (socket says 172.21.15.82:60564) 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 -- 172.21.15.82:0/3563421780 learned_addr learned my addr 172.21.15.82:0/3563421780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd18e800640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 0x7fd1901a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 -- 172.21.15.82:0/3563421780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 msgr2=0x7fd1901a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 0x7fd1901a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 -- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 msgr2=0x7fd19019b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 0x7fd19019b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.379+0000 7fd185400640 1 -- 172.21.15.82:0/3563421780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1901a3100 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd185400640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd178031440 tx=0x7fd178003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17803f070 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1901a3390 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd178031c60 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178035030 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.380+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1901a3870 con 0x7fd190108100 2024-06-06T02:27:06.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.381+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1901a3ad0 con 0x7fd190108100 2024-06-06T02:27:06.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.383+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fd178042070 con 0x7fd190108100 2024-06-06T02:27:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.385+0000 7fd187400640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 0x7fd1700b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.385+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd178100910 con 0x7fd190108100 2024-06-06T02:27:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.385+0000 7fd18de00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 0x7fd1700b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.386+0000 7fd18de00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 0x7fd1700b4c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd19006aff0 tx=0x7fd180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.389+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd1780c9c10 con 0x7fd190108100 2024-06-06T02:27:06.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.604+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fd1901a3e60 con 0x7fd190108100 2024-06-06T02:27:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.614+0000 7fd187400640 1 -- 172.21.15.82:0/3563421780 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v21)=0 v21) ==== 127+0+0 (secure 0 0 0) 0x7fd1780cdf10 con 0x7fd190108100 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.616+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 msgr2=0x7fd1700b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 0x7fd1700b4c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd19006aff0 tx=0x7fd180005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 msgr2=0x7fd19019bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd178031440 tx=0x7fd178003c10 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 shutdown_connections 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1700b2760 0x7fd1700b4c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19010aae0 0x7fd1901a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd190108100 0x7fd19019bb20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 --2- 172.21.15.82:0/3563421780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19006b2f0 0x7fd19019b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 >> 172.21.15.82:0/3563421780 conn(0x7fd1900fd340 msgr2=0x7fd19010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 shutdown_connections 2024-06-06T02:27:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.617+0000 7fd194e00640 1 -- 172.21.15.82:0/3563421780 wait complete. 2024-06-06T02:27:06.713 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi082') 2024-06-06T02:27:06.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:06 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2851992586' entity='client.admin' 2024-06-06T02:27:06.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:06 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:06.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 -- 172.21.15.82:0/2292845438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 msgr2=0x7f0b34115810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 --2- 172.21.15.82:0/2292845438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b34115810 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009ca0 tx=0x7f0b2c02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 -- 172.21.15.82:0/2292845438 shutdown_connections 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 --2- 172.21.15.82:0/2292845438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b34115810 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 --2- 172.21.15.82:0/2292845438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b3406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 --2- 172.21.15.82:0/2292845438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b3406c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.985+0000 7f0b3be00640 1 -- 172.21.15.82:0/2292845438 >> 172.21.15.82:0/2292845438 conn(0x7f0b34071eb0 msgr2=0x7f0b34109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.986+0000 7f0b3be00640 1 -- 172.21.15.82:0/2292845438 shutdown_connections 2024-06-06T02:27:06.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.986+0000 7f0b3be00640 1 -- 172.21.15.82:0/2292845438 wait complete. 2024-06-06T02:27:06.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 Processor -- start 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 -- start start 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b341a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b341a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b341ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b341191d0 con 0x7f0b3406c820 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34119050 con 0x7f0b34113300 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.987+0000 7f0b3be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34119350 con 0x7f0b3406de10 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b39400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b341a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b341a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b39400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b341a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46644/0 (socket says 172.21.15.82:46644) 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b39400640 1 -- 172.21.15.82:0/1410007950 learned_addr learned my addr 172.21.15.82:0/1410007950 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b39e00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b341ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 -- 172.21.15.82:0/1410007950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 msgr2=0x7f0b341ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b341ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 -- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 msgr2=0x7f0b341a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b341a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 -- 172.21.15.82:0/1410007950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b341ab810 con 0x7f0b3406de10 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.988+0000 7f0b38a00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b341a4210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9f0 tx=0x7f0b2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.989+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2000cd80 con 0x7f0b3406de10 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.989+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b341abb00 con 0x7f0b3406de10 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.989+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b200035f0 con 0x7f0b3406de10 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.989+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20010670 con 0x7f0b3406de10 2024-06-06T02:27:06.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.989+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b341ac040 con 0x7f0b3406de10 2024-06-06T02:27:06.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.990+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b341120c0 con 0x7f0b3406de10 2024-06-06T02:27:06.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.993+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f0b200037a0 con 0x7f0b3406de10 2024-06-06T02:27:06.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.994+0000 7f0b32000640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 0x7f0b1c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:06.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.994+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b200e07e0 con 0x7f0b3406de10 2024-06-06T02:27:06.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.994+0000 7f0b39400640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 0x7f0b1c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:06.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.995+0000 7f0b39400640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 0x7f0b1c0b4c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b341a4b70 tx=0x7f0b28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:06.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:06.996+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0b200aa130 con 0x7f0b3406de10 2024-06-06T02:27:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:06 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2851992586' entity='client.admin' 2024-06-06T02:27:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:06 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:07.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2851992586' entity='client.admin' 2024-06-06T02:27:07.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:06 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.207+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f0b3402dec0 con 0x7f0b3406de10 2024-06-06T02:27:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.214+0000 7f0b32000640 1 -- 172.21.15.82:0/1410007950 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v22)=0 v22) ==== 116+0+0 (secure 0 0 0) 0x7f0b200a9a30 con 0x7f0b3406de10 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 msgr2=0x7f0b1c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 0x7f0b1c0b4c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b341a4b70 tx=0x7f0b28005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 msgr2=0x7f0b341a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b341a4210 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000e9f0 tx=0x7f0b2000eeb0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 shutdown_connections 2024-06-06T02:27:07.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b34113300 0x7f0b341ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0b1c0b2760 0x7f0b1c0b4c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b3406de10 0x7f0b341a4210 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 --2- 172.21.15.82:0/1410007950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3406c820 0x7f0b341a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 >> 172.21.15.82:0/1410007950 conn(0x7f0b34071eb0 msgr2=0x7f0b3410f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 shutdown_connections 2024-06-06T02:27:07.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.217+0000 7f0b3be00640 1 -- 172.21.15.82:0/1410007950 wait complete. 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 -- 172.21.15.82:0/2587939113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f81046d0 msgr2=0x7f22f810afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 --2- 172.21.15.82:0/2587939113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f81046d0 0x7f22f810afd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009ca0 tx=0x7f22f002a8b0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 -- 172.21.15.82:0/2587939113 shutdown_connections 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 --2- 172.21.15.82:0/2587939113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f81046d0 0x7f22f810afd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 --2- 172.21.15.82:0/2587939113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f8103d80 0x7f22f8104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 --2- 172.21.15.82:0/2587939113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f8103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 -- 172.21.15.82:0/2587939113 >> 172.21.15.82:0/2587939113 conn(0x7f22f80fe480 msgr2=0x7f22f8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 -- 172.21.15.82:0/2587939113 shutdown_connections 2024-06-06T02:27:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.630+0000 7f22fd400640 1 -- 172.21.15.82:0/2587939113 wait complete. 2024-06-06T02:27:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.631+0000 7f22fd400640 1 Processor -- start 2024-06-06T02:27:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.631+0000 7f22fd400640 1 -- start start 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8103d80 0x7f22f8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 0x7f22f81a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f22f810e7c0 con 0x7f22f8103d80 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22f810e640 con 0x7f22f81046d0 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22fd400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f22f810e940 con 0x7f22f8102c50 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22f6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22f6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50336/0 (socket says 172.21.15.82:50336) 2024-06-06T02:27:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22f6800640 1 -- 172.21.15.82:0/1692824551 learned_addr learned my addr 172.21.15.82:0/1692824551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22f5e00640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8103d80 0x7f22f8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.632+0000 7f22f7200640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 0x7f22f81a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 -- 172.21.15.82:0/1692824551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 msgr2=0x7f22f81a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 0x7f22f81a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 -- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8103d80 msgr2=0x7f22f8199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8103d80 0x7f22f8199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 -- 172.21.15.82:0/1692824551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f81a0e00 con 0x7f22f8102c50 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f7200640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 0x7f22f81a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22f6800640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22e800e9f0 tx=0x7f22e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e800ccc0 con 0x7f22f8102c50 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e80054d0 con 0x7f22f8102c50 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8010430 con 0x7f22f8102c50 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.633+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f81a10f0 con 0x7f22f8102c50 2024-06-06T02:27:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.634+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f81a1630 con 0x7f22f8102c50 2024-06-06T02:27:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.635+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f8103060 con 0x7f22f8102c50 2024-06-06T02:27:07.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.637+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f22e80046c0 con 0x7f22f8102c50 2024-06-06T02:27:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.639+0000 7f22ef400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 0x7f22dc0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:07.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.639+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f22e80e0c90 con 0x7f22f8102c50 2024-06-06T02:27:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.639+0000 7f22f5e00640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 0x7f22dc0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.640+0000 7f22f5e00640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 0x7f22dc0b4cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22f819a390 tx=0x7f22e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:07.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.640+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22e80aa670 con 0x7f22f8102c50 2024-06-06T02:27:07.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.852+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f22f8109de0 con 0x7f22f8102c50 2024-06-06T02:27:07.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.862+0000 7f22ef400640 1 -- 172.21.15.82:0/1692824551 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f22e80a9f70 con 0x7f22f8102c50 2024-06-06T02:27:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 msgr2=0x7f22dc0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 0x7f22dc0b4cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22f819a390 tx=0x7f22e4005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 msgr2=0x7f22f81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22e800e9f0 tx=0x7f22e800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 shutdown_connections 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22f81046d0 0x7f22f81a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8103d80 0x7f22f8199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f22dc0b27e0 0x7f22dc0b4cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 --2- 172.21.15.82:0/1692824551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f8102c50 0x7f22f81992e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 >> 172.21.15.82:0/1692824551 conn(0x7f22f80fe480 msgr2=0x7f22f8106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.865+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 shutdown_connections 2024-06-06T02:27:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.866+0000 7f22fd400640 1 -- 172.21.15.82:0/1692824551 wait complete. 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 -- 172.21.15.82:0/2828281874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e806bbe0 msgr2=0x7f61e8112da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 --2- 172.21.15.82:0/2828281874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e806bbe0 0x7f61e8112da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009860 tx=0x7f61d402a340 comp rx=0 tx=0).stop 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 -- 172.21.15.82:0/2828281874 shutdown_connections 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 --2- 172.21.15.82:0/2828281874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e81133c0 0x7f61e81158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 --2- 172.21.15.82:0/2828281874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e806bbe0 0x7f61e8112da0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 --2- 172.21.15.82:0/2828281874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e806b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 -- 172.21.15.82:0/2828281874 >> 172.21.15.82:0/2828281874 conn(0x7f61e8070db0 msgr2=0x7f61e8073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 -- 172.21.15.82:0/2828281874 shutdown_connections 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.529+0000 7f61ef200640 1 -- 172.21.15.82:0/2828281874 wait complete. 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.530+0000 7f61ef200640 1 Processor -- start 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 -- start start 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e806bbe0 0x7f61e81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e81133c0 0x7f61e81ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8119220 con 0x7f61e806b270 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81190a0 con 0x7f61e806bbe0 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ef200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81193a0 con 0x7f61e81133c0 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46610/0 (socket says 172.21.15.82:46610) 2024-06-06T02:27:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61e7e00640 1 -- 172.21.15.82:0/2851992586 learned_addr learned my addr 172.21.15.82:0/2851992586 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61e7400640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e806bbe0 0x7f61e81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.531+0000 7f61ed200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e81133c0 0x7f61e81ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 -- 172.21.15.82:0/2851992586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e81133c0 msgr2=0x7f61e81ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e81133c0 0x7f61e81ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 -- 172.21.15.82:0/2851992586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e806bbe0 msgr2=0x7f61e81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e806bbe0 0x7f61e81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 -- 172.21.15.82:0/2851992586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e81ab940 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e7e00640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f61d80058c0 tx=0x7f61d800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d800cd30 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61d80035f0 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80044e0 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.532+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e81abc30 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.533+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81ac120 con 0x7f61e806b270 2024-06-06T02:27:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.534+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e810ae70 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.536+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f61d8003aa0 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.538+0000 7f61e4c00640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 0x7f61cc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.538+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f61d80e0920 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.538+0000 7f61e7400640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 0x7f61cc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.539+0000 7f61e7400640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 0x7f61cc0b4c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61d402a930 tx=0x7f61d4030450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.540+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f61d80aa270 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.756+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f61e802de20 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.762+0000 7f61e4c00640 1 -- 172.21.15.82:0/2851992586 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f61d80cae20 con 0x7f61e806b270 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 msgr2=0x7f61cc0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 0x7f61cc0b4c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f61d402a930 tx=0x7f61d4030450 comp rx=0 tx=0).stop 2024-06-06T02:27:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 msgr2=0x7f61e81a3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f61d80058c0 tx=0x7f61d800ee50 comp rx=0 tx=0).stop 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 shutdown_connections 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f61cc0b2760 0x7f61cc0b4c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61e81133c0 0x7f61e81ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61e806bbe0 0x7f61e81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 --2- 172.21.15.82:0/2851992586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61e806b270 0x7f61e81a3e90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 >> 172.21.15.82:0/2851992586 conn(0x7f61e8070db0 msgr2=0x7f61e80731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 shutdown_connections 2024-06-06T02:27:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:05.765+0000 7f61ef200640 1 -- 172.21.15.82:0/2851992586 wait complete. 2024-06-06T02:27:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:08 smithi082 ceph-mon[31579]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:08 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:08 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:08 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:08 smithi103 ceph-mon[36349]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:08 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:08 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:08 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:08 smithi184 ceph-mon[36922]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:08 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:08 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:08 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 -- 172.21.15.82:0/3507167874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab8102a70 msgr2=0x7f1ab8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 --2- 172.21.15.82:0/3507167874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab8102a70 0x7f1ab8102e80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009900 tx=0x7f1aac02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 -- 172.21.15.82:0/3507167874 shutdown_connections 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 --2- 172.21.15.82:0/3507167874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab81044f0 0x7f1ab810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 --2- 172.21.15.82:0/3507167874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8103ba0 0x7f1ab8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 --2- 172.21.15.82:0/3507167874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab8102a70 0x7f1ab8102e80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 -- 172.21.15.82:0/3507167874 >> 172.21.15.82:0/3507167874 conn(0x7f1ab80fe2a0 msgr2=0x7f1ab8100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 -- 172.21.15.82:0/3507167874 shutdown_connections 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.467+0000 7f1abe600640 1 -- 172.21.15.82:0/3507167874 wait complete. 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.468+0000 7f1abe600640 1 Processor -- start 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 -- start start 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab8103ba0 0x7f1ab8199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab81044f0 0x7f1ab81a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab810e570 con 0x7f1ab81044f0 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab810e3f0 con 0x7f1ab8103ba0 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abe600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab810e6f0 con 0x7f1ab8102a70 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abd200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1ab7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab8103ba0 0x7f1ab8199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abdc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab81044f0 0x7f1ab81a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abd200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50318/0 (socket says 172.21.15.82:50318) 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.469+0000 7f1abd200640 1 -- 172.21.15.82:0/866334436 learned_addr learned my addr 172.21.15.82:0/866334436 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 -- 172.21.15.82:0/866334436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab8103ba0 msgr2=0x7f1ab8199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab8103ba0 0x7f1ab8199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 -- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab81044f0 msgr2=0x7f1ab81a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab81044f0 0x7f1ab81a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 -- 172.21.15.82:0/866334436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab81a0c70 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abd200640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006010 tx=0x7f1aac004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac03f030 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1aac031910 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.470+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab81a0f00 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.471+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac035070 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.471+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab81a1300 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.472+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8109c00 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.474+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f1aac042030 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.475+0000 7f1ab5600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 0x7f1aa00b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.476+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1aac100c70 con 0x7f1ab8102a70 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.476+0000 7f1ab7e00640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 0x7f1aa00b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.476+0000 7f1ab7e00640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 0x7f1aa00b4c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ab819a200 tx=0x7f1aa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.477+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1aac0c9f70 con 0x7f1ab8102a70 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.689+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1ab802dda0 con 0x7f1ab8102a70 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.696+0000 7f1ab5600640 1 -- 172.21.15.82:0/866334436 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f1aac0ce270 con 0x7f1ab8102a70 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.698+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 msgr2=0x7f1aa00b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.698+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 0x7f1aa00b4c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ab819a200 tx=0x7f1aa4005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.698+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 msgr2=0x7f1ab8199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.698+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006010 tx=0x7f1aac004270 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 shutdown_connections 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ab81044f0 0x7f1ab81a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ab8103ba0 0x7f1ab8199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1aa00b2760 0x7f1aa00b4c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 --2- 172.21.15.82:0/866334436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ab8102a70 0x7f1ab8199150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 >> 172.21.15.82:0/866334436 conn(0x7f1ab80fe2a0 msgr2=0x7f1ab8106dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 shutdown_connections 2024-06-06T02:27:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:07.699+0000 7f1abe600640 1 -- 172.21.15.82:0/866334436 wait complete. 2024-06-06T02:27:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 -- 172.21.15.82:0/4206221705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010a1b0 msgr2=0x7fc7f010a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 --2- 172.21.15.82:0/4206221705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010a1b0 0x7fc7f010a5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009900 tx=0x7fc7dc02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 -- 172.21.15.82:0/4206221705 shutdown_connections 2024-06-06T02:27:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 --2- 172.21.15.82:0/4206221705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f010ab00 0x7fc7f0111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 --2- 172.21.15.82:0/4206221705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010a1b0 0x7fc7f010a5c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 --2- 172.21.15.82:0/4206221705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f0109080 0x7fc7f0109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 -- 172.21.15.82:0/4206221705 >> 172.21.15.82:0/4206221705 conn(0x7fc7f0078320 msgr2=0x7fc7f007a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 -- 172.21.15.82:0/4206221705 shutdown_connections 2024-06-06T02:27:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.366+0000 7fc7ef200640 1 -- 172.21.15.82:0/4206221705 wait complete. 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.367+0000 7fc7ef200640 1 Processor -- start 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.367+0000 7fc7ef200640 1 -- start start 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0109080 0x7fc7f019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 0x7fc7f01a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0114bc0 con 0x7fc7f010ab00 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0114a40 con 0x7fc7f010a1b0 2024-06-06T02:27:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ef200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0114d40 con 0x7fc7f0109080 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ed400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ede00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0109080 0x7fc7f019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ed400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60644/0 (socket says 172.21.15.82:60644) 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.368+0000 7fc7ed400640 1 -- 172.21.15.82:0/1209040041 learned_addr learned my addr 172.21.15.82:0/1209040041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ee800640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 0x7fc7f01a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ed400640 1 -- 172.21.15.82:0/1209040041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0109080 msgr2=0x7fc7f019f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ed400640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0109080 0x7fc7f019f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ed400640 1 -- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 msgr2=0x7fc7f01a6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ed400640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 0x7fc7f01a6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ed400640 1 -- 172.21.15.82:0/1209040041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f01a7280 con 0x7fc7f010a1b0 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.369+0000 7fc7ee800640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 0x7fc7f01a6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:27:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.370+0000 7fc7ed400640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc0042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.370+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc03f030 con 0x7fc7f010a1b0 2024-06-06T02:27:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.370+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc031910 con 0x7fc7f010a1b0 2024-06-06T02:27:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.370+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc035070 con 0x7fc7f010a1b0 2024-06-06T02:27:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.370+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01a7510 con 0x7fc7f010a1b0 2024-06-06T02:27:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.371+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a79a0 con 0x7fc7f010a1b0 2024-06-06T02:27:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.372+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f0110280 con 0x7fc7f010a1b0 2024-06-06T02:27:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.374+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fc7dc042030 con 0x7fc7f010a1b0 2024-06-06T02:27:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.376+0000 7fc7e6a00640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 0x7fc7d40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.376+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc7dc100af0 con 0x7fc7f010a1b0 2024-06-06T02:27:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.376+0000 7fc7ede00640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 0x7fc7d40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.377+0000 7fc7ede00640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 0x7fc7d40b4cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00095f0 tx=0x7fc7e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.379+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7dc0ca440 con 0x7fc7f010a1b0 2024-06-06T02:27:09.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.593+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_down_mkfs_grace}] v 0) -- 0x7fc7f002dd00 con 0x7fc7f010a1b0 2024-06-06T02:27:09.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.603+0000 7fc7e6a00640 1 -- 172.21.15.82:0/1209040041 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_down_mkfs_grace}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7fc7dc0c9d40 con 0x7fc7f010a1b0 2024-06-06T02:27:09.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 msgr2=0x7fc7d40b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:09.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 0x7fc7d40b4cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00095f0 tx=0x7fc7e0005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:09.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 msgr2=0x7fc7f019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc0042f0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 shutdown_connections 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f010ab00 0x7fc7f01a6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7f010a1b0 0x7fc7f019fca0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d40b27e0 0x7fc7d40b4cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 --2- 172.21.15.82:0/1209040041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7f0109080 0x7fc7f019f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.606+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 >> 172.21.15.82:0/1209040041 conn(0x7fc7f0078320 msgr2=0x7fc7f010d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:09.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.607+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 shutdown_connections 2024-06-06T02:27:09.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:09.607+0000 7fc7ef200640 1 -- 172.21.15.82:0/1209040041 wait complete. 2024-06-06T02:27:10.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:10 smithi103 ceph-mon[36349]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:10.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:10 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:10.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:10 smithi082 ceph-mon[31579]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:10.618 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:10 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:10.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:10 smithi184 ceph-mon[36922]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:10.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:10 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:11.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.955+0000 7f0345800640 1 -- 172.21.15.82:0/3884213291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 msgr2=0x7f0340103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.955+0000 7f0345800640 1 --2- 172.21.15.82:0/3884213291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f0340103070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0330009900 tx=0x7f033002a410 comp rx=0 tx=0).stop 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 -- 172.21.15.82:0/3884213291 shutdown_connections 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 --2- 172.21.15.82:0/3884213291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f034010afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 --2- 172.21.15.82:0/3884213291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f03401041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 --2- 172.21.15.82:0/3884213291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f0340103070 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 -- 172.21.15.82:0/3884213291 >> 172.21.15.82:0/3884213291 conn(0x7f03400fe490 msgr2=0x7f0340100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 -- 172.21.15.82:0/3884213291 shutdown_connections 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.956+0000 7f0345800640 1 -- 172.21.15.82:0/3884213291 wait complete. 2024-06-06T02:27:11.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 Processor -- start 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 -- start start 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f034019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f03401a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f034010e7b0 con 0x7f0340103d90 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f034010e630 con 0x7f03401046e0 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.957+0000 7f0345800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f034010e930 con 0x7f0340102c60 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f033ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f034019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58304/0 (socket says 172.21.15.82:58304) 2024-06-06T02:27:11.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 -- 172.21.15.82:0/88958079 learned_addr learned my addr 172.21.15.82:0/88958079 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f033f400640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f03401a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 -- 172.21.15.82:0/88958079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 msgr2=0x7f034019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f034019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 -- 172.21.15.82:0/88958079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 msgr2=0x7f03401a2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f03401a2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f0337e00640 1 -- 172.21.15.82:0/88958079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03401a31e0 con 0x7f0340103d90 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f033ea00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f034019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.958+0000 7f033f400640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f03401a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0337e00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9f0 tx=0x7f032800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:11.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032800cd80 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03401a34d0 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03280108e0 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328018980 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.959+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03401a3a60 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.960+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03401a3cc0 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.962+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f0328010430 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.964+0000 7f0337400640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 0x7f03240b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.964+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f03280e08a0 con 0x7f0340103d90 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.964+0000 7f033ea00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 0x7f03240b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:11.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.965+0000 7f033ea00640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 0x7f03240b4c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0330031440 tx=0x7f03300314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:11.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:11.969+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f03280a9ba0 con 0x7f0340103d90 2024-06-06T02:27:12.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 -- 172.21.15.82:0/233921126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7810f0c0 msgr2=0x7fae781114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 --2- 172.21.15.82:0/233921126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7810f0c0 0x7fae781114e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fae70009ca0 tx=0x7fae7002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 -- 172.21.15.82:0/233921126 shutdown_connections 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 --2- 172.21.15.82:0/233921126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae7810f0c0 0x7fae781114e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 --2- 172.21.15.82:0/233921126 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae78075090 0x7fae780754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 --2- 172.21.15.82:0/233921126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78076680 0x7fae78074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 -- 172.21.15.82:0/233921126 >> 172.21.15.82:0/233921126 conn(0x7fae780fe2a0 msgr2=0x7fae78100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 -- 172.21.15.82:0/233921126 shutdown_connections 2024-06-06T02:27:12.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.058+0000 7fae77200640 1 -- 172.21.15.82:0/233921126 wait complete. 2024-06-06T02:27:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.059+0000 7fae77200640 1 Processor -- start 2024-06-06T02:27:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.059+0000 7fae77200640 1 -- start start 2024-06-06T02:27:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:12.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae78076680 0x7fae7819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae7810f0c0 0x7fae781a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae78114bf0 con 0x7fae78076680 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae78114a70 con 0x7fae78075090 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae77200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fae78114d70 con 0x7fae7810f0c0 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae75e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae78076680 0x7fae7819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae75e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:44616/0 (socket says 172.21.15.82:44616) 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae75e00640 1 -- 172.21.15.82:0/3067378 learned_addr learned my addr 172.21.15.82:0/3067378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.060+0000 7fae76800640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae7810f0c0 0x7fae781a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 -- 172.21.15.82:0/3067378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae7810f0c0 msgr2=0x7fae781a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae7810f0c0 0x7fae781a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 -- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae78076680 msgr2=0x7fae7819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae78076680 0x7fae7819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 -- 172.21.15.82:0/3067378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae781a71f0 con 0x7fae78075090 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae75e00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae6800e9c0 tx=0x7fae6800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6800cde0 con 0x7fae78075090 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae781a74e0 con 0x7fae78075090 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.061+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae680108e0 con 0x7fae78075090 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.062+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae680188d0 con 0x7fae78075090 2024-06-06T02:27:12.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.062+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae781a7a70 con 0x7fae78075090 2024-06-06T02:27:12.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.063+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae78105170 con 0x7fae78075090 2024-06-06T02:27:12.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.067+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fae6801f020 con 0x7fae78075090 2024-06-06T02:27:12.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.069+0000 7fae6ea00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 0x7fae5c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.069+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fae680e08f0 con 0x7fae78075090 2024-06-06T02:27:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.069+0000 7fae6fe00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 0x7fae5c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:12.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.069+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fae680a5e50 con 0x7fae78075090 2024-06-06T02:27:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.070+0000 7fae6fe00640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 0x7fae5c0b4c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae781a0780 tx=0x7fae60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:12.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.182+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f03401a42e0 con 0x7f0340103d90 2024-06-06T02:27:12.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.190+0000 7f0337400640 1 -- 172.21.15.82:0/88958079 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v26)=0 v26) ==== 125+0+0 (secure 0 0 0) 0x7f03280adea0 con 0x7f0340103d90 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 msgr2=0x7f03240b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 0x7f03240b4c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0330031440 tx=0x7f03300314a0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 msgr2=0x7f034019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9f0 tx=0x7f032800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 shutdown_connections 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03401046e0 0x7f03401a2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0340103d90 0x7f034019bc00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03240b2760 0x7f03240b4c70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 --2- 172.21.15.82:0/88958079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0340102c60 0x7f034019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.193+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 >> 172.21.15.82:0/88958079 conn(0x7f03400fe490 msgr2=0x7f0340074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.194+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 shutdown_connections 2024-06-06T02:27:12.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.194+0000 7f0345800640 1 -- 172.21.15.82:0/88958079 wait complete. 2024-06-06T02:27:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.288+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fae7802dd00 con 0x7fae78075090 2024-06-06T02:27:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.295+0000 7fae6ea00640 1 -- 172.21.15.82:0/3067378 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7fae680aa2c0 con 0x7fae78075090 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 msgr2=0x7fae5c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 0x7fae5c0b4c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae781a0780 tx=0x7fae60005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 msgr2=0x7fae7819f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fae6800e9c0 tx=0x7fae6800ee80 comp rx=0 tx=0).stop 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 shutdown_connections 2024-06-06T02:27:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fae5c0b2760 0x7fae5c0b4c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae7810f0c0 0x7fae781a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae78076680 0x7fae7819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 --2- 172.21.15.82:0/3067378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae78075090 0x7fae7819f6d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.298+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 >> 172.21.15.82:0/3067378 conn(0x7fae780fe2a0 msgr2=0x7fae78102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.299+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 shutdown_connections 2024-06-06T02:27:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:12.299+0000 7fae77200640 1 -- 172.21.15.82:0/3067378 wait complete. 2024-06-06T02:27:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:12 smithi103 ceph-mon[36349]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:12 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/88958079' entity='client.admin' 2024-06-06T02:27:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:12 smithi082 ceph-mon[31579]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:12 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/88958079' entity='client.admin' 2024-06-06T02:27:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:12 smithi184 ceph-mon[36922]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:12 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/88958079' entity='client.admin' 2024-06-06T02:27:13.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:13 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:13.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:13 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:13.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:13 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:14 smithi082 ceph-mon[31579]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:14 smithi103 ceph-mon[36349]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:14 smithi184 ceph-mon[36922]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 -- 172.21.15.82:0/1655744108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc106160 msgr2=0x7f24cc108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 --2- 172.21.15.82:0/1655744108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc106160 0x7f24cc108580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009900 tx=0x7f24b802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 -- 172.21.15.82:0/1655744108 shutdown_connections 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 --2- 172.21.15.82:0/1655744108 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 0x7f24cc10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 --2- 172.21.15.82:0/1655744108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc106160 0x7f24cc108580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 --2- 172.21.15.82:0/1655744108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc103800 0x7f24cc105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 -- 172.21.15.82:0/1655744108 >> 172.21.15.82:0/1655744108 conn(0x7f24cc0fd450 msgr2=0x7f24cc0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 -- 172.21.15.82:0/1655744108 shutdown_connections 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.475+0000 7f24d1400640 1 -- 172.21.15.82:0/1655744108 wait complete. 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.476+0000 7f24d1400640 1 Processor -- start 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.476+0000 7f24d1400640 1 -- start start 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.476+0000 7f24d1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24d1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc106160 0x7f24cc19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24d1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 0x7f24cc1a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24d1400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10e800 con 0x7f24cc103800 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24d1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10e680 con 0x7f24cc108ac0 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24d1400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f24cc10e980 con 0x7f24cc106160 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58366/0 (socket says 172.21.15.82:58366) 2024-06-06T02:27:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 -- 172.21.15.82:0/1373982612 learned_addr learned my addr 172.21.15.82:0/1373982612 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24c9e00640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc106160 0x7f24cc19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24cb200640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 0x7f24cc1a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 -- 172.21.15.82:0/1373982612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc106160 msgr2=0x7f24cc19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc106160 0x7f24cc19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 -- 172.21.15.82:0/1373982612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 msgr2=0x7f24cc1a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 0x7f24cc1a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.477+0000 7f24ca800640 1 -- 172.21.15.82:0/1373982612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24cc1a3170 con 0x7f24cc103800 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24ca800640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00e9c0 tx=0x7f24bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00cd80 con 0x7f24cc103800 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24bc0035f0 con 0x7f24cc103800 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24cc1a3460 con 0x7f24cc103800 2024-06-06T02:27:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc010690 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.478+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24cc1a39f0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.479+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24cc10a5e0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.482+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f24bc0037a0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.483+0000 7f24c3400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 0x7f24b00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.484+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f24bc0e09a0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.484+0000 7f24c9e00640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 0x7f24b00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.484+0000 7f24c9e00640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 0x7f24b00b4cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009230 tx=0x7f24b8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.485+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f24bc0aa2f0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.697+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f24cc02dd00 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.707+0000 7f24c3400640 1 -- 172.21.15.82:0/1373982612 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v29)=0 v29) ==== 106+0+0 (secure 0 0 0) 0x7f24bc0a9bf0 con 0x7f24cc103800 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 msgr2=0x7f24b00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 0x7f24b00b4cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009230 tx=0x7f24b8031400 comp rx=0 tx=0).stop 2024-06-06T02:27:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 msgr2=0x7f24cc19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00e9c0 tx=0x7f24bc00ee80 comp rx=0 tx=0).stop 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 shutdown_connections 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f24cc108ac0 0x7f24cc1a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f24b00b27e0 0x7f24b00b4cf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24cc106160 0x7f24cc19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 --2- 172.21.15.82:0/1373982612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24cc103800 0x7f24cc19b650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 >> 172.21.15.82:0/1373982612 conn(0x7f24cc0fd450 msgr2=0x7f24cc103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 shutdown_connections 2024-06-06T02:27:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.710+0000 7f24d1400640 1 -- 172.21.15.82:0/1373982612 wait complete. 2024-06-06T02:27:16.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:16 smithi082 ceph-mon[31579]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:16.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/979707947' entity='client.admin' 2024-06-06T02:27:16.602 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1373982612' entity='client.admin' 2024-06-06T02:27:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:16 smithi103 ceph-mon[36349]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/979707947' entity='client.admin' 2024-06-06T02:27:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1373982612' entity='client.admin' 2024-06-06T02:27:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:16 smithi184 ceph-mon[36922]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/979707947' entity='client.admin' 2024-06-06T02:27:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1373982612' entity='client.admin' 2024-06-06T02:27:17.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 -- 172.21.15.82:0/4099063430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658108ac0 msgr2=0x7f365810aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 --2- 172.21.15.82:0/4099063430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658108ac0 0x7f365810aee0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3650009ca0 tx=0x7f365002a8e0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 -- 172.21.15.82:0/4099063430 shutdown_connections 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 --2- 172.21.15.82:0/4099063430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658108ac0 0x7f365810aee0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 --2- 172.21.15.82:0/4099063430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 0x7f3658108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 --2- 172.21.15.82:0/4099063430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658103800 0x7f3658105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 -- 172.21.15.82:0/4099063430 >> 172.21.15.82:0/4099063430 conn(0x7f36580fd450 msgr2=0x7f36580ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 -- 172.21.15.82:0/4099063430 shutdown_connections 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.115+0000 7f365f600640 1 -- 172.21.15.82:0/4099063430 wait complete. 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.116+0000 7f365f600640 1 Processor -- start 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.116+0000 7f365f600640 1 -- start start 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 0x7f365819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658108ac0 0x7f36581a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f365810e8b0 con 0x7f3658103800 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f365810e730 con 0x7f3658106160 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365f600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f365810ea30 con 0x7f3658108ac0 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365cc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58356/0 (socket says 172.21.15.82:58356) 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658108ac0 0x7f36581a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f365cc00640 1 -- 172.21.15.82:0/979707947 learned_addr learned my addr 172.21.15.82:0/979707947 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.117+0000 7f3657e00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 0x7f365819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 -- 172.21.15.82:0/979707947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658108ac0 msgr2=0x7f36581a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658108ac0 0x7f36581a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 -- 172.21.15.82:0/979707947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 msgr2=0x7f365819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 0x7f365819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 -- 172.21.15.82:0/979707947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36581a31a0 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f365cc00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f364c00e9c0 tx=0x7f364c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.118+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c00cd80 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.119+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f364c0035f0 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.119+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c010690 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.119+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36581a3490 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.119+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36581a3a00 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.120+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365810a5e0 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.124+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f364c004000 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.126+0000 7f3655600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 0x7f36400b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.126+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f364c0e0a10 con 0x7f3658103800 2024-06-06T02:27:17.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.126+0000 7f3657e00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 0x7f36400b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.127+0000 7f3657e00640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 0x7f36400b4c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f365819c730 tx=0x7f36440090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.130+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f364c0aa400 con 0x7f3658103800 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.343+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f365802dd00 con 0x7f3658103800 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.349+0000 7f3655600640 1 -- 172.21.15.82:0/979707947 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f364c0a9d00 con 0x7f3658103800 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 msgr2=0x7f36400b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 0x7f36400b4c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f365819c730 tx=0x7f36440090e0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 msgr2=0x7f365819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f364c00e9c0 tx=0x7f364c00ee80 comp rx=0 tx=0).stop 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 shutdown_connections 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f36400b2760 0x7f36400b4c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3658108ac0 0x7f36581a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3658106160 0x7f365819bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 --2- 172.21.15.82:0/979707947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3658103800 0x7f365819b680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 >> 172.21.15.82:0/979707947 conn(0x7f36580fd450 msgr2=0x7f3658107830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:17.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.353+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 shutdown_connections 2024-06-06T02:27:17.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:15.354+0000 7f365f600640 1 -- 172.21.15.82:0/979707947 wait complete. 2024-06-06T02:27:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 -- 172.21.15.82:0/3491941169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0105fa0 msgr2=0x7f88f01063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 --2- 172.21.15.82:0/3491941169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0105fa0 0x7f88f01063b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f88dc009900 tx=0x7f88dc02a410 comp rx=0 tx=0).stop 2024-06-06T02:27:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 -- 172.21.15.82:0/3491941169 shutdown_connections 2024-06-06T02:27:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 --2- 172.21.15.82:0/3491941169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f01068f0 0x7f88f010d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 --2- 172.21.15.82:0/3491941169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0105fa0 0x7f88f01063b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 --2- 172.21.15.82:0/3491941169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f0104e70 0x7f88f0105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.339+0000 7f88f8200640 1 -- 172.21.15.82:0/3491941169 >> 172.21.15.82:0/3491941169 conn(0x7f88f01006e0 msgr2=0x7f88f0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.340+0000 7f88f8200640 1 -- 172.21.15.82:0/3491941169 shutdown_connections 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.340+0000 7f88f8200640 1 -- 172.21.15.82:0/3491941169 wait complete. 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.341+0000 7f88f8200640 1 Processor -- start 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.341+0000 7f88f8200640 1 -- start start 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 0x7f88f019b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 0x7f88f019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f01068f0 0x7f88f01a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110990 con 0x7f88f0105fa0 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110810 con 0x7f88f01068f0 2024-06-06T02:27:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f8200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0110b10 con 0x7f88f0104e70 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f4e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 0x7f88f019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f5800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 0x7f88f019b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f01068f0 0x7f88f01a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f4e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 0x7f88f019bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58394/0 (socket says 172.21.15.82:58394) 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.342+0000 7f88f4e00640 1 -- 172.21.15.82:0/2802792278 learned_addr learned my addr 172.21.15.82:0/2802792278 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 -- 172.21.15.82:0/2802792278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f01068f0 msgr2=0x7f88f01a2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f01068f0 0x7f88f01a2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 -- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 msgr2=0x7f88f019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 0x7f88f019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 -- 172.21.15.82:0/2802792278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f01a3090 con 0x7f88f0104e70 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f5800640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 0x7f88f019b570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e9c0 tx=0x7f88e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400ccc0 con 0x7f88f0104e70 2024-06-06T02:27:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.343+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f01a3380 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.344+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88e4005020 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.344+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4004a00 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.344+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f01a38c0 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.345+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f0105280 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.347+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f88e40051d0 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.349+0000 7f88ee000640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 0x7f88d80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.349+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f88e40e0500 con 0x7f88f0104e70 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.349+0000 7f88f4e00640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 0x7f88d80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.350+0000 7f88f4e00640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 0x7f88d80b4c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88dc031440 tx=0x7f88dc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.352+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88e40a9e50 con 0x7f88f0104e70 2024-06-06T02:27:17.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:17 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:17.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:17 smithi082 ceph-mon[31579]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.570+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f88f010c000 con 0x7f88f0104e70 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.577+0000 7f88ee000640 1 -- 172.21.15.82:0/2802792278 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v30)=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7f88e40a9750 con 0x7f88f0104e70 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 msgr2=0x7f88d80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 0x7f88d80b4c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88dc031440 tx=0x7f88dc0314a0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 msgr2=0x7f88f019b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 0x7f88f019b570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f88e400e9c0 tx=0x7f88e400ee80 comp rx=0 tx=0).stop 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 shutdown_connections 2024-06-06T02:27:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88f01068f0 0x7f88f01a2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f88f0105fa0 0x7f88f019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f88d80b2760 0x7f88d80b4c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 --2- 172.21.15.82:0/2802792278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88f0104e70 0x7f88f019b570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.580+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 >> 172.21.15.82:0/2802792278 conn(0x7f88f01006e0 msgr2=0x7f88f01091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.581+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 shutdown_connections 2024-06-06T02:27:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:16.581+0000 7f88f8200640 1 -- 172.21.15.82:0/2802792278 wait complete. 2024-06-06T02:27:17.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:17 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:17.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:17 smithi103 ceph-mon[36349]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:17.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:17 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:17.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:17 smithi184 ceph-mon[36922]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:19.546 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.547 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.547 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.547 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.547 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.547 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi082') 2024-06-06T02:27:19.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:19 smithi082 ceph-mon[31579]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:20.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:19 smithi103 ceph-mon[36349]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:20.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:19 smithi184 ceph-mon[36922]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:20.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 -- 172.21.15.82:0/2825460220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010ad10 msgr2=0x7f359010b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:20.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 --2- 172.21.15.82:0/2825460220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010ad10 0x7f359010b1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3588009ca0 tx=0x7f358802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 -- 172.21.15.82:0/2825460220 shutdown_connections 2024-06-06T02:27:20.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 --2- 172.21.15.82:0/2825460220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010ad10 0x7f359010b1d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 --2- 172.21.15.82:0/2825460220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359010a140 0x7f359010a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 --2- 172.21.15.82:0/2825460220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359006b5b0 0x7f3590109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 -- 172.21.15.82:0/2825460220 >> 172.21.15.82:0/2825460220 conn(0x7f3590070100 msgr2=0x7f35900725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:20.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 -- 172.21.15.82:0/2825460220 shutdown_connections 2024-06-06T02:27:20.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.155+0000 7f3598400640 1 -- 172.21.15.82:0/2825460220 wait complete. 2024-06-06T02:27:20.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 Processor -- start 2024-06-06T02:27:20.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 -- start start 2024-06-06T02:27:20.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 0x7f359010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:20.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:20.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359010ad10 0x7f359010d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:20.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3590115e90 con 0x7f359010a140 2024-06-06T02:27:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3590115d10 con 0x7f359006b5b0 2024-06-06T02:27:20.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.157+0000 7f3598400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3590116010 con 0x7f359010ad10 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58420/0 (socket says 172.21.15.82:58420) 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595000640 1 -- 172.21.15.82:0/2639425266 learned_addr learned my addr 172.21.15.82:0/2639425266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 0x7f359010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3596400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359010ad10 0x7f359010d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 -- 172.21.15.82:0/2639425266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359010ad10 msgr2=0x7f359010d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359010ad10 0x7f359010d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 -- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 msgr2=0x7f359010cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595a00640 1 -- 172.21.15.82:0/2639425266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359010d890 con 0x7f359006b5b0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.158+0000 7f3595000640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f3595a00640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 0x7f359010e570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f358400e9c0 tx=0x7f358400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358400ccc0 con 0x7f359006b5b0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35840108e0 con 0x7f359006b5b0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35901abc00 con 0x7f359006b5b0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35840187c0 con 0x7f359006b5b0 2024-06-06T02:27:20.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.159+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35901ac0b0 con 0x7f359006b5b0 2024-06-06T02:27:20.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.160+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35901ac280 con 0x7f359006b5b0 2024-06-06T02:27:20.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.163+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f3584010430 con 0x7f359006b5b0 2024-06-06T02:27:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.164+0000 7f358e000640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 0x7f35780b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.164+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f35840e08f0 con 0x7f359006b5b0 2024-06-06T02:27:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.164+0000 7f3595000640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 0x7f35780b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:20.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.165+0000 7f3595000640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 0x7f35780b4c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f359010df20 tx=0x7f357c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:20.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.166+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f35840a9bf0 con 0x7f359006b5b0 2024-06-06T02:27:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.380+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f35901ac450 con 0x7f359006b5b0 2024-06-06T02:27:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.387+0000 7f358e000640 1 -- 172.21.15.82:0/2639425266 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v31)=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f35840b22c0 con 0x7f359006b5b0 2024-06-06T02:27:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 msgr2=0x7f35780b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 0x7f35780b4c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f359010df20 tx=0x7f357c005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 msgr2=0x7f359010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 0x7f359010e570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f358400e9c0 tx=0x7f358400ee80 comp rx=0 tx=0).stop 2024-06-06T02:27:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 shutdown_connections 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35780b2760 0x7f35780b4c70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f359010ad10 0x7f359010d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f359010a140 0x7f359010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 --2- 172.21.15.82:0/2639425266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f359006b5b0 0x7f359010e570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 >> 172.21.15.82:0/2639425266 conn(0x7f3590070100 msgr2=0x7f3590071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.390+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 shutdown_connections 2024-06-06T02:27:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:20.391+0000 7f3598400640 1 -- 172.21.15.82:0/2639425266 wait complete. 2024-06-06T02:27:21.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-06-06T02:27:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:21 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' 2024-06-06T02:27:21.753 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:21 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' 2024-06-06T02:27:21.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:21 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 -- 172.21.15.82:0/1878146658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e8100c50 msgr2=0x7fc0e8101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 --2- 172.21.15.82:0/1878146658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e8100c50 0x7fc0e8101060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009930 tx=0x7fc0d402a440 comp rx=0 tx=0).stop 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 -- 172.21.15.82:0/1878146658 shutdown_connections 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 --2- 172.21.15.82:0/1878146658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e81015a0 0x7fc0e810b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 --2- 172.21.15.82:0/1878146658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e8100c50 0x7fc0e8101060 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 --2- 172.21.15.82:0/1878146658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 0x7fc0e8104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 -- 172.21.15.82:0/1878146658 >> 172.21.15.82:0/1878146658 conn(0x7fc0e80fcaf0 msgr2=0x7fc0e80fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:22.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.117+0000 7fc0edc00640 1 -- 172.21.15.82:0/1878146658 shutdown_connections 2024-06-06T02:27:22.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.118+0000 7fc0edc00640 1 -- 172.21.15.82:0/1878146658 wait complete. 2024-06-06T02:27:22.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 Processor -- start 2024-06-06T02:27:22.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 -- start start 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e8100c50 0x7fc0e81993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 0x7fc0e81a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810e7e0 con 0x7fc0e81015a0 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810e660 con 0x7fc0e8104200 2024-06-06T02:27:22.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0edc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e810e960 con 0x7fc0e8100c50 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.119+0000 7fc0e6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49022/0 (socket says 172.21.15.82:49022) 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e8100c50 0x7fc0e81993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 -- 172.21.15.82:0/2946398498 learned_addr learned my addr 172.21.15.82:0/2946398498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e7400640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 0x7fc0e81a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:22.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 -- 172.21.15.82:0/2946398498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e8100c50 msgr2=0x7fc0e81993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:22.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e8100c50 0x7fc0e81993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 -- 172.21.15.82:0/2946398498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 msgr2=0x7fc0e81a08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:22.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 0x7fc0e81a08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 -- 172.21.15.82:0/2946398498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e81a0ee0 con 0x7fc0e81015a0 2024-06-06T02:27:22.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.120+0000 7fc0e6000640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4031440 tx=0x7fc0d4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.121+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d403f070 con 0x7fc0e81015a0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.121+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0d4031c50 con 0x7fc0e81015a0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.121+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e81a1170 con 0x7fc0e81015a0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.121+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4035030 con 0x7fc0e81015a0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.121+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e81a16a0 con 0x7fc0e81015a0 2024-06-06T02:27:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.122+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e8109fd0 con 0x7fc0e81015a0 2024-06-06T02:27:22.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.125+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fc0d4042070 con 0x7fc0e81015a0 2024-06-06T02:27:22.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.126+0000 7fc0df400640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 0x7fc0cc0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:22.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.127+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc0d4101460 con 0x7fc0e81015a0 2024-06-06T02:27:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.127+0000 7fc0e6a00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 0x7fc0cc0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:22.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.128+0000 7fc0e6a00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 0x7fc0cc0b4cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0e806ad70 tx=0x7fc0d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.128+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc0d40ca760 con 0x7fc0e81015a0 2024-06-06T02:27:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.336+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fc0e802dd00 con 0x7fc0e81015a0 2024-06-06T02:27:22.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.343+0000 7fc0df400640 1 -- 172.21.15.82:0/2946398498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7fc0d40cea60 con 0x7fc0e81015a0 2024-06-06T02:27:22.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.345+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 msgr2=0x7fc0cc0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:22.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.345+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 0x7fc0cc0b4cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0e806ad70 tx=0x7fc0d8005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:22.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.345+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 msgr2=0x7fc0e8199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:22.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.345+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4031440 tx=0x7fc0d4003c10 comp rx=0 tx=0).stop 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 shutdown_connections 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0e8104200 0x7fc0e81a08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0e81015a0 0x7fc0e8199900 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0cc0b27e0 0x7fc0cc0b4cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 --2- 172.21.15.82:0/2946398498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0e8100c50 0x7fc0e81993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 >> 172.21.15.82:0/2946398498 conn(0x7fc0e80fcaf0 msgr2=0x7fc0e81071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 shutdown_connections 2024-06-06T02:27:22.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:22.346+0000 7fc0edc00640 1 -- 172.21.15.82:0/2946398498 wait complete. 2024-06-06T02:27:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:22 smithi082 ceph-mon[31579]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:22 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2946398498' entity='client.admin' 2024-06-06T02:27:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:22 smithi103 ceph-mon[36349]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:22 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2946398498' entity='client.admin' 2024-06-06T02:27:22.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:22 smithi184 ceph-mon[36922]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:22.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:22 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2946398498' entity='client.admin' 2024-06-06T02:27:23.084 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.084 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_down_mkfs_grace', '300'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.085 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'b8ccb8a2-23ab-11ef-bc9b-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi082') 2024-06-06T02:27:23.086 INFO:tasks.cephadm:Deploying OSDs... 2024-06-06T02:27:23.086 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:27:23.086 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T02:27:23.141 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T02:27:23.141 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-06-06T02:27:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T02:27:23.190 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-06 02:25:29.682907172 +0000 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-06 02:20:22.018315590 +0000 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-06 02:20:22.018315590 +0000 2024-06-06T02:27:23.191 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-06 02:20:22.018315590 +0000 2024-06-06T02:27:23.191 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T02:27:23.266 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-06T02:27:23.266 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-06T02:27:23.266 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000351747 s, 1.5 MB/s 2024-06-06T02:27:23.270 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T02:27:23.326 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-06 02:25:29.755905828 +0000 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-06 02:20:22.605304810 +0000 2024-06-06T02:27:23.375 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-06 02:20:22.605304810 +0000 2024-06-06T02:27:23.376 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-06 02:20:22.605304810 +0000 2024-06-06T02:27:23.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T02:27:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-06T02:27:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-06T02:27:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000313817 s, 1.6 MB/s 2024-06-06T02:27:23.450 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T02:27:23.500 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-06-06T02:27:23.548 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T02:27:23.548 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:23.548 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-06 02:25:29.833904393 +0000 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-06 02:20:23.197293939 +0000 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-06 02:20:23.197293939 +0000 2024-06-06T02:27:23.549 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-06 02:20:23.197293939 +0000 2024-06-06T02:27:23.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T02:27:23.625 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-06T02:27:23.625 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-06T02:27:23.625 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000349366 s, 1.5 MB/s 2024-06-06T02:27:23.630 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T02:27:23.686 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-06 02:25:29.918902829 +0000 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-06 02:20:23.783283177 +0000 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-06 02:20:23.783283177 +0000 2024-06-06T02:27:23.733 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-06 02:20:23.783283177 +0000 2024-06-06T02:27:23.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T02:27:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-06-06T02:27:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-06-06T02:27:23.858 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000438119 s, 1.2 MB/s 2024-06-06T02:27:23.862 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T02:27:23.916 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-06-06T02:27:23.916 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T02:27:23.936 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T02:27:23.936 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-06-06T02:27:23.993 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T02:27:23.993 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:23.993 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-06-06T02:27:23.993 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:23.994 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:23.994 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-06-06 02:26:34.168046446 +0000 2024-06-06T02:27:23.994 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-06-06 02:18:47.097929812 +0000 2024-06-06T02:27:23.994 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-06-06 02:18:47.097929812 +0000 2024-06-06T02:27:23.994 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-06-06 02:18:47.097929812 +0000 2024-06-06T02:27:23.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T02:27:24.062 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-06-06T02:27:24.062 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-06-06T02:27:24.063 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000241647 s, 2.1 MB/s 2024-06-06T02:27:24.064 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T02:27:24.122 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-06-06T02:27:24.179 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T02:27:24.179 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:24.179 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-06-06T02:27:24.179 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:24.179 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:24.180 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-06-06 02:26:34.168046446 +0000 2024-06-06T02:27:24.180 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-06-06 02:18:47.415923860 +0000 2024-06-06T02:27:24.180 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-06-06 02:18:47.415923860 +0000 2024-06-06T02:27:24.180 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-06-06 02:18:47.415923860 +0000 2024-06-06T02:27:24.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T02:27:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-06-06T02:27:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-06-06T02:27:24.245 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000288934 s, 1.8 MB/s 2024-06-06T02:27:24.247 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T02:27:24.304 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-06-06T02:27:24.359 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T02:27:24.359 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:24.359 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-06-06T02:27:24.359 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:24.360 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:24.360 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-06-06 02:26:34.168046446 +0000 2024-06-06T02:27:24.360 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-06-06 02:18:47.734917889 +0000 2024-06-06T02:27:24.360 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-06-06 02:18:47.734917889 +0000 2024-06-06T02:27:24.360 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-06-06 02:18:47.734917889 +0000 2024-06-06T02:27:24.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T02:27:24.423 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-06-06T02:27:24.423 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-06-06T02:27:24.423 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000246261 s, 2.1 MB/s 2024-06-06T02:27:24.424 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T02:27:24.481 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-06-06 02:26:34.169046427 +0000 2024-06-06T02:27:24.537 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-06-06 02:18:48.065911693 +0000 2024-06-06T02:27:24.538 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-06-06 02:18:48.065911693 +0000 2024-06-06T02:27:24.538 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-06-06 02:18:48.065911693 +0000 2024-06-06T02:27:24.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T02:27:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-06-06T02:27:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-06-06T02:27:24.600 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000304041 s, 1.7 MB/s 2024-06-06T02:27:24.602 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T02:27:24.658 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-06-06T02:27:24.658 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-06-06T02:27:24.677 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-06T02:27:24.677 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-06-06T02:27:24.734 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-06T02:27:24.734 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:24.734 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-06-06T02:27:24.734 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:24.735 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:24.735 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-06 02:26:31.803096050 +0000 2024-06-06T02:27:24.735 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-06 02:18:47.138018927 +0000 2024-06-06T02:27:24.735 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-06 02:18:47.138018927 +0000 2024-06-06T02:27:24.735 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-06 02:18:47.138018927 +0000 2024-06-06T02:27:24.735 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-06T02:27:24.799 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:24 smithi184 ceph-mon[36922]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:24.802 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-06T02:27:24.802 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-06T02:27:24.802 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00027722 s, 1.8 MB/s 2024-06-06T02:27:24.804 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-06T02:27:24.862 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-06-06T02:27:24.866 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:24 smithi103 ceph-mon[36349]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:24 smithi082 ceph-mon[31579]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:24.920 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-06 02:26:31.803096050 +0000 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-06 02:18:47.470012259 +0000 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-06 02:18:47.470012259 +0000 2024-06-06T02:27:25.059 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-06 02:18:47.470012259 +0000 2024-06-06T02:27:25.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-06T02:27:25.085 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-06T02:27:25.085 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-06T02:27:25.086 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000229501 s, 2.2 MB/s 2024-06-06T02:27:25.087 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-06T02:27:25.144 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-06 02:26:31.804096030 +0000 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-06 02:18:47.790005833 +0000 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-06 02:18:47.790005833 +0000 2024-06-06T02:27:25.200 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-06 02:18:47.790005833 +0000 2024-06-06T02:27:25.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-06T02:27:25.265 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-06T02:27:25.265 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-06T02:27:25.265 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000208522 s, 2.5 MB/s 2024-06-06T02:27:25.266 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-06T02:27:25.322 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-06-06T02:27:25.378 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-06-06 02:26:31.804096030 +0000 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-06-06 02:18:48.114999306 +0000 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-06-06 02:18:48.114999306 +0000 2024-06-06T02:27:25.379 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-06-06 02:18:48.114999306 +0000 2024-06-06T02:27:25.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-06T02:27:25.442 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-06-06T02:27:25.443 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-06-06T02:27:25.443 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000224567 s, 2.3 MB/s 2024-06-06T02:27:25.444 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-06T02:27:25.500 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-06-06T02:27:25.500 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T02:27:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:27:26.799 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:26 smithi184 ceph-mon[36922]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:26.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:26 smithi082 ceph-mon[31579]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:26 smithi103 ceph-mon[36349]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:28.193 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T02:27:28.398 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T02:27:28.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:28 smithi082 ceph-mon[31579]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:28.447 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-06-06T02:27:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-06-06T02:27:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0363965 s, 288 MB/s 2024-06-06T02:27:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-06-06T02:27:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:28 smithi103 ceph-mon[36349]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:28.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:28 smithi184 ceph-mon[36922]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:29.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-06-06T02:27:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:27:30.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:30 smithi082 ceph-mon[31579]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:30 smithi103 ceph-mon[36349]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:30 smithi184 ceph-mon[36922]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 -- 172.21.15.82:0/237322325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 msgr2=0x7fbeec1050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:31.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 --2- 172.21.15.82:0/237322325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec1050a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009900 tx=0x7fbedc02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 -- 172.21.15.82:0/237322325 shutdown_connections 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 --2- 172.21.15.82:0/237322325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec106710 0x7fbeec10d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 --2- 172.21.15.82:0/237322325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec105dc0 0x7fbeec1061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 --2- 172.21.15.82:0/237322325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec1050a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 -- 172.21.15.82:0/237322325 >> 172.21.15.82:0/237322325 conn(0x7fbeec100500 msgr2=0x7fbeec102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 -- 172.21.15.82:0/237322325 shutdown_connections 2024-06-06T02:27:31.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.625+0000 7fbeebe00640 1 -- 172.21.15.82:0/237322325 wait complete. 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.626+0000 7fbeebe00640 1 Processor -- start 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 -- start start 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 0x7fbeec19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 0x7fbeec1a2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec1107e0 con 0x7fbeec104c90 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec110660 con 0x7fbeec106710 2024-06-06T02:27:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeebe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbeec110960 con 0x7fbeec105dc0 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeeaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeeaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49038/0 (socket says 172.21.15.82:49038) 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeeaa00640 1 -- 172.21.15.82:0/97176835 learned_addr learned my addr 172.21.15.82:0/97176835 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbee2000640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 0x7fbeec19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.627+0000 7fbeeb400640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 0x7fbeec1a2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 -- 172.21.15.82:0/97176835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 msgr2=0x7fbeec19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 0x7fbeec19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 -- 172.21.15.82:0/97176835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 msgr2=0x7fbeec1a2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 0x7fbeec1a2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 -- 172.21.15.82:0/97176835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec1a2e90 con 0x7fbeec104c90 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbee2000640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 0x7fbeec19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeb400640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 0x7fbeec1a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:27:31.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.628+0000 7fbeeaa00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbedc031440 tx=0x7fbedc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.629+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc03f070 con 0x7fbeec104c90 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.629+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbedc031c50 con 0x7fbeec104c90 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.629+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec1a3120 con 0x7fbeec104c90 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.629+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc035030 con 0x7fbeec104c90 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.629+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeec1a3650 con 0x7fbeec104c90 2024-06-06T02:27:31.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.630+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec10be90 con 0x7fbeec104c90 2024-06-06T02:27:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.632+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fbedc042070 con 0x7fbeec104c90 2024-06-06T02:27:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.634+0000 7fbef0a00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 0x7fbed00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:27:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.634+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbedc101430 con 0x7fbeec104c90 2024-06-06T02:27:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.634+0000 7fbee2000640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 0x7fbed00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:27:31.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.635+0000 7fbee2000640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 0x7fbed00b4d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeec19c420 tx=0x7fbed4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:27:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.636+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbedc0ca730 con 0x7fbeec104c90 2024-06-06T02:27:31.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:31.849+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbeec062ba0 con 0x7fbed00b2860 2024-06-06T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:32 smithi082 ceph-mon[31579]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:27:32.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:32 smithi103 ceph-mon[36349]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:27:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:27:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:32 smithi184 ceph-mon[36922]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:27:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:27:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:33.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:33 smithi082 ceph-mon[31579]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:27:33.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:33 smithi103 ceph-mon[36349]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:27:33.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:33 smithi184 ceph-mon[36922]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:27:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:34 smithi082 ceph-mon[31579]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:34 smithi103 ceph-mon[36349]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:34.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:34 smithi184 ceph-mon[36922]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]: dispatch 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]': finished 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:36 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3769444046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]: dispatch 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]': finished 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:36 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3769444046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:27:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]: dispatch 2024-06-06T02:27:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3732298297' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "924068dd-3df9-4f5e-8793-d853e41803ca"}]': finished 2024-06-06T02:27:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: osdmap e5: 1 total, 0 up, 1 in 2024-06-06T02:27:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:36 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3769444046' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:27:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:38 smithi103 ceph-mon[36349]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:38 smithi082 ceph-mon[31579]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:38.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:38 smithi184 ceph-mon[36922]: pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:39.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:39 smithi082 ceph-mon[31579]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:39.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:39 smithi103 ceph-mon[36349]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:39.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:39 smithi184 ceph-mon[36922]: pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:41.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:41 smithi082 ceph-mon[31579]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:41 smithi103 ceph-mon[36349]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:41 smithi184 ceph-mon[36922]: pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:43.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:43 smithi082 ceph-mon[31579]: pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:44.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:43 smithi103 ceph-mon[36349]: pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:44.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:43 smithi184 ceph-mon[36922]: pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:44.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T02:27:44.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:44.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:44 smithi082 ceph-mon[31579]: Deploying daemon osd.0 on smithi082 2024-06-06T02:27:45.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T02:27:45.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:45.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:44 smithi103 ceph-mon[36349]: Deploying daemon osd.0 on smithi082 2024-06-06T02:27:45.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-06T02:27:45.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:45.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:44 smithi184 ceph-mon[36922]: Deploying daemon osd.0 on smithi082 2024-06-06T02:27:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:45 smithi082 ceph-mon[31579]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:46.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:45 smithi103 ceph-mon[36349]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:45 smithi184 ceph-mon[36922]: pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:46.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:48.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:47 smithi082 ceph-mon[31579]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:48.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:48.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:48.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:47 smithi103 ceph-mon[36349]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:47 smithi184 ceph-mon[36922]: pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:49.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:49 smithi082 ceph-mon[31579]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:50.116 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:49 smithi103 ceph-mon[36349]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:50.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:49 smithi184 ceph-mon[36922]: pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:51.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:51 smithi082 ceph-mon[31579]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:52.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:51 smithi103 ceph-mon[36349]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:52.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:51 smithi184 ceph-mon[36922]: pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:53.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:53.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:53 smithi082 ceph-mon[31579]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:53 smithi103 ceph-mon[36349]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:53 smithi184 ceph-mon[36922]: pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:56.851 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:27:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:27:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.337+0000 7fbef0a00640 1 -- 172.21.15.82:0/97176835 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbeec062ba0 con 0x7fbed00b2860 2024-06-06T02:27:57.337 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-06-06T02:27:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.340+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 msgr2=0x7fbed00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.340+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 0x7fbed00b4d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbeec19c420 tx=0x7fbed4005f90 comp rx=0 tx=0).stop 2024-06-06T02:27:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 msgr2=0x7fbeec19b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:27:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbedc031440 tx=0x7fbedc003c10 comp rx=0 tx=0).stop 2024-06-06T02:27:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 shutdown_connections 2024-06-06T02:27:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeec106710 0x7fbeec1a2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbed00b2860 0x7fbed00b4d70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbeec105dc0 0x7fbeec19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 --2- 172.21.15.82:0/97176835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec104c90 0x7fbeec19b370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 >> 172.21.15.82:0/97176835 conn(0x7fbeec100500 msgr2=0x7fbeec109060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 shutdown_connections 2024-06-06T02:27:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:27:57.341+0000 7fbeebe00640 1 -- 172.21.15.82:0/97176835 wait complete. 2024-06-06T02:27:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:57 smithi082 ceph-mon[31579]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:57 smithi082 ceph-mon[31579]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:57 smithi103 ceph-mon[36349]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:57 smithi103 ceph-mon[36349]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:57 smithi184 ceph-mon[36922]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:57 smithi184 ceph-mon[36922]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-06T02:27:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:27:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:27:58.134 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.0.service 2024-06-06T02:27:58.140 INFO:tasks.cephadm:Deploying osd.1 on smithi103 with /dev/vg_nvme/lv_4... 2024-06-06T02:27:58.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T02:27:58.381 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:27:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T02:27:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T02:27:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:58 smithi082 ceph-mon[31579]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:58.709 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:58.709 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T02:27:58.709 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T02:27:58.710 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:58.710 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:58.710 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:58 smithi103 ceph-mon[36349]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:27:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-06T02:27:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: osdmap e6: 1 total, 0 up, 1 in 2024-06-06T02:27:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: from='osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:58.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:58 smithi184 ceph-mon[36922]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:27:59.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0[49764]: 2024-06-06T02:27:59.052+0000 7fc416600640 -1 osd.0 0 waiting for initial osdmap 2024-06-06T02:27:59.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0[49764]: 2024-06-06T02:27:59.069+0000 7fc40c600640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:27:59.611 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:59 smithi103 ceph-mon[36349]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:27:59.611 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:59 smithi103 ceph-mon[36349]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T02:27:59.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:27:59 smithi103 ceph-mon[36349]: from='osd.0 ' entity='osd.0' 2024-06-06T02:27:59.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-mon[31579]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:27:59.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-mon[31579]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T02:27:59.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.812 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:27:59 smithi082 ceph-mon[31579]: from='osd.0 ' entity='osd.0' 2024-06-06T02:27:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:59 smithi184 ceph-mon[36922]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:27:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:59 smithi184 ceph-mon[36922]: osdmap e7: 1 total, 0 up, 1 in 2024-06-06T02:27:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:27:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:27:59 smithi184 ceph-mon[36922]: from='osd.0 ' entity='osd.0' 2024-06-06T02:27:59.967 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T02:28:00.071 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T02:28:00.084 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-06-06T02:28:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-06-06T02:28:00.084 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011309 s, 927 MB/s 2024-06-06T02:28:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-06-06T02:28:00.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-06-06T02:28:00.694 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:28:00.694 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:28:00.695 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:28:00.695 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.695 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] boot 2024-06-06T02:28:00.695 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T02:28:00.695 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] boot 2024-06-06T02:28:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T02:28:00.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: osd.0 [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] boot 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: osdmap e8: 1 total, 1 up, 1 in 2024-06-06T02:28:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-06T02:28:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:28:01.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:01 smithi103 ceph-mon[36349]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:01.723 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:01 smithi082 ceph-mon[31579]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:01.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:01 smithi184 ceph-mon[36922]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 -- 172.21.15.103:0/1914251988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc103680 msgr2=0x7f18cc109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 --2- 172.21.15.103:0/1914251988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc103680 0x7f18cc109f80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009ca0 tx=0x7f18c402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 -- 172.21.15.103:0/1914251988 shutdown_connections 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 --2- 172.21.15.103:0/1914251988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc103680 0x7f18cc109f80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 --2- 172.21.15.103:0/1914251988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc102d30 0x7f18cc103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 --2- 172.21.15.103:0/1914251988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc101c00 0x7f18cc102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 -- 172.21.15.103:0/1914251988 >> 172.21.15.103:0/1914251988 conn(0x7f18cc0fd450 msgr2=0x7f18cc0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 -- 172.21.15.103:0/1914251988 shutdown_connections 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.463+0000 7f18d343b640 1 -- 172.21.15.103:0/1914251988 wait complete. 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 Processor -- start 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 -- start start 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc102d30 0x7f18cc104070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc103680 0x7f18cc1045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc10d7d0 con 0x7f18cc102d30 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc10d650 con 0x7f18cc101c00 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d343b640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc10d950 con 0x7f18cc103680 2024-06-06T02:28:02.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d11d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.464+0000 7f18d11d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36148/0 (socket says 172.21.15.103:36148) 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 -- 172.21.15.103:0/1286707054 learned_addr learned my addr 172.21.15.103:0/1286707054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d19d8640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc103680 0x7f18cc1045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 -- 172.21.15.103:0/1286707054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc103680 msgr2=0x7f18cc1045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc103680 0x7f18cc1045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 -- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc102d30 msgr2=0x7f18cc104070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d09d6640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc102d30 0x7f18cc104070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc102d30 0x7f18cc104070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 -- 172.21.15.103:0/1286707054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc104ce0 con 0x7f18cc101c00 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d11d7640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b450 tx=0x7f18c800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:02.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8015020 con 0x7f18cc101c00 2024-06-06T02:28:02.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc1a3530 con 0x7f18cc101c00 2024-06-06T02:28:02.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18c8011d40 con 0x7f18cc101c00 2024-06-06T02:28:02.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c800f340 con 0x7f18cc101c00 2024-06-06T02:28:02.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.465+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1a3a10 con 0x7f18cc101c00 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.466+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc1a3cd0 con 0x7f18cc101c00 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.468+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f18c8018020 con 0x7f18cc101c00 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.468+0000 7f18c27fc640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 0x7f18b80b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.468+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f18c80e0870 con 0x7f18cc101c00 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.469+0000 7f18d09d6640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 0x7f18b80b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:02.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.470+0000 7f18d09d6640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 0x7f18b80b4c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005fd0 tx=0x7f18bc005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:02.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.472+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f18c801f020 con 0x7f18cc101c00 2024-06-06T02:28:02.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:02 smithi103 ceph-mon[36349]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T02:28:02.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:02.665+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f18cc0ff520 con 0x7f18b80b2760 2024-06-06T02:28:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:02 smithi082 ceph-mon[31579]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T02:28:02.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:02 smithi184 ceph-mon[36922]: osdmap e9: 1 total, 1 up, 1 in 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi082 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi082 to 17089M 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:03.726 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:03.727 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:03.727 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:03.727 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi082 2024-06-06T02:28:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi082 to 17089M 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:03.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi082 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi082 to 17089M 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:03.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/1304502175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]': finished 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T02:28:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:05.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:05 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/4247658211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/1304502175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]': finished 2024-06-06T02:28:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T02:28:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:06.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:05 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/4247658211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/1304502175' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]: dispatch 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2cba94c6-c648-4beb-a92a-51cc809abb4b"}]': finished 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: osdmap e10: 2 total, 1 up, 2 in 2024-06-06T02:28:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:06.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:05 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/4247658211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:07 smithi103 ceph-mon[36349]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:07 smithi082 ceph-mon[31579]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:08.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:07 smithi184 ceph-mon[36922]: pgmap v86: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:09.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:09 smithi103 ceph-mon[36349]: pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:09 smithi082 ceph-mon[31579]: pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:10.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:09 smithi184 ceph-mon[36922]: pgmap v87: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:11 smithi103 ceph-mon[36349]: pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:12.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:11 smithi082 ceph-mon[31579]: pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:11 smithi184 ceph-mon[36922]: pgmap v88: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:13.111 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T02:28:13.111 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:13.111 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:12 smithi103 ceph-mon[36349]: Deploying daemon osd.1 on smithi103 2024-06-06T02:28:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T02:28:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:13.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:12 smithi082 ceph-mon[31579]: Deploying daemon osd.1 on smithi103 2024-06-06T02:28:13.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-06T02:28:13.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:13.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:12 smithi184 ceph-mon[36922]: Deploying daemon osd.1 on smithi103 2024-06-06T02:28:14.046 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:13 smithi103 ceph-mon[36349]: pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:13 smithi082 ceph-mon[31579]: pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:14.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:13 smithi184 ceph-mon[36922]: pgmap v89: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:16.075 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:15 smithi103 ceph-mon[36349]: pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:16.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:15 smithi082 ceph-mon[31579]: pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:15 smithi184 ceph-mon[36922]: pgmap v90: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:17.082 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:17.083 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:17.083 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:18.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:17 smithi103 ceph-mon[36349]: pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:17 smithi082 ceph-mon[31579]: pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:17 smithi184 ceph-mon[36922]: pgmap v91: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:19.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.994+0000 7f18c27fc640 1 -- 172.21.15.103:0/1286707054 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f18cc0ff520 con 0x7f18b80b2760 2024-06-06T02:28:19.994 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 1 on host 'smithi103' 2024-06-06T02:28:19.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 msgr2=0x7f18b80b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:19.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 0x7f18b80b4c70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f18bc005fd0 tx=0x7f18bc005c70 comp rx=0 tx=0).stop 2024-06-06T02:28:19.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 msgr2=0x7f18cc1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:19.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b450 tx=0x7f18c800b910 comp rx=0 tx=0).stop 2024-06-06T02:28:19.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 shutdown_connections 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f18b80b2760 0x7f18b80b4c70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc103680 0x7f18cc1045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18cc102d30 0x7f18cc104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 --2- 172.21.15.103:0/1286707054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18cc101c00 0x7f18cc1059c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 >> 172.21.15.103:0/1286707054 conn(0x7f18cc0fd450 msgr2=0x7f18cc0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 shutdown_connections 2024-06-06T02:28:19.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:28:19.996+0000 7f18d343b640 1 -- 172.21.15.103:0/1286707054 wait complete. 2024-06-06T02:28:20.288 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.555 DEBUG:teuthology.orchestra.run.smithi103:osd.1> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.1.service 2024-06-06T02:28:20.597 INFO:tasks.cephadm:Deploying osd.2 on smithi184 with /dev/vg_nvme/lv_4... 2024-06-06T02:28:20.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-06T02:28:20.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:20.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.622 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: pgmap v92: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:20.622 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:20.834 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:28:21.222 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:21 smithi184 ceph-mon[36922]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:21.223 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:21 smithi184 ceph-mon[36922]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:21.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:21 smithi103 ceph-mon[36349]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:21.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:21 smithi103 ceph-mon[36349]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:21 smithi082 ceph-mon[31579]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:21 smithi082 ceph-mon[31579]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-06T02:28:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T02:28:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T02:28:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:22.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-mon[36349]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T02:28:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T02:28:22.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:22.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:22 smithi184 ceph-mon[36922]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.479 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-06T02:28:22.562 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-06T02:28:22.575 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-06-06T02:28:22.575 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-06-06T02:28:22.575 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113128 s, 927 MB/s 2024-06-06T02:28:22.575 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-06-06T02:28:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: pgmap v93: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-06T02:28:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: from='osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: osdmap e11: 2 total, 1 up, 2 in 2024-06-06T02:28:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:22 smithi082 ceph-mon[31579]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:28:22.993 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1[41015]: 2024-06-06T02:28:22.639+0000 7f4b87b89640 -1 osd.1 0 waiting for initial osdmap 2024-06-06T02:28:22.993 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:22 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1[41015]: 2024-06-06T02:28:22.645+0000 7f4b7f170640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:28:23.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-06-06T02:28:23.310 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:23 smithi103 ceph-mon[36349]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:28:23.311 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:23 smithi103 ceph-mon[36349]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T02:28:23.311 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.311 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.311 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:23 smithi103 ceph-mon[36349]: from='osd.1 ' entity='osd.1' 2024-06-06T02:28:23.448 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:23 smithi184 ceph-mon[36922]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:28:23.448 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:23 smithi184 ceph-mon[36922]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T02:28:23.448 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.448 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.449 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:23 smithi184 ceph-mon[36922]: from='osd.1 ' entity='osd.1' 2024-06-06T02:28:23.457 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:28:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:23 smithi082 ceph-mon[31579]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:28:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:23 smithi082 ceph-mon[31579]: osdmap e12: 2 total, 1 up, 2 in 2024-06-06T02:28:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:23 smithi082 ceph-mon[31579]: from='osd.1 ' entity='osd.1' 2024-06-06T02:28:24.480 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:28:24.480 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:28:24.480 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi103 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi103 to 17088M 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] boot 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T02:28:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi103 2024-06-06T02:28:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi103 to 17088M 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] boot 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T02:28:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:28:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:28:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: pgmap v96: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi103 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi103 to 17088M 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: osd.1 [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] boot 2024-06-06T02:28:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: osdmap e13: 2 total, 2 up, 2 in 2024-06-06T02:28:24.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-06T02:28:24.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 -- 172.21.15.184:0/427593372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a301046e0 msgr2=0x7f5a3010afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:24.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 --2- 172.21.15.184:0/427593372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a301046e0 0x7f5a3010afe0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009ca0 tx=0x7f5a2802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 -- 172.21.15.184:0/427593372 shutdown_connections 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 --2- 172.21.15.184:0/427593372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a301046e0 0x7f5a3010afe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 --2- 172.21.15.184:0/427593372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 0x7f5a301041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 --2- 172.21.15.184:0/427593372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a30102c60 0x7f5a30103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 -- 172.21.15.184:0/427593372 >> 172.21.15.184:0/427593372 conn(0x7f5a300fe490 msgr2=0x7f5a30100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 -- 172.21.15.184:0/427593372 shutdown_connections 2024-06-06T02:28:24.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.951+0000 7f5a37086640 1 -- 172.21.15.184:0/427593372 wait complete. 2024-06-06T02:28:24.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 Processor -- start 2024-06-06T02:28:24.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 -- start start 2024-06-06T02:28:24.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:24.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 0x7f5a30199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:24.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301046e0 0x7f5a301a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3010e800 con 0x7f5a301046e0 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3010e680 con 0x7f5a30103d90 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a37086640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3010e980 con 0x7f5a30102c60 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a34e22640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a34e22640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:57148/0 (socket says 172.21.15.184:57148) 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a34e22640 1 -- 172.21.15.184:0/182297250 learned_addr learned my addr 172.21.15.184:0/182297250 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.952+0000 7f5a2ffff640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 0x7f5a30199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 -- 172.21.15.184:0/182297250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 msgr2=0x7f5a30199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 0x7f5a30199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 -- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301046e0 msgr2=0x7f5a301a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301046e0 0x7f5a301a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 -- 172.21.15.184:0/182297250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a301a0f70 con 0x7f5a30102c60 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a34e22640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000b450 tx=0x7f5a2000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:24.954 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20015020 con 0x7f5a30102c60 2024-06-06T02:28:24.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a20011d40 con 0x7f5a30102c60 2024-06-06T02:28:24.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2000f340 con 0x7f5a30102c60 2024-06-06T02:28:24.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a301a1260 con 0x7f5a30102c60 2024-06-06T02:28:24.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.953+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a17a0 con 0x7f5a30102c60 2024-06-06T02:28:24.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.954+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a30109df0 con 0x7f5a30102c60 2024-06-06T02:28:24.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.955+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f5a20018020 con 0x7f5a30102c60 2024-06-06T02:28:24.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.956+0000 7f5a2dffb640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 0x7f5a180b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:24.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.956+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f5a200e0410 con 0x7f5a30102c60 2024-06-06T02:28:24.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.957+0000 7f5a2ffff640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 0x7f5a180b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:24.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.958+0000 7f5a2ffff640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 0x7f5a180b4c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a3019a500 tx=0x7f5a2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:24.960 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:24.961+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5a2001f020 con 0x7f5a30102c60 2024-06-06T02:28:25.148 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:25.149+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5a30062ba0 con 0x7f5a180b2760 2024-06-06T02:28:25.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:25.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:25.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:25.571 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:25.571 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:25.571 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:25.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:25.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:25.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:26.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:26 smithi082 ceph-mon[31579]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:26.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:26 smithi082 ceph-mon[31579]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:26.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:26 smithi082 ceph-mon[31579]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T02:28:26.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:26 smithi184 ceph-mon[36922]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:26.574 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:26 smithi184 ceph-mon[36922]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:26.574 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:26 smithi184 ceph-mon[36922]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T02:28:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:26 smithi103 ceph-mon[36349]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:26 smithi103 ceph-mon[36349]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:26 smithi103 ceph-mon[36349]: osdmap e14: 2 total, 2 up, 2 in 2024-06-06T02:28:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/2765110822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]': finished 2024-06-06T02:28:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T02:28:28.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:28.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:28 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/1367591103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/2765110822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]': finished 2024-06-06T02:28:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T02:28:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:28 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/1367591103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/2765110822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]: dispatch 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "79f93c60-64fb-4787-9060-e630dc82b86a"}]': finished 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: osdmap e15: 3 total, 2 up, 3 in 2024-06-06T02:28:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:28 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/1367591103' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:30 smithi103 ceph-mon[36349]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:30.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:30 smithi082 ceph-mon[31579]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:30.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:30 smithi184 ceph-mon[36922]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:32.326 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:32 smithi184 ceph-mon[36922]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:32 smithi103 ceph-mon[36349]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:32.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:32 smithi082 ceph-mon[31579]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:34 smithi184 ceph-mon[36922]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T02:28:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:34 smithi103 ceph-mon[36349]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T02:28:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:34 smithi082 ceph-mon[31579]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-06T02:28:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:35.596 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:35 smithi184 ceph-mon[36922]: Deploying daemon osd.2 on smithi184 2024-06-06T02:28:35.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:35 smithi103 ceph-mon[36349]: Deploying daemon osd.2 on smithi184 2024-06-06T02:28:35.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:35 smithi082 ceph-mon[31579]: Deploying daemon osd.2 on smithi184 2024-06-06T02:28:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:36 smithi184 ceph-mon[36922]: pgmap v105: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:36 smithi103 ceph-mon[36349]: pgmap v105: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:36 smithi082 ceph-mon[31579]: pgmap v105: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:38 smithi103 ceph-mon[36349]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:38.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:38 smithi082 ceph-mon[31579]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:38 smithi184 ceph-mon[36922]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:39.549 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:39.549 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:39.549 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:39.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:40.563 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:40 smithi184 ceph-mon[36922]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:40.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:40 smithi103 ceph-mon[36349]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:40 smithi082 ceph-mon[31579]: pgmap v107: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:42.351 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: pgmap v108: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:42.351 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.351 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.351 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:42.352 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:42.352 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.409+0000 7f5a2dffb640 1 -- 172.21.15.184:0/182297250 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5a30062ba0 con 0x7f5a180b2760 2024-06-06T02:28:42.409 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 2 on host 'smithi184' 2024-06-06T02:28:42.411 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 msgr2=0x7f5a180b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:42.411 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 0x7f5a180b4c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a3019a500 tx=0x7f5a2400b390 comp rx=0 tx=0).stop 2024-06-06T02:28:42.411 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 msgr2=0x7f5a30199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:42.411 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5a2000b450 tx=0x7f5a2000b910 comp rx=0 tx=0).stop 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 shutdown_connections 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a301046e0 0x7f5a301a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a30103d90 0x7f5a30199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5a180b2760 0x7f5a180b4c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 --2- 172.21.15.184:0/182297250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a30102c60 0x7f5a30199450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 >> 172.21.15.184:0/182297250 conn(0x7f5a300fe490 msgr2=0x7f5a30106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 shutdown_connections 2024-06-06T02:28:42.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:28:42.412+0000 7f5a37086640 1 -- 172.21.15.184:0/182297250 wait complete. 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: pgmap v108: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: pgmap v108: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.038 DEBUG:teuthology.orchestra.run.smithi184:osd.2> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.2.service 2024-06-06T02:28:43.040 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-06-06T02:28:43.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T02:28:43.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:43 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:43.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:43 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:43 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:43 smithi103 ceph-mon[36349]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:43.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:43 smithi103 ceph-mon[36349]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:43.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:43 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:43.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:43 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:43 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:43 smithi082 ceph-mon[31579]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:43.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:43 smithi082 ceph-mon[31579]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:43.465 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:28:43.566 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:43 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:28:43.566 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:43 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.566 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:43 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:43.566 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:43 smithi184 ceph-mon[36922]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:43.567 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:43 smithi184 ceph-mon[36922]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:44.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-mon[36922]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:44.498 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2[42011]: 2024-06-06T02:28:44.420+0000 7f5ce28ad640 -1 osd.2 0 waiting for initial osdmap 2024-06-06T02:28:44.498 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2[42011]: 2024-06-06T02:28:44.426+0000 7f5cde6b0640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:28:44.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:44.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T02:28:44.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T02:28:44.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:44.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:44.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:44 smithi082 ceph-mon[31579]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: pgmap v109: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: osdmap e16: 3 total, 2 up, 3 in 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: from='osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:44 smithi103 ceph-mon[36349]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:28:45.510 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:45 smithi184 ceph-mon[36922]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:28:45.510 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:45 smithi184 ceph-mon[36922]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T02:28:45.510 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.510 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.732 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:45 smithi082 ceph-mon[31579]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:28:45.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:45 smithi082 ceph-mon[31579]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T02:28:45.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.733 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:45 smithi103 ceph-mon[36349]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:28:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:45 smithi103 ceph-mon[36349]: osdmap e17: 3 total, 2 up, 3 in 2024-06-06T02:28:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:45.985 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T02:28:46.180 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T02:28:46.216 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-06-06T02:28:46.216 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-06-06T02:28:46.217 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303716 s, 345 MB/s 2024-06-06T02:28:46.217 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-06-06T02:28:46.574 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] boot 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.575 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:46.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:46.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:46.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:28:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:28:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] boot 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:46.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:28:46.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: pgmap v112: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: osd.2 [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] boot 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: osdmap e18: 3 total, 3 up, 3 in 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:28:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:46.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-06-06T02:28:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:28:47.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi184 2024-06-06T02:28:47.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi184 to 17088M 2024-06-06T02:28:47.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:47.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:47.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T02:28:47.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi184 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi184 to 17088M 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T02:28:47.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:47.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi184 2024-06-06T02:28:47.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi184 to 17088M 2024-06-06T02:28:47.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:47.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:47.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: osdmap e19: 3 total, 3 up, 3 in 2024-06-06T02:28:47.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:28:48.366 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54297]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54297]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54297]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.367 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54300]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.519 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44698]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44698]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44698]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44701]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44701]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.520 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44701]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45622]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45622]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45622]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45625]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45625]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.560 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.561 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45625]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: pgmap v114: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.561 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45628]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45628]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45631]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45631]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.562 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54304]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54304]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54304]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54307]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54307]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 sudo[54307]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: pgmap v114: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:48.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:48 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: pgmap v114: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: osdmap e20: 3 total, 3 up, 3 in 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44704]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44707]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44707]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-06-06T02:28:48.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:48 smithi103 sudo[44707]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:48.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:48 smithi184 sudo[45631]: pam_unix(sudo:session): session closed for user root 2024-06-06T02:28:49.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.531+0000 7fbfc6600640 1 -- 172.21.15.82:0/3684781019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 msgr2=0x7fbfc010ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:49.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.531+0000 7fbfc6600640 1 --2- 172.21.15.82:0/3684781019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc010ce30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009ca0 tx=0x7fbfb802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 -- 172.21.15.82:0/3684781019 shutdown_connections 2024-06-06T02:28:49.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 --2- 172.21.15.82:0/3684781019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc010ce30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 --2- 172.21.15.82:0/3684781019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc0075440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 --2- 172.21.15.82:0/3684781019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc0074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 -- 172.21.15.82:0/3684781019 >> 172.21.15.82:0/3684781019 conn(0x7fbfc00fe2f0 msgr2=0x7fbfc0100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:28:49.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 -- 172.21.15.82:0/3684781019 shutdown_connections 2024-06-06T02:28:49.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.532+0000 7fbfc6600640 1 -- 172.21.15.82:0/3684781019 wait complete. 2024-06-06T02:28:49.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.533+0000 7fbfc6600640 1 Processor -- start 2024-06-06T02:28:49.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.533+0000 7fbfc6600640 1 -- start start 2024-06-06T02:28:49.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.533+0000 7fbfc6600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:49.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:49.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc01a2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01107e0 con 0x7fbfc010a940 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0110660 con 0x7fbfc0076620 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc6600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0110960 con 0x7fbfc0075030 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38668/0 (socket says 172.21.15.82:38668) 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53178/0 (socket says 172.21.15.82:53178) 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc5200640 1 -- 172.21.15.82:0/1220688135 learned_addr learned my addr 172.21.15.82:0/1220688135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:28:49.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc5c00640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc01a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 -- 172.21.15.82:0/1220688135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 msgr2=0x7fbfc019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 -- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 msgr2=0x7fbfc01a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc01a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfbfe00640 1 -- 172.21.15.82:0/1220688135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc01a2e50 con 0x7fbfc0076620 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.534+0000 7fbfc5200640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:28:49.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.535+0000 7fbfbfe00640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00e9f0 tx=0x7fbfac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:49.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.542+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00ccc0 con 0x7fbfc0076620 2024-06-06T02:28:49.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.542+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfac005020 con 0x7fbfc0076620 2024-06-06T02:28:49.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.542+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac004a00 con 0x7fbfc0076620 2024-06-06T02:28:49.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.542+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc01a3140 con 0x7fbfc0076620 2024-06-06T02:28:49.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.542+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01a3630 con 0x7fbfc0076620 2024-06-06T02:28:49.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.543+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc0109750 con 0x7fbfc0076620 2024-06-06T02:28:49.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.546+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbfac004ba0 con 0x7fbfc0076620 2024-06-06T02:28:49.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.547+0000 7fbfbd600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 0x7fbfa80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:28:49.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.547+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7fbfac0e0da0 con 0x7fbfc0076620 2024-06-06T02:28:49.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.548+0000 7fbfc5200640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 0x7fbfa80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:28:49.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.548+0000 7fbfc5200640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 0x7fbfa80b4d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40058c0 tx=0x7fbfb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:28:49.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.549+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbfac0a9df0 con 0x7fbfc0076620 2024-06-06T02:28:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: pgmap v117: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:49 smithi082 ceph-mon[31579]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T02:28:49.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:28:49.768+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbfc0062ba0 con 0x7fbfa80b2870 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: pgmap v117: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:49.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:49 smithi103 ceph-mon[36349]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T02:28:49.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: pgmap v117: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:49.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:49 smithi184 ceph-mon[36922]: osdmap e21: 3 total, 3 up, 3 in 2024-06-06T02:28:50.759 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:50 smithi082 ceph-mon[31579]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-06-06T02:28:50.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:50 smithi082 ceph-mon[31579]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:50.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:50 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:50.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:50 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:50.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:50 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:50 smithi103 ceph-mon[36349]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-06-06T02:28:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:50 smithi103 ceph-mon[36349]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:50 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:50 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:50 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:50 smithi184 ceph-mon[36922]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-06-06T02:28:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:50 smithi184 ceph-mon[36922]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:28:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:50 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:28:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:50 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:28:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:50 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:28:51.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:51 smithi082 ceph-mon[31579]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:51.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:51 smithi103 ceph-mon[36349]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:51.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:51 smithi184 ceph-mon[36922]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:53.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:53 smithi082 ceph-mon[31579]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:53.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:53 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]: dispatch 2024-06-06T02:28:53.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:53 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]': finished 2024-06-06T02:28:53.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:53 smithi082 ceph-mon[31579]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T02:28:53.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:53 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:28:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:53 smithi103 ceph-mon[36349]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:53 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]: dispatch 2024-06-06T02:28:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:53 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]': finished 2024-06-06T02:28:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:53 smithi103 ceph-mon[36349]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T02:28:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:53 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:28:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:53 smithi184 ceph-mon[36922]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:53 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]: dispatch 2024-06-06T02:28:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:53 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3732132076' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3525ec4e-8aba-4b93-a2a0-53d0768d6024"}]': finished 2024-06-06T02:28:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:53 smithi184 ceph-mon[36922]: osdmap e22: 4 total, 3 up, 4 in 2024-06-06T02:28:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:53 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:28:55.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:54 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2412244695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:55.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:54 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2412244695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:55.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:54 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2412244695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:28:56.049 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:55 smithi184 ceph-mon[36922]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:56.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:55 smithi103 ceph-mon[36349]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:56.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:55 smithi082 ceph-mon[31579]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:57.760 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:57 smithi082 ceph-mon[31579]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:58.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:57 smithi103 ceph-mon[36349]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:28:58.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:57 smithi184 ceph-mon[36922]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:00.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:28:59 smithi103 ceph-mon[36349]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:28:59 smithi082 ceph-mon[31579]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:28:59 smithi184 ceph-mon[36922]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:01.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:01 smithi082 ceph-mon[31579]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:02.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:01 smithi103 ceph-mon[36349]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:02.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:01 smithi184 ceph-mon[36922]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:03.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T02:29:03.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T02:29:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-06T02:29:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:03 smithi082 ceph-mon[31579]: Deploying daemon osd.3 on smithi082 2024-06-06T02:29:03.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:03 smithi082 ceph-mon[31579]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:04.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:03 smithi103 ceph-mon[36349]: Deploying daemon osd.3 on smithi082 2024-06-06T02:29:04.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:03 smithi103 ceph-mon[36349]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:04.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:03 smithi184 ceph-mon[36922]: Deploying daemon osd.3 on smithi082 2024-06-06T02:29:04.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:03 smithi184 ceph-mon[36922]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:05 smithi103 ceph-mon[36349]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:06.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:05 smithi082 ceph-mon[31579]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:05 smithi184 ceph-mon[36922]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:07.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:07 smithi082 ceph-mon[31579]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:07 smithi103 ceph-mon[36349]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:08.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:07 smithi184 ceph-mon[36922]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:10.085 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:09 smithi082 ceph-mon[31579]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:10.116 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:09 smithi103 ceph-mon[36349]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:10.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:09 smithi184 ceph-mon[36922]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:12.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:11 smithi082 ceph-mon[31579]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:12.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:12.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:12.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:11 smithi103 ceph-mon[36349]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:11 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:11 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:11 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:11 smithi184 ceph-mon[36922]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:13.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:13 smithi082 ceph-mon[31579]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:14.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:13 smithi103 ceph-mon[36349]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:14.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:13 smithi184 ceph-mon[36922]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:16.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:16.071 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:16.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.146+0000 7fbfbd600640 1 -- 172.21.15.82:0/1220688135 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbfc0062ba0 con 0x7fbfa80b2870 2024-06-06T02:29:16.148 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 msgr2=0x7fbfa80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 0x7fbfa80b4d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40058c0 tx=0x7fbfb4005f90 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 msgr2=0x7fbfc019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbfac00e9f0 tx=0x7fbfac00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 shutdown_connections 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfc010a940 0x7fbfc01a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfc0076620 0x7fbfc019b870 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbfa80b2870 0x7fbfa80b4d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 --2- 172.21.15.82:0/1220688135 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbfc0075030 0x7fbfc019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.150+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 >> 172.21.15.82:0/1220688135 conn(0x7fbfc00fe2f0 msgr2=0x7fbfc0106920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.151+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 shutdown_connections 2024-06-06T02:29:16.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:29:16.151+0000 7fbfc6600640 1 -- 172.21.15.82:0/1220688135 wait complete. 2024-06-06T02:29:17.087 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T02:29:17.087 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T02:29:17.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:29:17.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:17.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:17.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.093 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.3.service 2024-06-06T02:29:17.097 INFO:tasks.cephadm:Deploying osd.4 on smithi103 with /dev/vg_nvme/lv_3... 2024-06-06T02:29:17.097 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T02:29:17.116 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: osdmap e23: 4 total, 3 up, 4 in 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:29:18.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:17 smithi082 ceph-mon[31579]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:18.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:17 smithi082 ceph-mon[31579]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:29:18.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:17 smithi082 ceph-mon[31579]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T02:29:18.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:17 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:18.109 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:17 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:18.116 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:17 smithi103 ceph-mon[36349]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:18.116 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:17 smithi103 ceph-mon[36349]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:29:18.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:17 smithi103 ceph-mon[36349]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T02:29:18.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:17 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:18.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:17 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:17 smithi184 ceph-mon[36922]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:17 smithi184 ceph-mon[36922]: from='osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:29:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:17 smithi184 ceph-mon[36922]: osdmap e24: 4 total, 3 up, 4 in 2024-06-06T02:29:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:17 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:17 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:19.096 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:29:19.096 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:29:19.096 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] boot 2024-06-06T02:29:19.096 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T02:29:19.097 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:19.097 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:18 smithi082 ceph-mon[31579]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T02:29:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:29:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:29:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] boot 2024-06-06T02:29:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T02:29:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:19.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:18 smithi103 ceph-mon[36349]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T02:29:19.134 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T02:29:19.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:29:19.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:29:19.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: osd.3 [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] boot 2024-06-06T02:29:19.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: osdmap e25: 4 total, 4 up, 4 in 2024-06-06T02:29:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-06T02:29:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:18 smithi184 ceph-mon[36922]: osdmap e26: 4 total, 4 up, 4 in 2024-06-06T02:29:19.218 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T02:29:19.233 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-06-06T02:29:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-06-06T02:29:19.233 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127863 s, 820 MB/s 2024-06-06T02:29:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-06-06T02:29:19.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-06-06T02:29:20.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:19 smithi103 ceph-mon[36349]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:20.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:19 smithi103 ceph-mon[36349]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T02:29:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:19 smithi082 ceph-mon[31579]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:19 smithi082 ceph-mon[31579]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T02:29:20.138 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:29:20.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:19 smithi184 ceph-mon[36922]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-06T02:29:20.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:19 smithi184 ceph-mon[36922]: osdmap e27: 4 total, 4 up, 4 in 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 -- 172.21.15.103:0/1757678592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e41046e0 msgr2=0x7fb0e410afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/1757678592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e41046e0 0x7fb0e410afe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009ca0 tx=0x7fb0dc02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 -- 172.21.15.103:0/1757678592 shutdown_connections 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/1757678592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e41046e0 0x7fb0e410afe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/1757678592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e4103d90 0x7fb0e41041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/1757678592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e4102c60 0x7fb0e4103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 -- 172.21.15.103:0/1757678592 >> 172.21.15.103:0/1757678592 conn(0x7fb0e40fe490 msgr2=0x7fb0e4100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 -- 172.21.15.103:0/1757678592 shutdown_connections 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.718+0000 7fb0ebb90640 1 -- 172.21.15.103:0/1757678592 wait complete. 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 Processor -- start 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 -- start start 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e4103d90 0x7fb0e41999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e41046e0 0x7fb0e41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e410e860 con 0x7fb0e4103d90 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e410e6e0 con 0x7fb0e4102c60 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0ebb90640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e410e9e0 con 0x7fb0e41046e0 2024-06-06T02:29:21.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0e992c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0e992c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48538/0 (socket says 172.21.15.103:48538) 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.719+0000 7fb0e992c640 1 -- 172.21.15.103:0/3294744792 learned_addr learned my addr 172.21.15.103:0/3294744792 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0ea12d640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e41046e0 0x7fb0e41a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 -- 172.21.15.103:0/3294744792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e41046e0 msgr2=0x7fb0e41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e41046e0 0x7fb0e41a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 -- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e4103d90 msgr2=0x7fb0e41999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e4103d90 0x7fb0e41999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 -- 172.21.15.103:0/3294744792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e41a0f90 con 0x7fb0e4102c60 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0e992c640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b450 tx=0x7fb0e000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0015020 con 0x7fb0e4102c60 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e41a1280 con 0x7fb0e4102c60 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0e0011d40 con 0x7fb0e4102c60 2024-06-06T02:29:21.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e000f340 con 0x7fb0e4102c60 2024-06-06T02:29:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.720+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e41a1840 con 0x7fb0e4102c60 2024-06-06T02:29:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.721+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e4109e60 con 0x7fb0e4102c60 2024-06-06T02:29:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.723+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb0e0018020 con 0x7fb0e4102c60 2024-06-06T02:29:21.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.724+0000 7fb0daffd640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 0x7fb0d00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.724+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7fb0e00e1190 con 0x7fb0e4102c60 2024-06-06T02:29:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.724+0000 7fb0e912b640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 0x7fb0d00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:21.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.726+0000 7fb0e912b640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 0x7fb0d00b4d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0e419a520 tx=0x7fb0d4006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:29:21.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.727+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb0e001f020 con 0x7fb0e4102c60 2024-06-06T02:29:21.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:21.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:21.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:21.922+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb0e4062ba0 con 0x7fb0d00b27f0 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:22.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi082 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi082 to 8544M 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:23.047 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:22 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi082 2024-06-06T02:29:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi082 to 8544M 2024-06-06T02:29:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:22 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi082 2024-06-06T02:29:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi082 to 8544M 2024-06-06T02:29:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:22 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:24.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:23 smithi103 ceph-mon[36349]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:24.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:23 smithi082 ceph-mon[31579]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:24.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:23 smithi184 ceph-mon[36922]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:24 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/2823996637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:24 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:24 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]': finished 2024-06-06T02:29:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:24 smithi103 ceph-mon[36349]: osdmap e28: 5 total, 4 up, 5 in 2024-06-06T02:29:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:24 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/2823996637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:24 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:24 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]': finished 2024-06-06T02:29:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:24 smithi082 ceph-mon[31579]: osdmap e28: 5 total, 4 up, 5 in 2024-06-06T02:29:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:25.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:24 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/2823996637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:25.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:24 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]: dispatch 2024-06-06T02:29:25.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:24 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6577bfe-f247-4018-abca-2aa1e02cd3f7"}]': finished 2024-06-06T02:29:25.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:24 smithi184 ceph-mon[36922]: osdmap e28: 5 total, 4 up, 5 in 2024-06-06T02:29:25.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:25 smithi103 ceph-mon[36349]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:29:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:25 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/2924918795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:25 smithi082 ceph-mon[31579]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:29:26.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:25 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/2924918795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:26.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:25 smithi184 ceph-mon[36922]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:29:26.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:25 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/2924918795' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:27 smithi103 ceph-mon[36349]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:29:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:27 smithi082 ceph-mon[31579]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:29:28.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:27 smithi184 ceph-mon[36922]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:29:29.954 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:29 smithi103 ceph-mon[36349]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-06-06T02:29:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:29 smithi082 ceph-mon[31579]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-06-06T02:29:30.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:29 smithi184 ceph-mon[36922]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-06-06T02:29:31.982 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:31 smithi103 ceph-mon[36349]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:31.982 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T02:29:31.982 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:31.982 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:31 smithi103 ceph-mon[36349]: Deploying daemon osd.4 on smithi103 2024-06-06T02:29:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:31 smithi082 ceph-mon[31579]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T02:29:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:31 smithi082 ceph-mon[31579]: Deploying daemon osd.4 on smithi103 2024-06-06T02:29:32.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:31 smithi184 ceph-mon[36922]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:32.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-06T02:29:32.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:32.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:31 smithi184 ceph-mon[36922]: Deploying daemon osd.4 on smithi103 2024-06-06T02:29:34.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:33 smithi103 ceph-mon[36349]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:33 smithi082 ceph-mon[31579]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:34.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:33 smithi184 ceph-mon[36922]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:29:35.951 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:35 smithi103 ceph-mon[36349]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:36.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:35 smithi082 ceph-mon[31579]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:36.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:35 smithi184 ceph-mon[36922]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:37.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:37.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:37.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:37.886 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:37 smithi103 ceph-mon[36349]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:37 smithi082 ceph-mon[31579]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:38.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:37 smithi184 ceph-mon[36922]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:39.909 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 4 on host 'smithi103' 2024-06-06T02:29:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.908+0000 7fb0daffd640 1 -- 172.21.15.103:0/3294744792 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb0e4062ba0 con 0x7fb0d00b27f0 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 msgr2=0x7fb0d00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 0x7fb0d00b4d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb0e419a520 tx=0x7fb0d4006c90 comp rx=0 tx=0).stop 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 msgr2=0x7fb0e4199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b450 tx=0x7fb0e000b910 comp rx=0 tx=0).stop 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 shutdown_connections 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb0d00b27f0 0x7fb0d00b4d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0e41046e0 0x7fb0e41a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e4103d90 0x7fb0e41999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 --2- 172.21.15.103:0/3294744792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e4102c60 0x7fb0e4199470 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 >> 172.21.15.103:0/3294744792 conn(0x7fb0e40fe490 msgr2=0x7fb0e4107030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:29:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 shutdown_connections 2024-06-06T02:29:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:29:39.911+0000 7fb0ebb90640 1 -- 172.21.15.103:0/3294744792 wait complete. 2024-06-06T02:29:40.267 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:40.267 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:40.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:40.652 DEBUG:teuthology.orchestra.run.smithi103:osd.4> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.4.service 2024-06-06T02:29:40.654 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_3... 2024-06-06T02:29:40.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-06T02:29:40.894 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:29:41.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:41 smithi184 ceph-mon[36922]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:41.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:41 smithi184 ceph-mon[36922]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:41.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:41 smithi103 ceph-mon[36349]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:41.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:41 smithi103 ceph-mon[36349]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:41.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:41 smithi082 ceph-mon[31579]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:41.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:41 smithi082 ceph-mon[31579]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-06T02:29:42.297 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:42.297 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T02:29:42.297 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.297 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: osdmap e29: 5 total, 4 up, 5 in 2024-06-06T02:29:42.298 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:42.298 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:42 smithi184 ceph-mon[36922]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: osdmap e29: 5 total, 4 up, 5 in 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-mon[36349]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-06T02:29:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: from='osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: osdmap e29: 5 total, 4 up, 5 in 2024-06-06T02:29:42.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:42.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:42 smithi082 ceph-mon[31579]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:29:42.773 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-06T02:29:42.851 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-06T02:29:42.864 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-06-06T02:29:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-06-06T02:29:42.864 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113551 s, 923 MB/s 2024-06-06T02:29:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-06-06T02:29:42.867 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4[47502]: 2024-06-06T02:29:42.594+0000 7f994543c640 -1 osd.4 0 waiting for initial osdmap 2024-06-06T02:29:42.867 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:29:42 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4[47502]: 2024-06-06T02:29:42.602+0000 7f993d237640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:29:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:43 smithi184 ceph-mon[36922]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:29:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:43 smithi184 ceph-mon[36922]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T02:29:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:43 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:43 smithi184 ceph-mon[36922]: from='osd.4 ' entity='osd.4' 2024-06-06T02:29:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:43 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.449 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:43 smithi103 ceph-mon[36349]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:29:43.449 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:43 smithi103 ceph-mon[36349]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T02:29:43.449 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:43 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.449 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:43 smithi103 ceph-mon[36349]: from='osd.4 ' entity='osd.4' 2024-06-06T02:29:43.450 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:43 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-06-06T02:29:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:43 smithi082 ceph-mon[31579]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:29:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:43 smithi082 ceph-mon[31579]: osdmap e30: 5 total, 4 up, 5 in 2024-06-06T02:29:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:43 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:43 smithi082 ceph-mon[31579]: from='osd.4 ' entity='osd.4' 2024-06-06T02:29:43.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:43 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:43.782 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] boot 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: osdmap e31: 5 total, 5 up, 5 in 2024-06-06T02:29:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] boot 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: osdmap e31: 5 total, 5 up, 5 in 2024-06-06T02:29:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:29:44.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:29:44.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: osd.4 [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] boot 2024-06-06T02:29:44.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: osdmap e31: 5 total, 5 up, 5 in 2024-06-06T02:29:44.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-06T02:29:45.230 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:45 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi103 2024-06-06T02:29:45.230 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:45 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi103 to 8544M 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 -- 172.21.15.184:0/55843569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c108a60 msgr2=0x7f6c7c10ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/55843569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c108a60 0x7f6c7c10ae80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009ca0 tx=0x7f6c7402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 -- 172.21.15.184:0/55843569 shutdown_connections 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/55843569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c108a60 0x7f6c7c10ae80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/55843569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c7c106100 0x7f6c7c108520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.448 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/55843569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c100f80 0x7f6c7c101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 -- 172.21.15.184:0/55843569 >> 172.21.15.184:0/55843569 conn(0x7f6c7c0fcb30 msgr2=0x7f6c7c0fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 -- 172.21.15.184:0/55843569 shutdown_connections 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.440+0000 7f6c80dd5640 1 -- 172.21.15.184:0/55843569 wait complete. 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 Processor -- start 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 -- start start 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c7c106100 0x7f6c7c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c108a60 0x7f6c7c1a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:45.449 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10e860 con 0x7f6c7c106100 2024-06-06T02:29:45.450 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10e6e0 con 0x7f6c7c108a60 2024-06-06T02:29:45.450 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c80dd5640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10e9e0 con 0x7f6c7c100f80 2024-06-06T02:29:45.450 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:45.450 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:49320/0 (socket says 172.21.15.184:49320) 2024-06-06T02:29:45.450 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c7a59c640 1 -- 172.21.15.184:0/482341068 learned_addr learned my addr 172.21.15.184:0/482341068 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.441+0000 7f6c7ad9d640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c108a60 0x7f6c7c1a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 -- 172.21.15.184:0/482341068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c108a60 msgr2=0x7f6c7c1a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c108a60 0x7f6c7c1a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 -- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c7c106100 msgr2=0x7f6c7c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c7c106100 0x7f6c7c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 -- 172.21.15.184:0/482341068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1a0f90 con 0x7f6c7c100f80 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c7a59c640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00b450 tx=0x7f6c6c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c015020 con 0x7f6c7c100f80 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c1a1280 con 0x7f6c7c100f80 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c6c011d40 con 0x7f6c7c100f80 2024-06-06T02:29:45.451 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00f340 con 0x7f6c7c100f80 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.442+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1a1840 con 0x7f6c7c100f80 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.443+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c0fe650 con 0x7f6c7c100f80 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.444+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6c6c018020 con 0x7f6c7c100f80 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.445+0000 7f6c737fe640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 0x7f6c680b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.445+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f6c6c0e12b0 con 0x7f6c7c100f80 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.445+0000 7f6c73fff640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 0x7f6c680b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.447+0000 7f6c73fff640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 0x7f6c680b4d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c19a520 tx=0x7f6c64006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:29:45.452 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.448+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6c6c01f020 con 0x7f6c7c100f80 2024-06-06T02:29:45.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:45 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi103 2024-06-06T02:29:45.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:45 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi103 to 8544M 2024-06-06T02:29:45.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:45 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi103 2024-06-06T02:29:45.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:45 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi103 to 8544M 2024-06-06T02:29:45.638 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:29:45.639+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6c7c062ba0 con 0x7f6c680b27f0 2024-06-06T02:29:46.392 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:46 smithi184 ceph-mon[36922]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:46.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:46 smithi184 ceph-mon[36922]: osdmap e32: 5 total, 5 up, 5 in 2024-06-06T02:29:46.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:46.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:46.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:46 smithi103 ceph-mon[36349]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:46 smithi103 ceph-mon[36349]: osdmap e32: 5 total, 5 up, 5 in 2024-06-06T02:29:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:46 smithi082 ceph-mon[31579]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:46 smithi082 ceph-mon[31579]: osdmap e32: 5 total, 5 up, 5 in 2024-06-06T02:29:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:29:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:29:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:47.342 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:47 smithi184 ceph-mon[36922]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:47.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:47 smithi103 ceph-mon[36349]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:47.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:47 smithi082 ceph-mon[31579]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/2302892838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]': finished 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: osdmap e33: 6 total, 5 up, 6 in 2024-06-06T02:29:48.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:29:48.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:48.621 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/2302892838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.621 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.621 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]': finished 2024-06-06T02:29:48.622 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: osdmap e33: 6 total, 5 up, 6 in 2024-06-06T02:29:48.622 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:29:48.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:48.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/2302892838' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]: dispatch 2024-06-06T02:29:48.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7650a94a-7c8c-4eb2-8c34-937d964e525c"}]': finished 2024-06-06T02:29:48.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: osdmap e33: 6 total, 5 up, 6 in 2024-06-06T02:29:48.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:29:49.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:49 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/2892200321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:49 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/2892200321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:49.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:49 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/2892200321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:29:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:50 smithi103 ceph-mon[36349]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:50 smithi082 ceph-mon[31579]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:50 smithi184 ceph-mon[36922]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:52.314 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:52 smithi184 ceph-mon[36922]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:52 smithi103 ceph-mon[36349]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:52.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:52 smithi082 ceph-mon[31579]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:54 smithi103 ceph-mon[36349]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:54.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:54 smithi082 ceph-mon[31579]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:54 smithi184 ceph-mon[36922]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:55.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T02:29:55.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:55.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T02:29:55.522 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:55.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-06T02:29:55.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:29:56.490 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:56 smithi184 ceph-mon[36922]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:56.490 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:56 smithi184 ceph-mon[36922]: Deploying daemon osd.5 on smithi184 2024-06-06T02:29:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:56 smithi103 ceph-mon[36349]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:56 smithi103 ceph-mon[36349]: Deploying daemon osd.5 on smithi184 2024-06-06T02:29:56.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:56 smithi082 ceph-mon[31579]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:56.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:56 smithi082 ceph-mon[31579]: Deploying daemon osd.5 on smithi184 2024-06-06T02:29:58.290 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:29:58 smithi184 ceph-mon[36922]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:29:58 smithi103 ceph-mon[36349]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:29:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:29:58 smithi082 ceph-mon[31579]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:00 smithi103 ceph-mon[36349]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:00 smithi103 ceph-mon[36349]: overall HEALTH_OK 2024-06-06T02:30:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:00 smithi082 ceph-mon[31579]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:00 smithi082 ceph-mon[31579]: overall HEALTH_OK 2024-06-06T02:30:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:00 smithi184 ceph-mon[36922]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:00 smithi184 ceph-mon[36922]: overall HEALTH_OK 2024-06-06T02:30:01.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:01.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:01.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:01.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:01.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:01.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:01.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:01.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:01.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:02.590 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:02 smithi184 ceph-mon[36922]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:02.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:02 smithi103 ceph-mon[36349]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:02.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:02 smithi082 ceph-mon[31579]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:04.039 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2024-06-06T02:30:04.040 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.040+0000 7f6c737fe640 1 -- 172.21.15.184:0/482341068 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c7c062ba0 con 0x7f6c680b27f0 2024-06-06T02:30:04.041 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 msgr2=0x7f6c680b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 0x7f6c680b4d00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c19a520 tx=0x7f6c64006c90 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 msgr2=0x7f6c7c199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00b450 tx=0x7f6c6c00b910 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 shutdown_connections 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c7c108a60 0x7f6c7c1a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c7c106100 0x7f6c7c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6c680b27f0 0x7f6c680b4d00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 --2- 172.21.15.184:0/482341068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c7c100f80 0x7f6c7c199470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 >> 172.21.15.184:0/482341068 conn(0x7f6c7c0fcb30 msgr2=0x7f6c7c106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 shutdown_connections 2024-06-06T02:30:04.042 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:30:04.042+0000 7f6c80dd5640 1 -- 172.21.15.184:0/482341068 wait complete. 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:04.419 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.420 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:04.420 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.420 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:04.744 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.5.service 2024-06-06T02:30:04.746 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-06-06T02:30:04.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T02:30:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:30:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:05 smithi184 ceph-mon[36922]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:05 smithi184 ceph-mon[36922]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:05.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:05 smithi082 ceph-mon[31579]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:05.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:05 smithi082 ceph-mon[31579]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:05.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:05 smithi103 ceph-mon[36349]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:05.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:05 smithi103 ceph-mon[36349]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: osdmap e34: 6 total, 5 up, 6 in 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:06.611 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:06 smithi082 ceph-mon[31579]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T02:30:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: osdmap e34: 6 total, 5 up, 6 in 2024-06-06T02:30:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:06 smithi103 ceph-mon[36349]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-06T02:30:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: from='osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: osdmap e34: 6 total, 5 up, 6 in 2024-06-06T02:30:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-mon[36922]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:30:06.648 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5[48491]: 2024-06-06T02:30:06.201+0000 7f9b62556640 -1 osd.5 0 waiting for initial osdmap 2024-06-06T02:30:06.648 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:30:06 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5[48491]: 2024-06-06T02:30:06.207+0000 7f9b5e359640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] boot 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: osdmap e36: 6 total, 6 up, 6 in 2024-06-06T02:30:07.531 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.568 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:30:07.568 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T02:30:07.568 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.568 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.568 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] boot 2024-06-06T02:30:07.569 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: osdmap e36: 6 total, 6 up, 6 in 2024-06-06T02:30:07.569 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: osdmap e35: 6 total, 5 up, 6 in 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: osd.5 [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] boot 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: osdmap e36: 6 total, 6 up, 6 in 2024-06-06T02:30:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-06T02:30:07.878 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T02:30:08.070 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T02:30:08.111 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-06-06T02:30:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-06-06T02:30:08.112 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0339187 s, 309 MB/s 2024-06-06T02:30:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-06-06T02:30:08.514 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:30:08.514 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.515 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:08 smithi082 ceph-mon[31579]: osdmap e37: 6 total, 6 up, 6 in 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:08.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:08.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:08 smithi103 ceph-mon[36349]: osdmap e37: 6 total, 6 up, 6 in 2024-06-06T02:30:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:30:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:30:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-06-06T02:30:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:08 smithi184 ceph-mon[36922]: osdmap e37: 6 total, 6 up, 6 in 2024-06-06T02:30:09.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-06-06T02:30:09.490 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:30:09.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:09 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi184 2024-06-06T02:30:09.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:09 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi184 to 8544M 2024-06-06T02:30:09.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:09 smithi103 ceph-mon[36349]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T02:30:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:09 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi184 2024-06-06T02:30:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:09 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi184 to 8544M 2024-06-06T02:30:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:09 smithi082 ceph-mon[31579]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T02:30:09.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:09 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi184 2024-06-06T02:30:09.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:09 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi184 to 8544M 2024-06-06T02:30:09.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:09 smithi184 ceph-mon[36922]: osdmap e38: 6 total, 6 up, 6 in 2024-06-06T02:30:10.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:10 smithi082 ceph-mon[31579]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:10.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:10 smithi103 ceph-mon[36349]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:10.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:10 smithi184 ceph-mon[36922]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.823+0000 7f784ae00640 1 -- 172.21.15.82:0/3453874657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784410f0c0 msgr2=0x7f78441114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.823+0000 7f784ae00640 1 --2- 172.21.15.82:0/3453874657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784410f0c0 0x7f78441114e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f783c009900 tx=0x7f783c02a400 comp rx=0 tx=0).stop 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 -- 172.21.15.82:0/3453874657 shutdown_connections 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 --2- 172.21.15.82:0/3453874657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784410f0c0 0x7f78441114e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 --2- 172.21.15.82:0/3453874657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844075090 0x7f78440754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 --2- 172.21.15.82:0/3453874657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7844076680 0x7f7844074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:11.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 -- 172.21.15.82:0/3453874657 >> 172.21.15.82:0/3453874657 conn(0x7f78440fe2c0 msgr2=0x7f7844100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:30:11.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 -- 172.21.15.82:0/3453874657 shutdown_connections 2024-06-06T02:30:11.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.824+0000 7f784ae00640 1 -- 172.21.15.82:0/3453874657 wait complete. 2024-06-06T02:30:11.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.825+0000 7f784ae00640 1 Processor -- start 2024-06-06T02:30:11.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.825+0000 7f784ae00640 1 -- start start 2024-06-06T02:30:11.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.825+0000 7f784ae00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.825+0000 7f784ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 0x7f784419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f784ae00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f784410f0c0 0x7f78441a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f784ae00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7844114bf0 con 0x7f7844075090 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f784ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7844114a70 con 0x7f7844076680 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f784ae00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7844114d70 con 0x7f784410f0c0 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45896/0 (socket says 172.21.15.82:45896) 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 -- 172.21.15.82:0/1625492467 learned_addr learned my addr 172.21.15.82:0/1625492467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849000640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 0x7f784419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f784a400640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f784410f0c0 0x7f78441a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 -- 172.21.15.82:0/1625492467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f784410f0c0 msgr2=0x7f78441a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:11.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f784410f0c0 0x7f78441a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:11.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 -- 172.21.15.82:0/1625492467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 msgr2=0x7f784419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:11.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 0x7f784419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:11.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849a00640 1 -- 172.21.15.82:0/1625492467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441a7200 con 0x7f7844075090 2024-06-06T02:30:11.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.826+0000 7f7849000640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 0x7f784419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:30:11.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f7849a00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f783800ebc0 tx=0x7f783800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838003b70 con 0x7f7844075090 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78441a74f0 con 0x7f7844075090 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7838003d10 con 0x7f7844075090 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838019800 con 0x7f7844075090 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.827+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78441a7a30 con 0x7f7844075090 2024-06-06T02:30:11.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.828+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844105170 con 0x7f7844075090 2024-06-06T02:30:11.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.832+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f78380199a0 con 0x7f7844075090 2024-06-06T02:30:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.833+0000 7f7842000640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 0x7f782c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.834+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7f78380e1d90 con 0x7f7844075090 2024-06-06T02:30:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.834+0000 7f7849000640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 0x7f782c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.834+0000 7f7849000640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 0x7f782c0b4d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78441a0790 tx=0x7f7830005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:30:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:11.835+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f78380aa960 con 0x7f7844075090 2024-06-06T02:30:12.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:12.054+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7844062ba0 con 0x7f782c0b27f0 2024-06-06T02:30:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:12 smithi082 ceph-mon[31579]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-06-06T02:30:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:12 smithi103 ceph-mon[36349]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-06-06T02:30:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:12 smithi184 ceph-mon[36922]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-06-06T02:30:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:13.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:13 smithi103 ceph-mon[36349]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:13.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:13 smithi082 ceph-mon[31579]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:13.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:13 smithi184 ceph-mon[36922]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:14.313 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:14 smithi082 ceph-mon[31579]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T02:30:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:14 smithi103 ceph-mon[36349]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T02:30:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:14 smithi184 ceph-mon[36922]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-06T02:30:16.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:16 smithi082 ceph-mon[31579]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T02:30:16.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]: dispatch 2024-06-06T02:30:16.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]': finished 2024-06-06T02:30:16.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:16 smithi082 ceph-mon[31579]: osdmap e39: 7 total, 6 up, 7 in 2024-06-06T02:30:16.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:16 smithi103 ceph-mon[36349]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T02:30:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]: dispatch 2024-06-06T02:30:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]': finished 2024-06-06T02:30:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:16 smithi103 ceph-mon[36349]: osdmap e39: 7 total, 6 up, 7 in 2024-06-06T02:30:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:16 smithi184 ceph-mon[36922]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-06-06T02:30:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]: dispatch 2024-06-06T02:30:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1449509080' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dca2a063-43f3-474f-a96d-478981f1837e"}]': finished 2024-06-06T02:30:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:16 smithi184 ceph-mon[36922]: osdmap e39: 7 total, 6 up, 7 in 2024-06-06T02:30:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:17.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:17 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2444298052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:17.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:17 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2444298052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:17.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:17 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2444298052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:18 smithi103 ceph-mon[36349]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:30:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:18 smithi082 ceph-mon[31579]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:30:18.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:18 smithi184 ceph-mon[36922]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:30:20.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:20 smithi103 ceph-mon[36349]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-06T02:30:20.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:20 smithi082 ceph-mon[31579]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-06T02:30:20.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:20 smithi184 ceph-mon[36922]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-06-06T02:30:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:22 smithi103 ceph-mon[36349]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:22 smithi082 ceph-mon[31579]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:22.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:22 smithi184 ceph-mon[36922]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:24.546 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:24 smithi082 ceph-mon[31579]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:24 smithi103 ceph-mon[36349]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:24 smithi184 ceph-mon[36922]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:25.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T02:30:25.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:25.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T02:30:25.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:25.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-06T02:30:25.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:26 smithi082 ceph-mon[31579]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:26 smithi082 ceph-mon[31579]: Deploying daemon osd.6 on smithi082 2024-06-06T02:30:26.548 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:26 smithi184 ceph-mon[36922]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:26.548 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:26 smithi184 ceph-mon[36922]: Deploying daemon osd.6 on smithi082 2024-06-06T02:30:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:26 smithi103 ceph-mon[36349]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:26 smithi103 ceph-mon[36349]: Deploying daemon osd.6 on smithi082 2024-06-06T02:30:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:28 smithi103 ceph-mon[36349]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:28 smithi082 ceph-mon[31579]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:28 smithi184 ceph-mon[36922]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:30.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:30 smithi082 ceph-mon[31579]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:30 smithi103 ceph-mon[36349]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:30.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:30 smithi184 ceph-mon[36922]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:32 smithi103 ceph-mon[36349]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:32.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:32 smithi082 ceph-mon[31579]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:32.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:32 smithi184 ceph-mon[36922]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:34.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:34 smithi082 ceph-mon[31579]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:34.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:34.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:34.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:34.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:34 smithi103 ceph-mon[36349]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:34 smithi184 ceph-mon[36922]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:36.613 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:36 smithi103 ceph-mon[36349]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:36 smithi082 ceph-mon[31579]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:36 smithi184 ceph-mon[36922]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:38.423 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:38.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-06T02:30:38.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:38.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:38.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:38.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.852+0000 7f7842000640 1 -- 172.21.15.82:0/1625492467 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7844062ba0 con 0x7f782c0b27f0 2024-06-06T02:30:38.852 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-06-06T02:30:38.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.856+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 msgr2=0x7f782c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:38.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.856+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 0x7f782c0b4d00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f78441a0790 tx=0x7f7830005f90 comp rx=0 tx=0).stop 2024-06-06T02:30:38.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.856+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 msgr2=0x7f784419f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:38.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.856+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f783800ebc0 tx=0x7f783800c6a0 comp rx=0 tx=0).stop 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 shutdown_connections 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f782c0b27f0 0x7f782c0b4d00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f784410f0c0 0x7f78441a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7844076680 0x7f784419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 --2- 172.21.15.82:0/1625492467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7844075090 0x7f784419f6e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 >> 172.21.15.82:0/1625492467 conn(0x7f78440fe2c0 msgr2=0x7f7844102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 shutdown_connections 2024-06-06T02:30:38.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:30:38.857+0000 7f784ae00640 1 -- 172.21.15.82:0/1625492467 wait complete. 2024-06-06T02:30:39.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T02:30:39.606 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: osdmap e40: 7 total, 6 up, 7 in 2024-06-06T02:30:39.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:30:39.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:39.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:39.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: osdmap e40: 7 total, 6 up, 7 in 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-06T02:30:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: osdmap e40: 7 total, 6 up, 7 in 2024-06-06T02:30:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:30:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:39.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:39.669 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.6.service 2024-06-06T02:30:39.674 INFO:tasks.cephadm:Deploying osd.7 on smithi103 with /dev/vg_nvme/lv_2... 2024-06-06T02:30:39.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T02:30:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:30:40.269 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:30:39 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6[63093]: 2024-06-06T02:30:39.989+0000 7f3f02200640 -1 osd.6 0 waiting for initial osdmap 2024-06-06T02:30:40.269 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6[63093]: 2024-06-06T02:30:40.026+0000 7f3ef8200640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:30:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:30:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: osdmap e41: 7 total, 6 up, 7 in 2024-06-06T02:30:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:40 smithi103 ceph-mon[36349]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: osdmap e41: 7 total, 6 up, 7 in 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:40 smithi082 ceph-mon[31579]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' 2024-06-06T02:30:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:30:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: osdmap e41: 7 total, 6 up, 7 in 2024-06-06T02:30:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:40.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:40 smithi184 ceph-mon[36922]: from='osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999]' entity='osd.6' 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] boot 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: osdmap e42: 7 total, 7 up, 7 in 2024-06-06T02:30:41.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:41 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:30:41.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:30:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] boot 2024-06-06T02:30:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: osdmap e42: 7 total, 7 up, 7 in 2024-06-06T02:30:41.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:30:41.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:30:41.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: osd.6 [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] boot 2024-06-06T02:30:41.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: osdmap e42: 7 total, 7 up, 7 in 2024-06-06T02:30:41.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:41 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-06T02:30:41.681 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T02:30:41.764 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T02:30:41.777 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-06-06T02:30:41.777 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-06-06T02:30:41.777 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113493 s, 924 MB/s 2024-06-06T02:30:41.777 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-06-06T02:30:42.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-06-06T02:30:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:42 smithi103 ceph-mon[36349]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:42 smithi103 ceph-mon[36349]: osdmap e43: 7 total, 7 up, 7 in 2024-06-06T02:30:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:42 smithi082 ceph-mon[31579]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:42 smithi082 ceph-mon[31579]: osdmap e43: 7 total, 7 up, 7 in 2024-06-06T02:30:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:42 smithi184 ceph-mon[36922]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-06T02:30:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:42 smithi184 ceph-mon[36922]: osdmap e43: 7 total, 7 up, 7 in 2024-06-06T02:30:42.743 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:30:44.513 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:44 smithi103 ceph-mon[36349]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:44.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 -- 172.21.15.103:0/4226541225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070101c00 msgr2=0x7f8070102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:44.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 --2- 172.21.15.103:0/4226541225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070101c00 0x7f8070102010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8060009ca0 tx=0x7f806002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 -- 172.21.15.103:0/4226541225 shutdown_connections 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 --2- 172.21.15.103:0/4226541225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070103680 0x7f8070109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 --2- 172.21.15.103:0/4226541225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070102d30 0x7f8070103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 --2- 172.21.15.103:0/4226541225 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070101c00 0x7f8070102010 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 -- 172.21.15.103:0/4226541225 >> 172.21.15.103:0/4226541225 conn(0x7f80700fd450 msgr2=0x7f80700ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 -- 172.21.15.103:0/4226541225 shutdown_connections 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.514+0000 7f8075361640 1 -- 172.21.15.103:0/4226541225 wait complete. 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 Processor -- start 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 -- start start 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070101c00 0x7f807006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:44.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070102d30 0x7f807019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d780 con 0x7f8070102d30 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d600 con 0x7f8070103680 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f8075361640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f807010d900 con 0x7f8070101c00 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35030/0 (socket says 172.21.15.103:35030) 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 -- 172.21.15.103:0/3908204338 learned_addr learned my addr 172.21.15.103:0/3908204338 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806effd640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070101c00 0x7f807006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 -- 172.21.15.103:0/3908204338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070101c00 msgr2=0x7f807006ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070101c00 0x7f807006ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 -- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070102d30 msgr2=0x7f807019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.515+0000 7f806f7fe640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070102d30 0x7f807019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f806f7fe640 1 -- 172.21.15.103:0/3908204338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80701a0f90 con 0x7f8070103680 2024-06-06T02:30:44.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f806f7fe640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8068009fd0 tx=0x7f806800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068011830 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8068016070 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701a1280 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068010de0 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.516+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701a17f0 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.517+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8070108d90 con 0x7f8070103680 2024-06-06T02:30:44.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.519+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f80680119d0 con 0x7f8070103680 2024-06-06T02:30:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.520+0000 7f8057fff640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 0x7f80580b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:30:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.520+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f80680e1330 con 0x7f8070103680 2024-06-06T02:30:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.521+0000 7f806effd640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 0x7f80580b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:30:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.522+0000 7f806effd640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 0x7f80580b4d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80600094e0 tx=0x7f8060004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:30:44.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.524+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f80680a9cc0 con 0x7f8070103680 2024-06-06T02:30:44.598 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:44 smithi082 ceph-mon[31579]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:44.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:44 smithi184 ceph-mon[36922]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:44.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:30:44.714+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8070062ba0 con 0x7f80580b2870 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi082 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi082 to 5696M 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:45.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:45 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:46.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi082 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi082 to 5696M 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:46.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:46.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:45 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi082 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi082 to 5696M 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:46.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:30:46.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:45 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/939670836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]': finished 2024-06-06T02:30:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: osdmap e44: 8 total, 7 up, 8 in 2024-06-06T02:30:48.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:30:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/939670836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]': finished 2024-06-06T02:30:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: osdmap e44: 8 total, 7 up, 8 in 2024-06-06T02:30:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/939670836' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]: dispatch 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2"}]': finished 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: osdmap e44: 8 total, 7 up, 8 in 2024-06-06T02:30:48.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:30:49.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:48 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/2602146489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:49.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:48 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/2602146489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:49.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:48 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/2602146489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:30:50.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:49 smithi103 ceph-mon[36349]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:49 smithi082 ceph-mon[31579]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:50.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:49 smithi184 ceph-mon[36922]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:51.981 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:51 smithi103 ceph-mon[36349]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:52.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:51 smithi082 ceph-mon[31579]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:52.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:51 smithi184 ceph-mon[36922]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:53.974 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:53 smithi103 ceph-mon[36349]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:54.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:53 smithi082 ceph-mon[31579]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:53 smithi184 ceph-mon[36922]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:55.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T02:30:55.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:55.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:54 smithi082 ceph-mon[31579]: Deploying daemon osd.7 on smithi103 2024-06-06T02:30:55.087 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T02:30:55.087 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:55.088 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:54 smithi103 ceph-mon[36349]: Deploying daemon osd.7 on smithi103 2024-06-06T02:30:55.151 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-06T02:30:55.151 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:30:55.151 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:54 smithi184 ceph-mon[36922]: Deploying daemon osd.7 on smithi103 2024-06-06T02:30:55.950 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:55 smithi103 ceph-mon[36349]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:56.048 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:55 smithi184 ceph-mon[36922]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:56.054 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:55 smithi082 ceph-mon[31579]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:57 smithi103 ceph-mon[36349]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:58.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:57 smithi082 ceph-mon[31579]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:58.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:57 smithi184 ceph-mon[36922]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:59.832 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:59 smithi103 ceph-mon[36349]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:30:59.832 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:30:59.832 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:30:59.832 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:30:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:59 smithi082 ceph-mon[31579]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:30:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:59 smithi184 ceph-mon[36922]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:30:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:02.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:01 smithi103 ceph-mon[36349]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:01 smithi082 ceph-mon[31579]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:01 smithi184 ceph-mon[36922]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:02.321 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 7 on host 'smithi103' 2024-06-06T02:31:02.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.321+0000 7f8057fff640 1 -- 172.21.15.103:0/3908204338 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8070062ba0 con 0x7f80580b2870 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 msgr2=0x7f80580b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 0x7f80580b4d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80600094e0 tx=0x7f8060004a40 comp rx=0 tx=0).stop 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 msgr2=0x7f80701a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8068009fd0 tx=0x7f806800b8e0 comp rx=0 tx=0).stop 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 shutdown_connections 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8070103680 0x7f80701a0770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8070102d30 0x7f807019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f80580b2870 0x7f80580b4d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 --2- 172.21.15.103:0/3908204338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8070101c00 0x7f807006ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 >> 172.21.15.103:0/3908204338 conn(0x7f80700fd450 msgr2=0x7f8070105f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:31:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 shutdown_connections 2024-06-06T02:31:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:31:02.324+0000 7f8075361640 1 -- 172.21.15.103:0/3908204338 wait complete. 2024-06-06T02:31:02.971 DEBUG:teuthology.orchestra.run.smithi103:osd.7> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.7.service 2024-06-06T02:31:02.974 INFO:tasks.cephadm:Deploying osd.8 on smithi184 with /dev/vg_nvme/lv_2... 2024-06-06T02:31:02.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-06T02:31:03.225 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:31:03.302 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:31:03.020+0000 7feadcd22640 -1 osd.7 0 log_to_monitors true 2024-06-06T02:31:03.583 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.583 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.584 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.584 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.584 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.584 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-06T02:31:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:03.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: osdmap e45: 8 total, 7 up, 8 in 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:04.444 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-mon[36349]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: osdmap e45: 8 total, 7 up, 8 in 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:04.599 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:04 smithi184 ceph-mon[36922]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-06T02:31:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: from='osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: osdmap e45: 8 total, 7 up, 8 in 2024-06-06T02:31:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:04 smithi082 ceph-mon[31579]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:31:05.117 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:31:04.787+0000 7fead8ca5640 -1 osd.7 0 waiting for initial osdmap 2024-06-06T02:31:05.117 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:31:04 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:31:04.798+0000 7fead0aa0640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:31:05.142 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-06T02:31:05.219 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-06T02:31:05.233 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-06-06T02:31:05.233 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-06-06T02:31:05.233 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114516 s, 916 MB/s 2024-06-06T02:31:05.233 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-06-06T02:31:05.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:05 smithi082 ceph-mon[31579]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:05 smithi082 ceph-mon[31579]: osdmap e46: 8 total, 7 up, 8 in 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:05 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:05 smithi082 ceph-mon[31579]: from='osd.7 ' entity='osd.7' 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:05 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:05 smithi103 ceph-mon[36349]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:05 smithi103 ceph-mon[36349]: osdmap e46: 8 total, 7 up, 8 in 2024-06-06T02:31:05.627 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:05 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:05.628 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:05 smithi103 ceph-mon[36349]: from='osd.7 ' entity='osd.7' 2024-06-06T02:31:05.628 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:05 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:05.628 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:05 smithi184 ceph-mon[36922]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:31:05.628 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:05 smithi184 ceph-mon[36922]: osdmap e46: 8 total, 7 up, 8 in 2024-06-06T02:31:05.628 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:05 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:05.629 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:05 smithi184 ceph-mon[36922]: from='osd.7 ' entity='osd.7' 2024-06-06T02:31:05.629 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:05 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:06.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-06-06T02:31:06.245 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] boot 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: osdmap e47: 8 total, 8 up, 8 in 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:06.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:31:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] boot 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: osdmap e47: 8 total, 8 up, 8 in 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: osd.7 [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] boot 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: osdmap e47: 8 total, 8 up, 8 in 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:06.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi103 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi103 to 5696M 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: osdmap e48: 8 total, 8 up, 8 in 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:07.399 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:07.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi103 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi103 to 5696M 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: osdmap e48: 8 total, 8 up, 8 in 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:07.580 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:07 smithi184 ceph-mon[36922]: osdmap e49: 8 total, 8 up, 8 in 2024-06-06T02:31:07.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:07.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:07 smithi082 ceph-mon[31579]: osdmap e49: 8 total, 8 up, 8 in 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi103 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi103 to 5696M 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: osdmap e48: 8 total, 8 up, 8 in 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:07 smithi103 ceph-mon[36349]: osdmap e49: 8 total, 8 up, 8 in 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 -- 172.21.15.184:0/2088529877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b41046e0 msgr2=0x7f46b410afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 --2- 172.21.15.184:0/2088529877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b41046e0 0x7f46b410afe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009ca0 tx=0x7f46ac02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 -- 172.21.15.184:0/2088529877 shutdown_connections 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 --2- 172.21.15.184:0/2088529877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b41046e0 0x7f46b410afe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 --2- 172.21.15.184:0/2088529877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46b4103d90 0x7f46b41041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 --2- 172.21.15.184:0/2088529877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4102c60 0x7f46b4103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 -- 172.21.15.184:0/2088529877 >> 172.21.15.184:0/2088529877 conn(0x7f46b40fe490 msgr2=0x7f46b4100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 -- 172.21.15.184:0/2088529877 shutdown_connections 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.075+0000 7f46ba979640 1 -- 172.21.15.184:0/2088529877 wait complete. 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 Processor -- start 2024-06-06T02:31:08.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 -- start start 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4102c60 0x7f46b4076400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46b41046e0 0x7f46b4074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46b410e7e0 con 0x7f46b4102c60 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f46b410e660 con 0x7f46b41046e0 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.076+0000 7f46ba979640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f46b410e960 con 0x7f46b4103d90 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52122/0 (socket says 172.21.15.184:52122) 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 -- 172.21.15.184:0/768202475 learned_addr learned my addr 172.21.15.184:0/768202475 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 -- 172.21.15.184:0/768202475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46b41046e0 msgr2=0x7f46b4074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46b41046e0 0x7f46b4074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.084 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 -- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4102c60 msgr2=0x7f46b4076400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4102c60 0x7f46b4076400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 -- 172.21.15.184:0/768202475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b4075720 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b37fe640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c890 tx=0x7f46a800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8004220 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a3400 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a80043c0 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8004a00 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.077+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a3930 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.078+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4109df0 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.080+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f46a80079b0 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.081+0000 7f46b17fa640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 0x7f469c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.081+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5397+0+0 (secure 0 0 0) 0x7f46a80e1550 con 0x7f46b4103d90 2024-06-06T02:31:08.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.082+0000 7f46b3fff640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 0x7f469c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:08.086 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.083+0000 7f46b3fff640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 0x7f469c0b4d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46b4103c90 tx=0x7f46a4006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:31:08.086 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.085+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f46a8014030 con 0x7f46b4103d90 2024-06-06T02:31:08.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:08.274+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f46b4062ba0 con 0x7f469c0b27f0 2024-06-06T02:31:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:08 smithi184 ceph-mon[36922]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:08 smithi103 ceph-mon[36349]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:08 smithi082 ceph-mon[31579]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:09.687 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:09 smithi184 ceph-mon[36922]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:09.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:09 smithi103 ceph-mon[36349]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:09.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:09 smithi082 ceph-mon[31579]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:10.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:10 smithi184 ceph-mon[36922]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:10 smithi103 ceph-mon[36349]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:10 smithi082 ceph-mon[31579]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:11.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/4095928712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]': finished 2024-06-06T02:31:11.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: osdmap e50: 9 total, 8 up, 9 in 2024-06-06T02:31:11.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:11.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/2340749615' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/4095928712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]': finished 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: osdmap e50: 9 total, 8 up, 9 in 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/2340749615' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/4095928712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]: dispatch 2024-06-06T02:31:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0"}]': finished 2024-06-06T02:31:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: osdmap e50: 9 total, 8 up, 9 in 2024-06-06T02:31:11.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/2340749615' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:12 smithi103 ceph-mon[36349]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:12.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:12 smithi082 ceph-mon[31579]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:12.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:12 smithi184 ceph-mon[36922]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:14 smithi184 ceph-mon[36922]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-06-06T02:31:14.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:14 smithi103 ceph-mon[36349]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-06-06T02:31:14.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:14 smithi082 ceph-mon[31579]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-06-06T02:31:16.770 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:16 smithi103 ceph-mon[36349]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:16.807 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:16 smithi184 ceph-mon[36922]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:16.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:16 smithi082 ceph-mon[31579]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:18.591 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:18 smithi184 ceph-mon[36922]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-06-06T02:31:18.591 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:18 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T02:31:18.591 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:18 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:18 smithi103 ceph-mon[36349]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-06-06T02:31:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:18 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T02:31:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:18 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:18 smithi082 ceph-mon[31579]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-06-06T02:31:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-06T02:31:18.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:18 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:19.587 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:19 smithi184 ceph-mon[36922]: Deploying daemon osd.8 on smithi184 2024-06-06T02:31:19.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:19 smithi103 ceph-mon[36349]: Deploying daemon osd.8 on smithi184 2024-06-06T02:31:19.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:19 smithi082 ceph-mon[31579]: Deploying daemon osd.8 on smithi184 2024-06-06T02:31:20.858 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:20 smithi184 ceph-mon[36922]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:20 smithi103 ceph-mon[36349]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:20 smithi082 ceph-mon[31579]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:22.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:22 smithi184 ceph-mon[36922]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:22 smithi103 ceph-mon[36349]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:22 smithi082 ceph-mon[31579]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:23.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:23.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:23.835 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:23.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:23.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:23.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:23.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:23.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:23.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:24 smithi103 ceph-mon[36349]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-06T02:31:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:24 smithi082 ceph-mon[31579]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-06T02:31:24.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:24 smithi184 ceph-mon[36922]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-06T02:31:25.772 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:25 smithi082 ceph-mon[31579]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:25.838 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:25 smithi184 ceph-mon[36922]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:25.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:25 smithi103 ceph-mon[36349]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:26.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.700+0000 7f46b17fa640 1 -- 172.21.15.184:0/768202475 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f46b4062ba0 con 0x7f469c0b27f0 2024-06-06T02:31:26.700 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 8 on host 'smithi184' 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 msgr2=0x7f469c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 0x7f469c0b4d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f46b4103c90 tx=0x7f46a4006c90 comp rx=0 tx=0).stop 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 msgr2=0x7f46b4074ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f46a800c890 tx=0x7f46a800cd50 comp rx=0 tx=0).stop 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 shutdown_connections 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46b41046e0 0x7f46b4074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f469c0b27f0 0x7f469c0b4d00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:26.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46b4103d90 0x7f46b4074ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:26.703 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 --2- 172.21.15.184:0/768202475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46b4102c60 0x7f46b4076400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:26.703 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.702+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 >> 172.21.15.184:0/768202475 conn(0x7f46b40fe490 msgr2=0x7f46b4106fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:31:26.703 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.703+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 shutdown_connections 2024-06-06T02:31:26.703 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:31:26.703+0000 7f46ba979640 1 -- 172.21.15.184:0/768202475 wait complete. 2024-06-06T02:31:27.448 DEBUG:teuthology.orchestra.run.smithi184:osd.8> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.8.service 2024-06-06T02:31:27.451 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-06-06T02:31:27.451 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:27.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:27.896 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:31:28.056 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.056 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:28.056 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.057 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:28.057 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:28.057 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.057 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:29.059 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-mon[36922]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T02:31:29.059 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-mon[36922]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.060 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-mon[36922]: osdmap e51: 9 total, 8 up, 9 in 2024-06-06T02:31:29.060 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:29.060 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-mon[36922]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.060 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8[55301]: 2024-06-06T02:31:28.720+0000 7fb4c8753640 -1 osd.8 0 waiting for initial osdmap 2024-06-06T02:31:29.060 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:31:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8[55301]: 2024-06-06T02:31:28.731+0000 7fb4c4556640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:31:29.081 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:28 smithi082 ceph-mon[31579]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T02:31:29.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:28 smithi082 ceph-mon[31579]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:28 smithi082 ceph-mon[31579]: osdmap e51: 9 total, 8 up, 9 in 2024-06-06T02:31:29.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:29.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:28 smithi082 ceph-mon[31579]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:28 smithi103 ceph-mon[36349]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-06T02:31:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:28 smithi103 ceph-mon[36349]: from='osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:28 smithi103 ceph-mon[36349]: osdmap e51: 9 total, 8 up, 9 in 2024-06-06T02:31:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:28 smithi103 ceph-mon[36349]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:31:29.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:29 smithi184 ceph-mon[36922]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:29 smithi184 ceph-mon[36922]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:31:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:29 smithi184 ceph-mon[36922]: osdmap e52: 9 total, 8 up, 9 in 2024-06-06T02:31:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:30.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:29 smithi082 ceph-mon[31579]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:30.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:29 smithi082 ceph-mon[31579]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:31:30.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:29 smithi082 ceph-mon[31579]: osdmap e52: 9 total, 8 up, 9 in 2024-06-06T02:31:30.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:30.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:29 smithi103 ceph-mon[36349]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-06-06T02:31:30.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:29 smithi103 ceph-mon[36349]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:31:30.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:29 smithi103 ceph-mon[36349]: osdmap e52: 9 total, 8 up, 9 in 2024-06-06T02:31:30.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T02:31:30.693 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T02:31:30.735 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-06-06T02:31:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-06-06T02:31:30.735 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0347452 s, 302 MB/s 2024-06-06T02:31:30.736 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-06-06T02:31:30.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:31:30.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:31:30.774 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] boot 2024-06-06T02:31:30.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: osdmap e53: 9 total, 9 up, 9 in 2024-06-06T02:31:30.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:30.775 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:30 smithi082 ceph-mon[31579]: osdmap e54: 9 total, 9 up, 9 in 2024-06-06T02:31:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:31:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:31:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] boot 2024-06-06T02:31:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: osdmap e53: 9 total, 9 up, 9 in 2024-06-06T02:31:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:30 smithi184 ceph-mon[36922]: osdmap e54: 9 total, 9 up, 9 in 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: osd.8 [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] boot 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: osdmap e53: 9 total, 9 up, 9 in 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-06T02:31:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:30 smithi103 ceph-mon[36349]: osdmap e54: 9 total, 9 up, 9 in 2024-06-06T02:31:31.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-06-06T02:31:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:31:32.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:32.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi184 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi184 to 5696M 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:32.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:32 smithi184 ceph-mon[36922]: osdmap e55: 9 total, 9 up, 9 in 2024-06-06T02:31:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi184 2024-06-06T02:31:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.481 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi184 to 5696M 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.482 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.483 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:32 smithi082 ceph-mon[31579]: osdmap e55: 9 total, 9 up, 9 in 2024-06-06T02:31:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi184 2024-06-06T02:31:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi184 to 5696M 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:31:32.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:32.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:32 smithi103 ceph-mon[36349]: osdmap e55: 9 total, 9 up, 9 in 2024-06-06T02:31:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.312+0000 7fa59b200640 1 -- 172.21.15.82:0/716827902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c105de0 msgr2=0x7fa59c1061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.312+0000 7fa59b200640 1 --2- 172.21.15.82:0/716827902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c105de0 0x7fa59c1061f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa588009900 tx=0x7fa58802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 -- 172.21.15.82:0/716827902 shutdown_connections 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 --2- 172.21.15.82:0/716827902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 0x7fa59c10d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 --2- 172.21.15.82:0/716827902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c105de0 0x7fa59c1061f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 --2- 172.21.15.82:0/716827902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c104cb0 0x7fa59c1050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 -- 172.21.15.82:0/716827902 >> 172.21.15.82:0/716827902 conn(0x7fa59c100500 msgr2=0x7fa59c102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 -- 172.21.15.82:0/716827902 shutdown_connections 2024-06-06T02:31:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.313+0000 7fa59b200640 1 -- 172.21.15.82:0/716827902 wait complete. 2024-06-06T02:31:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.314+0000 7fa59b200640 1 Processor -- start 2024-06-06T02:31:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.314+0000 7fa59b200640 1 -- start start 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c105de0 0x7fa59c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 0x7fa59c1a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c1107e0 con 0x7fa59c104cb0 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c110660 con 0x7fa59c105de0 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c110960 con 0x7fa59c106730 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa599e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa599400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c105de0 0x7fa59c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa599e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44238/0 (socket says 172.21.15.82:44238) 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa599e00640 1 -- 172.21.15.82:0/1547968065 learned_addr learned my addr 172.21.15.82:0/1547968065 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:31:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.315+0000 7fa59a800640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 0x7fa59c1a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 -- 172.21.15.82:0/1547968065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 msgr2=0x7fa59c1a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 0x7fa59c1a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 -- 172.21.15.82:0/1547968065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c105de0 msgr2=0x7fa59c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:31:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c105de0 0x7fa59c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:31:34.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 -- 172.21.15.82:0/1547968065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c1a2ee0 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa599e00640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e9c0 tx=0x7fa58c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00cd80 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa58c0054d0 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c1a31d0 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.316+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c010430 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.317+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c1a3710 con 0x7fa59c104cb0 2024-06-06T02:31:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.318+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c10beb0 con 0x7fa59c104cb0 2024-06-06T02:31:34.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.320+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa58c004fd0 con 0x7fa59c104cb0 2024-06-06T02:31:34.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.322+0000 7fa592a00640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 0x7fa5800b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:31:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.322+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5829+0+0 (secure 0 0 0) 0x7fa58c0e1d40 con 0x7fa59c104cb0 2024-06-06T02:31:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.322+0000 7fa599400640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 0x7fa5800b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:31:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.323+0000 7fa599400640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 0x7fa5800b4d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa588009230 tx=0x7fa588031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:31:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.324+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa58c0aa370 con 0x7fa59c104cb0 2024-06-06T02:31:34.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:34 smithi082 ceph-mon[31579]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:34.420 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:34 smithi103 ceph-mon[36349]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:34.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:31:34.540+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa59c062ba0 con 0x7fa5800b27f0 2024-06-06T02:31:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:34 smithi184 ceph-mon[36922]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:35.432 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:35.432 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:35.432 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:35.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:35.616 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:35.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:35.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:31:35.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:31:35.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:36.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:36 smithi082 ceph-mon[31579]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:36.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:36 smithi082 ceph-mon[31579]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:36 smithi103 ceph-mon[36349]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:36 smithi103 ceph-mon[36349]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:36 smithi184 ceph-mon[36922]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:31:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:36 smithi184 ceph-mon[36922]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:38 smithi082 ceph-mon[31579]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-06T02:31:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:38 smithi103 ceph-mon[36349]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-06T02:31:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:38 smithi184 ceph-mon[36922]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-06-06T02:31:39.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:39 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1358768562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:39 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:39 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]': finished 2024-06-06T02:31:39.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:39 smithi082 ceph-mon[31579]: osdmap e56: 10 total, 9 up, 10 in 2024-06-06T02:31:39.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:31:39.455 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:39 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1358768562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.455 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:39 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.455 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:39 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]': finished 2024-06-06T02:31:39.455 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:39 smithi184 ceph-mon[36922]: osdmap e56: 10 total, 9 up, 10 in 2024-06-06T02:31:39.455 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:31:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:39 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1358768562' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:39 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]: dispatch 2024-06-06T02:31:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:39 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e0ab7ce-21f3-4c86-a051-c7e28dfd8069"}]': finished 2024-06-06T02:31:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:39 smithi103 ceph-mon[36349]: osdmap e56: 10 total, 9 up, 10 in 2024-06-06T02:31:39.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:31:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:40 smithi103 ceph-mon[36349]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:40 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1680431204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:40 smithi082 ceph-mon[31579]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:40 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1680431204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:40 smithi184 ceph-mon[36922]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-06T02:31:40.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:40 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1680431204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:31:42.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:42 smithi082 ceph-mon[31579]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-06-06T02:31:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:42 smithi103 ceph-mon[36349]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-06-06T02:31:42.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:42 smithi184 ceph-mon[36922]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-06-06T02:31:44.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:44 smithi082 ceph-mon[31579]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:44.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:44 smithi103 ceph-mon[36349]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:44.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:44 smithi184 ceph-mon[36922]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:46.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:46 smithi082 ceph-mon[31579]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:46 smithi103 ceph-mon[36349]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:46.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:46 smithi184 ceph-mon[36922]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:31:48.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:48 smithi082 ceph-mon[31579]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:48.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T02:31:48.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:48 smithi103 ceph-mon[36349]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T02:31:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:48 smithi184 ceph-mon[36922]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-06T02:31:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:31:49.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:49 smithi103 ceph-mon[36349]: Deploying daemon osd.9 on smithi082 2024-06-06T02:31:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:49 smithi082 ceph-mon[31579]: Deploying daemon osd.9 on smithi082 2024-06-06T02:31:49.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:49 smithi184 ceph-mon[36922]: Deploying daemon osd.9 on smithi082 2024-06-06T02:31:50.609 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:50 smithi082 ceph-mon[31579]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:50 smithi103 ceph-mon[36349]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:50.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:50 smithi184 ceph-mon[36922]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:52 smithi103 ceph-mon[36349]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:52.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:52 smithi082 ceph-mon[31579]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:52.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:52 smithi184 ceph-mon[36922]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:54.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:54 smithi082 ceph-mon[31579]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:54 smithi103 ceph-mon[36349]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:54 smithi184 ceph-mon[36922]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:56.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:56 smithi184 ceph-mon[36922]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:56.548 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:56 smithi082 ceph-mon[31579]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:56 smithi103 ceph-mon[36349]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:57.496 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:57.496 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:57.496 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:57 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:57.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:57.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:57.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:57 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:57.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:31:57.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:57.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:57 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:31:58.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:31:58 smithi082 ceph-mon[31579]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:31:58 smithi103 ceph-mon[36349]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:31:58.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:31:58 smithi184 ceph-mon[36922]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:00 smithi103 ceph-mon[36349]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:00 smithi082 ceph-mon[31579]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:00 smithi184 ceph-mon[36922]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:02.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:02.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:02.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:02.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:01 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:02.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:02.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:01 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:02.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:02.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:01 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:02.431 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-06-06T02:32:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.431+0000 7fa592a00640 1 -- 172.21.15.82:0/1547968065 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa59c062ba0 con 0x7fa5800b27f0 2024-06-06T02:32:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.435+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 msgr2=0x7fa5800b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.435+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 0x7fa5800b4d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa588009230 tx=0x7fa588031400 comp rx=0 tx=0).stop 2024-06-06T02:32:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.435+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 msgr2=0x7fa59c19b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.435+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e9c0 tx=0x7fa58c00ee80 comp rx=0 tx=0).stop 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 shutdown_connections 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5800b27f0 0x7fa5800b4d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa59c106730 0x7fa59c1a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa59c105de0 0x7fa59c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 --2- 172.21.15.82:0/1547968065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa59c104cb0 0x7fa59c19b3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 >> 172.21.15.82:0/1547968065 conn(0x7fa59c100500 msgr2=0x7fa59c109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 shutdown_connections 2024-06-06T02:32:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:02.436+0000 7fa59b200640 1 -- 172.21.15.82:0/1547968065 wait complete. 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: osdmap e57: 10 total, 9 up, 10 in 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T02:32:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: osdmap e57: 10 total, 9 up, 10 in 2024-06-06T02:32:03.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.241 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.9.service 2024-06-06T02:32:03.247 INFO:tasks.cephadm:Deploying osd.10 on smithi103 with /dev/vg_nvme/lv_1... 2024-06-06T02:32:03.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T02:32:03.274 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-06T02:32:03.274 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.274 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: osdmap e57: 10 total, 9 up, 10 in 2024-06-06T02:32:03.275 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:03.275 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-06-06T02:32:03.275 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:03.275 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.275 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:03.494 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:32:04.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:03 smithi082 ceph-mon[31579]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:03 smithi082 ceph-mon[31579]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:32:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:03 smithi082 ceph-mon[31579]: osdmap e58: 10 total, 9 up, 10 in 2024-06-06T02:32:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:04.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:03 smithi103 ceph-mon[36349]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:03 smithi103 ceph-mon[36349]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:32:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:03 smithi103 ceph-mon[36349]: osdmap e58: 10 total, 9 up, 10 in 2024-06-06T02:32:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:03 smithi184 ceph-mon[36922]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:03 smithi184 ceph-mon[36922]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-06-06T02:32:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:03 smithi184 ceph-mon[36922]: osdmap e58: 10 total, 9 up, 10 in 2024-06-06T02:32:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:04 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:32:05.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:04 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:32:05.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:04 smithi082 ceph-mon[31579]: osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] boot 2024-06-06T02:32:05.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:04 smithi082 ceph-mon[31579]: osdmap e59: 10 total, 10 up, 10 in 2024-06-06T02:32:05.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:05.221 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:04 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:32:05.222 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:04 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:32:05.222 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:04 smithi103 ceph-mon[36349]: osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] boot 2024-06-06T02:32:05.222 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:04 smithi103 ceph-mon[36349]: osdmap e59: 10 total, 10 up, 10 in 2024-06-06T02:32:05.222 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:05.394 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:04 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:04 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:04 smithi184 ceph-mon[36922]: osd.9 [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] boot 2024-06-06T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:04 smithi184 ceph-mon[36922]: osdmap e59: 10 total, 10 up, 10 in 2024-06-06T02:32:05.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-06T02:32:05.500 INFO:teuthology.orchestra.run.smithi103.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T02:32:05.519 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10+0 records in 2024-06-06T02:32:05.519 INFO:teuthology.orchestra.run.smithi103.stderr:10+0 records out 2024-06-06T02:32:05.519 INFO:teuthology.orchestra.run.smithi103.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0165941 s, 632 MB/s 2024-06-06T02:32:05.519 INFO:teuthology.orchestra.run.smithi103.stderr:--> Zapping successful for: 2024-06-06T02:32:06.175 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:05 smithi103 ceph-mon[36349]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:06.175 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:05 smithi103 ceph-mon[36349]: osdmap e60: 10 total, 10 up, 10 in 2024-06-06T02:32:06.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-06-06T02:32:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:05 smithi082 ceph-mon[31579]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:06.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:05 smithi082 ceph-mon[31579]: osdmap e60: 10 total, 10 up, 10 in 2024-06-06T02:32:06.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:05 smithi184 ceph-mon[36922]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-06-06T02:32:06.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:05 smithi184 ceph-mon[36922]: osdmap e60: 10 total, 10 up, 10 in 2024-06-06T02:32:06.478 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:32:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- 172.21.15.103:0/2891769357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 msgr2=0x7f6690108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 --2- 172.21.15.103:0/2891769357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690108580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6684009900 tx=0x7f668402a410 comp rx=0 tx=0).stop 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- 172.21.15.103:0/2891769357 shutdown_connections 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 --2- 172.21.15.103:0/2891769357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6690108ac0 0x7f669010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 --2- 172.21.15.103:0/2891769357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690108580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 --2- 172.21.15.103:0/2891769357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 0x7f6690105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- 172.21.15.103:0/2891769357 >> 172.21.15.103:0/2891769357 conn(0x7f66900fd450 msgr2=0x7f66900ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- 172.21.15.103:0/2891769357 shutdown_connections 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- 172.21.15.103:0/2891769357 wait complete. 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 Processor -- start 2024-06-06T02:32:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.081+0000 7f66962b2640 1 -- start start 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 0x7f6690103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6690108ac0 0x7f6690101c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f669010e8b0 con 0x7f6690108ac0 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f669010e730 con 0x7f6690106160 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f66962b2640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f669010ea30 con 0x7f6690103800 2024-06-06T02:32:08.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34268/0 (socket says 172.21.15.103:34268) 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 -- 172.21.15.103:0/221864284 learned_addr learned my addr 172.21.15.103:0/221864284 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668ffff640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 0x7f6690103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 -- 172.21.15.103:0/221864284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 msgr2=0x7f6690103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 0x7f6690103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 -- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6690108ac0 msgr2=0x7f6690101c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6690108ac0 0x7f6690101c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.082+0000 7f668f7fe640 1 -- 172.21.15.103:0/221864284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6690102380 con 0x7f6690106160 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f668f7fe640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6684006010 tx=0x7f6684031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668403f030 con 0x7f6690106160 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6684003aa0 con 0x7f6690106160 2024-06-06T02:32:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66901a3570 con 0x7f6690106160 2024-06-06T02:32:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684035070 con 0x7f6690106160 2024-06-06T02:32:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.083+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901a39e0 con 0x7f6690106160 2024-06-06T02:32:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.084+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6690106570 con 0x7f6690106160 2024-06-06T02:32:08.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.085+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6684042030 con 0x7f6690106160 2024-06-06T02:32:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.086+0000 7f668d7fa640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 0x7f66780b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.086+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6261+0+0 (secure 0 0 0) 0x7f6684102680 con 0x7f6690106160 2024-06-06T02:32:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.086+0000 7f668ffff640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 0x7f66780b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.088+0000 7f668ffff640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 0x7f66780b4d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f669006ba30 tx=0x7f6680005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:08.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.089+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f66840caba0 con 0x7f6690106160 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:08.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:08.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:07 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:08.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:08.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:07 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:08.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:07 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:08.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:08.281+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6690062c60 con 0x7f66780b27f0 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi082 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi082 to 4272M 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:08.966 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:08 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:09.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi082 2024-06-06T02:32:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi082 to 4272M 2024-06-06T02:32:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:08 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi082 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi082 to 4272M 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:09.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:08 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:10.051 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:09 smithi103 ceph-mon[36349]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:10.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:09 smithi082 ceph-mon[31579]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:10.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:09 smithi184 ceph-mon[36922]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:10 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/1717684361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:10 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:10 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]': finished 2024-06-06T02:32:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:10 smithi103 ceph-mon[36349]: osdmap e61: 11 total, 10 up, 11 in 2024-06-06T02:32:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:10 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:10 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/1717684361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:10 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:10 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]': finished 2024-06-06T02:32:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:10 smithi082 ceph-mon[31579]: osdmap e61: 11 total, 10 up, 11 in 2024-06-06T02:32:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:10 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:10 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/1717684361' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:10 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]: dispatch 2024-06-06T02:32:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:10 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "077d6b20-a049-43e8-bdab-9683e568ff7c"}]': finished 2024-06-06T02:32:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:10 smithi184 ceph-mon[36922]: osdmap e61: 11 total, 10 up, 11 in 2024-06-06T02:32:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:10 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:12.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:11 smithi103 ceph-mon[36349]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:12.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.103:0/1071266564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:11 smithi082 ceph-mon[31579]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.103:0/1071266564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:12.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:11 smithi184 ceph-mon[36922]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:12.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.103:0/1071266564' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:14.318 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:13 smithi103 ceph-mon[36349]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:13 smithi082 ceph-mon[31579]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:14.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:13 smithi184 ceph-mon[36922]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:16.037 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:15 smithi103 ceph-mon[36349]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:16.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:15 smithi082 ceph-mon[31579]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:16.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:15 smithi184 ceph-mon[36922]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:18.250 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:17 smithi103 ceph-mon[36349]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:18.250 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:17 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T02:32:18.250 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:17 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:17 smithi082 ceph-mon[31579]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:17 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T02:32:18.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:17 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:17 smithi184 ceph-mon[36922]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:17 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-06T02:32:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:17 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:19.307 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:18 smithi103 ceph-mon[36349]: Deploying daemon osd.10 on smithi103 2024-06-06T02:32:19.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:18 smithi082 ceph-mon[31579]: Deploying daemon osd.10 on smithi103 2024-06-06T02:32:19.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:18 smithi184 ceph-mon[36922]: Deploying daemon osd.10 on smithi103 2024-06-06T02:32:20.237 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:19 smithi103 ceph-mon[36349]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:20.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:19 smithi082 ceph-mon[31579]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:20.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:19 smithi184 ceph-mon[36922]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:22.298 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:21 smithi103 ceph-mon[36349]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:22.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:21 smithi082 ceph-mon[31579]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:21 smithi184 ceph-mon[36922]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:23.329 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:23.329 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:23.329 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:23.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:23.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:23.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:24.289 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:24 smithi103 ceph-mon[36349]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:24 smithi082 ceph-mon[31579]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:24.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:24 smithi184 ceph-mon[36922]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:26.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:26.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:26.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:26.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:26.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.535+0000 7f668d7fa640 1 -- 172.21.15.103:0/221864284 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6690062c60 con 0x7f66780b27f0 2024-06-06T02:32:26.536 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 10 on host 'smithi103' 2024-06-06T02:32:26.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 msgr2=0x7f66780b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:26.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 0x7f66780b4d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f669006ba30 tx=0x7f6680005f90 comp rx=0 tx=0).stop 2024-06-06T02:32:26.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 msgr2=0x7f6690101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:26.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6684006010 tx=0x7f6684031a50 comp rx=0 tx=0).stop 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 shutdown_connections 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6690108ac0 0x7f6690101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6690106160 0x7f6690101710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f66780b27f0 0x7f66780b4d00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 --2- 172.21.15.103:0/221864284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6690103800 0x7f6690103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 >> 172.21.15.103:0/221864284 conn(0x7f66900fd450 msgr2=0x7f66901043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 shutdown_connections 2024-06-06T02:32:26.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-06-06T02:32:26.538+0000 7f66962b2640 1 -- 172.21.15.103:0/221864284 wait complete. 2024-06-06T02:32:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:27 smithi103 ceph-mon[36349]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:27 smithi103 ceph-mon[36349]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.222 DEBUG:teuthology.orchestra.run.smithi103:osd.10> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.10.service 2024-06-06T02:32:27.225 INFO:tasks.cephadm:Deploying osd.11 on smithi184 with /dev/vg_nvme/lv_1... 2024-06-06T02:32:27.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-06T02:32:27.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:27.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:27 smithi082 ceph-mon[31579]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:27 smithi082 ceph-mon[31579]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:27.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:27.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:27 smithi184 ceph-mon[36922]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:27 smithi184 ceph-mon[36922]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-06T02:32:27.464 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: osdmap e62: 11 total, 10 up, 11 in 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:28.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-mon[36349]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:28.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T02:32:28.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: osdmap e62: 11 total, 10 up, 11 in 2024-06-06T02:32:28.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:28.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:28 smithi082 ceph-mon[31579]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-06T02:32:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: from='osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: osdmap e62: 11 total, 10 up, 11 in 2024-06-06T02:32:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:28 smithi184 ceph-mon[36922]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-06-06T02:32:28.706 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:32:28.548+0000 7f516dd66640 -1 osd.10 0 waiting for initial osdmap 2024-06-06T02:32:28.706 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:32:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:32:28.559+0000 7f5169b69640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:32:29.283 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-06T02:32:29.362 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-06T02:32:29.376 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-06-06T02:32:29.376 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-06-06T02:32:29.376 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115452 s, 908 MB/s 2024-06-06T02:32:29.376 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-06-06T02:32:29.729 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:32:29.729 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: osdmap e63: 11 total, 10 up, 11 in 2024-06-06T02:32:29.729 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.729 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.729 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] boot 2024-06-06T02:32:29.730 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: osdmap e64: 11 total, 11 up, 11 in 2024-06-06T02:32:29.730 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.730 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:29 smithi103 ceph-mon[36349]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:29.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: osdmap e63: 11 total, 10 up, 11 in 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] boot 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: osdmap e64: 11 total, 11 up, 11 in 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:29 smithi082 ceph-mon[31579]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:29.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-06-06T02:32:29.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: osdmap e63: 11 total, 10 up, 11 in 2024-06-06T02:32:29.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: osd.10 [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] boot 2024-06-06T02:32:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: osdmap e64: 11 total, 11 up, 11 in 2024-06-06T02:32:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-06T02:32:29.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:29 smithi184 ceph-mon[36922]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-06T02:32:30.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2024-06-06T02:32:30.306 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: osdmap e65: 11 total, 11 up, 11 in 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi103 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi103 to 4272M 2024-06-06T02:32:30.756 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:30.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:30.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:30.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:30 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:32:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:32:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: osdmap e65: 11 total, 11 up, 11 in 2024-06-06T02:32:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi103 2024-06-06T02:32:31.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi103 to 4272M 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:30 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: osdmap e65: 11 total, 11 up, 11 in 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi103 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi103 to 4272M 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:31.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:30 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:31.797 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:31 smithi184 ceph-mon[36922]: osdmap e66: 11 total, 11 up, 11 in 2024-06-06T02:32:31.798 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:31 smithi184 ceph-mon[36922]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:32.024 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 -- 172.21.15.184:0/1765152089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac103d90 msgr2=0x7f45ac1041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:32.024 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 --2- 172.21.15.184:0/1765152089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac103d90 0x7f45ac1041a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009900 tx=0x7f45a002a410 comp rx=0 tx=0).stop 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 -- 172.21.15.184:0/1765152089 shutdown_connections 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 --2- 172.21.15.184:0/1765152089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45ac1046e0 0x7f45ac10afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 --2- 172.21.15.184:0/1765152089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac103d90 0x7f45ac1041a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 --2- 172.21.15.184:0/1765152089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 0x7f45ac103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 -- 172.21.15.184:0/1765152089 >> 172.21.15.184:0/1765152089 conn(0x7f45ac0fe490 msgr2=0x7f45ac100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 -- 172.21.15.184:0/1765152089 shutdown_connections 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.023+0000 7f45b2339640 1 -- 172.21.15.184:0/1765152089 wait complete. 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 Processor -- start 2024-06-06T02:32:32.025 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 -- start start 2024-06-06T02:32:32.027 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 0x7f45ac1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:32.027 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45ac103d90 0x7f45ac199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:32.027 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:32.027 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac10e800 con 0x7f45ac103d90 2024-06-06T02:32:32.027 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac10e680 con 0x7f45ac102c60 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.024+0000 7f45b2339640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac10e980 con 0x7f45ac1046e0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:34788/0 (socket says 172.21.15.184:34788) 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 -- 172.21.15.184:0/234530520 learned_addr learned my addr 172.21.15.184:0/234530520 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45abfff640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 0x7f45ac1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 -- 172.21.15.184:0/234530520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 msgr2=0x7f45ac1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 0x7f45ac1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 -- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45ac103d90 msgr2=0x7f45ac199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45ac103d90 0x7f45ac199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 -- 172.21.15.184:0/234530520 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ac1a0ee0 con 0x7f45ac1046e0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b08d6640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45a400b970 tx=0x7f45a400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4019070 con 0x7f45ac1046e0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45a4014440 con 0x7f45ac1046e0 2024-06-06T02:32:32.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ac1a11d0 con 0x7f45ac1046e0 2024-06-06T02:32:32.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a40075d0 con 0x7f45ac1046e0 2024-06-06T02:32:32.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.025+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ac1a1740 con 0x7f45ac1046e0 2024-06-06T02:32:32.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.026+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ac109e60 con 0x7f45ac1046e0 2024-06-06T02:32:32.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.028+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f45a401c070 con 0x7f45ac1046e0 2024-06-06T02:32:32.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.028+0000 7f45a97fa640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 0x7f45940b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:32.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.028+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6694+0+0 (secure 0 0 0) 0x7f45a40e1700 con 0x7f45ac1046e0 2024-06-06T02:32:32.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.029+0000 7f45abfff640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 0x7f45940b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:32.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.030+0000 7f45abfff640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 0x7f45940b4d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f459c005fd0 tx=0x7f459c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:32.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.032+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f45a40a9a70 con 0x7f45ac1046e0 2024-06-06T02:32:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:31 smithi103 ceph-mon[36349]: osdmap e66: 11 total, 11 up, 11 in 2024-06-06T02:32:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:31 smithi103 ceph-mon[36349]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:31 smithi082 ceph-mon[31579]: osdmap e66: 11 total, 11 up, 11 in 2024-06-06T02:32:32.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:31 smithi082 ceph-mon[31579]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:32.226 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:32.225+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f45ac062ba0 con 0x7f45940b27f0 2024-06-06T02:32:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:32 smithi184 ceph-mon[36922]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:32 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:33.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:32 smithi103 ceph-mon[36349]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:33.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:33.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:33.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:32 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:32 smithi082 ceph-mon[31579]: from='client.24547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:32:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-06T02:32:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-06T02:32:33.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:32 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:33.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:33 smithi184 ceph-mon[36922]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-06T02:32:34.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:33 smithi103 ceph-mon[36349]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-06T02:32:34.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:33 smithi082 ceph-mon[31579]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-06-06T02:32:35.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:34 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/2959027352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:34 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:34 smithi184 ceph-mon[36922]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]': finished 2024-06-06T02:32:35.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:34 smithi184 ceph-mon[36922]: osdmap e67: 12 total, 11 up, 12 in 2024-06-06T02:32:35.076 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:35.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:34 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/2959027352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:34 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:34 smithi103 ceph-mon[36349]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]': finished 2024-06-06T02:32:35.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:34 smithi103 ceph-mon[36349]: osdmap e67: 12 total, 11 up, 12 in 2024-06-06T02:32:35.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:34 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/2959027352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:34 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]: dispatch 2024-06-06T02:32:35.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:34 smithi082 ceph-mon[31579]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f20b235-215a-43d5-af49-13634a770b8d"}]': finished 2024-06-06T02:32:35.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:34 smithi082 ceph-mon[31579]: osdmap e67: 12 total, 11 up, 12 in 2024-06-06T02:32:35.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:35 smithi103 ceph-mon[36349]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:32:36.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:35 smithi103 ceph-mon[36349]: from='client.? 172.21.15.184:0/4102562854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:36.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:35 smithi082 ceph-mon[31579]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:32:36.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:35 smithi082 ceph-mon[31579]: from='client.? 172.21.15.184:0/4102562854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:36.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:35 smithi184 ceph-mon[36922]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-06-06T02:32:36.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:35 smithi184 ceph-mon[36922]: from='client.? 172.21.15.184:0/4102562854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-06T02:32:38.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:37 smithi103 ceph-mon[36349]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-06T02:32:38.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:37 smithi082 ceph-mon[31579]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-06T02:32:38.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:37 smithi184 ceph-mon[36922]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-06T02:32:40.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:39 smithi103 ceph-mon[36349]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T02:32:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:39 smithi082 ceph-mon[31579]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T02:32:40.140 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:39 smithi184 ceph-mon[36922]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-06-06T02:32:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:41 smithi103 ceph-mon[36349]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:32:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:41 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T02:32:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:41 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:41 smithi082 ceph-mon[31579]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:32:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T02:32:42.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:41 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:41 smithi184 ceph-mon[36922]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-06T02:32:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:41 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-06T02:32:42.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:41 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:43.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:42 smithi103 ceph-mon[36349]: Deploying daemon osd.11 on smithi184 2024-06-06T02:32:43.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:42 smithi082 ceph-mon[31579]: Deploying daemon osd.11 on smithi184 2024-06-06T02:32:43.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:42 smithi184 ceph-mon[36922]: Deploying daemon osd.11 on smithi184 2024-06-06T02:32:44.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:43 smithi103 ceph-mon[36349]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:44.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:43 smithi082 ceph-mon[31579]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:44.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:43 smithi184 ceph-mon[36922]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:46.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:45 smithi103 ceph-mon[36349]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:46.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:45 smithi082 ceph-mon[31579]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:46.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:45 smithi184 ceph-mon[36922]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:47.962 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:47 smithi184 ceph-mon[36922]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:47.963 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:47.963 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:47.963 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:47 smithi103 ceph-mon[36349]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:48.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:47 smithi082 ceph-mon[31579]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:48.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:50.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:49 smithi103 ceph-mon[36349]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:50.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:49 smithi082 ceph-mon[31579]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:50.141 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:49 smithi184 ceph-mon[36922]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:50.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.852+0000 7f45a97fa640 1 -- 172.21.15.184:0/234530520 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f45ac062ba0 con 0x7f45940b27f0 2024-06-06T02:32:50.852 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 11 on host 'smithi184' 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 msgr2=0x7f45940b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 0x7f45940b4d00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f459c005fd0 tx=0x7f459c005850 comp rx=0 tx=0).stop 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 msgr2=0x7f45ac1a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45a400b970 tx=0x7f45a400be30 comp rx=0 tx=0).stop 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 shutdown_connections 2024-06-06T02:32:50.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f45940b27f0 0x7f45940b4d00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45ac1046e0 0x7f45ac1a08a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45ac103d90 0x7f45ac199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.854+0000 7f45b2339640 1 --2- 172.21.15.184:0/234530520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45ac102c60 0x7f45ac1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.855+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 >> 172.21.15.184:0/234530520 conn(0x7f45ac0fe490 msgr2=0x7f45ac107030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.855+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 shutdown_connections 2024-06-06T02:32:50.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:32:50.855+0000 7f45b2339640 1 -- 172.21.15.184:0/234530520 wait complete. 2024-06-06T02:32:51.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:51.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:51 smithi184 ceph-mon[36922]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:51.560 DEBUG:teuthology.orchestra.run.smithi184:osd.11> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.11.service 2024-06-06T02:32:51.563 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-06T02:32:51.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:51.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:51.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:51 smithi103 ceph-mon[36349]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:32:51.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:51.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:51.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:51 smithi082 ceph-mon[31579]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-06T02:32:52.022 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: osdmap e68: 12 total, 11 up, 12 in 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:52.452 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-mon[36922]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: osdmap e68: 12 total, 11 up, 12 in 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:52.505 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:52 smithi082 ceph-mon[31579]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: osdmap e68: 12 total, 11 up, 12 in 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: from='osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:52 smithi103 ceph-mon[36349]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-06-06T02:32:53.077 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:32:52.855+0000 7ff369c08640 -1 osd.11 0 waiting for initial osdmap 2024-06-06T02:32:53.077 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:32:52 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:32:52.866+0000 7ff365a0b640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-06T02:32:54.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:53 smithi103 ceph-mon[36349]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:54.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:53 smithi103 ceph-mon[36349]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:32:54.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:53 smithi103 ceph-mon[36349]: osdmap e69: 12 total, 11 up, 12 in 2024-06-06T02:32:54.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:53 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:54.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:53 smithi082 ceph-mon[31579]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:54.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:53 smithi082 ceph-mon[31579]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:32:54.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:53 smithi082 ceph-mon[31579]: osdmap e69: 12 total, 11 up, 12 in 2024-06-06T02:32:54.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:53 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:53 smithi184 ceph-mon[36922]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-06T02:32:54.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:53 smithi184 ceph-mon[36922]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-06-06T02:32:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:53 smithi184 ceph-mon[36922]: osdmap e69: 12 total, 11 up, 12 in 2024-06-06T02:32:54.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:53 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 -- 172.21.15.82:0/587312382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10076680 msgr2=0x7f4b10074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/587312382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10076680 0x7f4b10074b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009900 tx=0x7f4b0002a410 comp rx=0 tx=0).stop 2024-06-06T02:32:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 -- 172.21.15.82:0/587312382 shutdown_connections 2024-06-06T02:32:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/587312382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b1010a920 0x7f4b1010ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/587312382 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 0x7f4b100754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/587312382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b10076680 0x7f4b10074b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.334+0000 7f4b0fe00640 1 -- 172.21.15.82:0/587312382 >> 172.21.15.82:0/587312382 conn(0x7f4b100fe2a0 msgr2=0x7f4b10100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.335+0000 7f4b0fe00640 1 -- 172.21.15.82:0/587312382 shutdown_connections 2024-06-06T02:32:54.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.335+0000 7f4b0fe00640 1 -- 172.21.15.82:0/587312382 wait complete. 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 Processor -- start 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 -- start start 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 0x7f4b1019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 0x7f4b101a2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10110790 con 0x7f4b1010a920 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10110610 con 0x7f4b10076680 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.336+0000 7f4b0fe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b10110910 con 0x7f4b10075090 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45908/0 (socket says 172.21.15.82:45908) 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 -- 172.21.15.82:0/1781970197 learned_addr learned my addr 172.21.15.82:0/1781970197 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b0f400640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 0x7f4b101a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b0ea00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 0x7f4b1019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 -- 172.21.15.82:0/1781970197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 msgr2=0x7f4b1019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 0x7f4b1019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 -- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 msgr2=0x7f4b101a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 0x7f4b101a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b06000640 1 -- 172.21.15.82:0/1781970197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b101a2ec0 con 0x7f4b10076680 2024-06-06T02:32:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.337+0000 7f4b0f400640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 0x7f4b101a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:32:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b06000640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4af800e9f0 tx=0x7f4af800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af800cd80 con 0x7f4b10076680 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b101a31b0 con 0x7f4b10076680 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af80054d0 con 0x7f4b10076680 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8010690 con 0x7f4b10076680 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.338+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b101a36f0 con 0x7f4b10076680 2024-06-06T02:32:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.340+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b101096e0 con 0x7f4b10076680 2024-06-06T02:32:54.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.345+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4af8004e50 con 0x7f4b10076680 2024-06-06T02:32:54.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.347+0000 7f4b07e00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 0x7f4af40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.347+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f4af80e23e0 con 0x7f4b10076680 2024-06-06T02:32:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.347+0000 7f4b0ea00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 0x7f4af40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:54.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.347+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4af80e2860 con 0x7f4b10076680 2024-06-06T02:32:54.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.348+0000 7f4b0ea00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 0x7f4af40b4d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009230 tx=0x7f4b00031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:54.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.558+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4b10063360 con 0x7f4b10076680 2024-06-06T02:32:54.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.559+0000 7f4b07e00640 1 -- 172.21.15.82:0/1781970197 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f4af80aa500 con 0x7f4b10076680 2024-06-06T02:32:54.561 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:32:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 msgr2=0x7f4af40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 0x7f4af40b4d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009230 tx=0x7f4b00031400 comp rx=0 tx=0).stop 2024-06-06T02:32:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 msgr2=0x7f4b1019b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4af800e9f0 tx=0x7f4af800edf0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 shutdown_connections 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1010a920 0x7f4b101a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b10076680 0x7f4b1019b8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4af40b2870 0x7f4af40b4d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 --2- 172.21.15.82:0/1781970197 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b10075090 0x7f4b1019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 >> 172.21.15.82:0/1781970197 conn(0x7f4b100fe2a0 msgr2=0x7f4b101068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 shutdown_connections 2024-06-06T02:32:54.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:54.562+0000 7f4b0fe00640 1 -- 172.21.15.82:0/1781970197 wait complete. 2024-06-06T02:32:55.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: purged_snaps scrub starts 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: purged_snaps scrub ok 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] boot 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: osdmap e70: 12 total, 12 up, 12 in 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1781970197' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:55.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:54 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: purged_snaps scrub starts 2024-06-06T02:32:55.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: purged_snaps scrub ok 2024-06-06T02:32:55.309 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] boot 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: osdmap e70: 12 total, 12 up, 12 in 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1781970197' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:55.311 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:55.311 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:54 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: purged_snaps scrub starts 2024-06-06T02:32:55.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: purged_snaps scrub ok 2024-06-06T02:32:55.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: osd.11 [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] boot 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: osdmap e70: 12 total, 12 up, 12 in 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1781970197' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:32:55.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:54 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:32:55.382 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1717641173,"num_in_osds":12,"osd_in_since":1717641154,"num_remapped_pgs":0} 2024-06-06T02:32:55.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:32:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:32:56.140 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:55 smithi082 ceph-mon[31579]: Detected new or changed devices on smithi184 2024-06-06T02:32:56.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:55 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi184 to 4272M 2024-06-06T02:32:56.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:55 smithi082 ceph-mon[31579]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:56.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:55 smithi082 ceph-mon[31579]: osdmap e71: 12 total, 12 up, 12 in 2024-06-06T02:32:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:55 smithi184 ceph-mon[36922]: Detected new or changed devices on smithi184 2024-06-06T02:32:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:55 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi184 to 4272M 2024-06-06T02:32:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:55 smithi184 ceph-mon[36922]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:55 smithi184 ceph-mon[36922]: osdmap e71: 12 total, 12 up, 12 in 2024-06-06T02:32:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:55 smithi103 ceph-mon[36349]: Detected new or changed devices on smithi184 2024-06-06T02:32:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:55 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi184 to 4272M 2024-06-06T02:32:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:55 smithi103 ceph-mon[36349]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:55 smithi103 ceph-mon[36349]: osdmap e71: 12 total, 12 up, 12 in 2024-06-06T02:32:58.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 -- 172.21.15.82:0/2048036837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f921810a0b0 msgr2=0x7f9218116520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 --2- 172.21.15.82:0/2048036837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f921810a0b0 0x7f9218116520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9210009900 tx=0x7f921002a410 comp rx=0 tx=0).stop 2024-06-06T02:32:58.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:57 smithi082 ceph-mon[31579]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 -- 172.21.15.82:0/2048036837 shutdown_connections 2024-06-06T02:32:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 --2- 172.21.15.82:0/2048036837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f921810a0b0 0x7f9218116520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 --2- 172.21.15.82:0/2048036837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9218109760 0x7f9218109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 --2- 172.21.15.82:0/2048036837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810f6a0 0x7f921810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 -- 172.21.15.82:0/2048036837 >> 172.21.15.82:0/2048036837 conn(0x7f921806e3f0 msgr2=0x7f921806e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 -- 172.21.15.82:0/2048036837 shutdown_connections 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.082+0000 7f921e400640 1 -- 172.21.15.82:0/2048036837 wait complete. 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.084+0000 7f921e400640 1 Processor -- start 2024-06-06T02:32:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.084+0000 7f921e400640 1 -- start start 2024-06-06T02:32:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 0x7f92181a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810a0b0 0x7f92181a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 0x7f92181a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92181194c0 con 0x7f9218109760 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9218119340 con 0x7f921810f6a0 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f921e400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9218119640 con 0x7f921810a0b0 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f9217400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 0x7f92181a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f9217400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 0x7f92181a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35034/0 (socket says 172.21.15.82:35034) 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f9217400640 1 -- 172.21.15.82:0/3864277625 learned_addr learned my addr 172.21.15.82:0/3864277625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:32:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f9217e00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 0x7f92181a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.085+0000 7f920ea00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810a0b0 0x7f92181a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 -- 172.21.15.82:0/3864277625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810a0b0 msgr2=0x7f92181a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810a0b0 0x7f92181a25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 -- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 msgr2=0x7f92181a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 0x7f92181a2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 -- 172.21.15.82:0/3864277625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92181a6ef0 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9217e00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 0x7f92181a68b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9210009230 tx=0x7f9210003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921003f070 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9210031b50 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210035030 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.086+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92181a7180 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.087+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92181a7610 con 0x7f921810f6a0 2024-06-06T02:32:58.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.088+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9218109b70 con 0x7f921810f6a0 2024-06-06T02:32:58.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.090+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9210042070 con 0x7f921810f6a0 2024-06-06T02:32:58.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.092+0000 7f9214c00640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 0x7f91fc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:32:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.092+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f92101023e0 con 0x7f921810f6a0 2024-06-06T02:32:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.092+0000 7f9217400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 0x7f91fc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:32:58.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.093+0000 7f9217400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 0x7f91fc0b4d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9208009c50 tx=0x7f9208005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:32:58.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.093+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92100c9eb0 con 0x7f921810f6a0 2024-06-06T02:32:58.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:57 smithi184 ceph-mon[36922]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:58.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.302+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9218113b60 con 0x7f921810f6a0 2024-06-06T02:32:58.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.304+0000 7f9214c00640 1 -- 172.21.15.82:0/3864277625 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18456 (secure 0 0 0) 0x7f92100ce1b0 con 0x7f921810f6a0 2024-06-06T02:32:58.304 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:32:58.304 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":71,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:32:54.864177+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:32:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 msgr2=0x7f91fc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 0x7f91fc0b4d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9208009c50 tx=0x7f9208005f90 comp rx=0 tx=0).stop 2024-06-06T02:32:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 msgr2=0x7f92181a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:32:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 0x7f92181a68b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9210009230 tx=0x7f9210003b90 comp rx=0 tx=0).stop 2024-06-06T02:32:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 shutdown_connections 2024-06-06T02:32:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f921810f6a0 0x7f92181a68b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91fc0b2870 0x7f91fc0b4d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f921810a0b0 0x7f92181a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 --2- 172.21.15.82:0/3864277625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9218109760 0x7f92181a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:32:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 >> 172.21.15.82:0/3864277625 conn(0x7f921806e3f0 msgr2=0x7f921810da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:32:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.307+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 shutdown_connections 2024-06-06T02:32:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:32:58.308+0000 7f921e400640 1 -- 172.21.15.82:0/3864277625 wait complete. 2024-06-06T02:32:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:57 smithi103 ceph-mon[36349]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:32:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:58 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3864277625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:32:59.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:58 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3864277625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:32:59.236 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T02:28:46.735414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T02:32:59.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-06T02:32:59.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:58 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3864277625' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:32:59.671 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:00.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:32:59 smithi082 ceph-mon[31579]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:00.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:32:59 smithi103 ceph-mon[36349]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:00.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:32:59 smithi184 ceph-mon[36922]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 -- 172.21.15.82:0/3511430666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20104f30 msgr2=0x7fcd20105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 --2- 172.21.15.82:0/3511430666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20104f30 0x7fcd20105340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009960 tx=0x7fcd1002a460 comp rx=0 tx=0).stop 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 -- 172.21.15.82:0/3511430666 shutdown_connections 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 --2- 172.21.15.82:0/3511430666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd2010a1b0 0x7fcd20111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 --2- 172.21.15.82:0/3511430666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20109860 0x7fcd20109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:01.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 --2- 172.21.15.82:0/3511430666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd20104f30 0x7fcd20105340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 -- 172.21.15.82:0/3511430666 >> 172.21.15.82:0/3511430666 conn(0x7fcd20100990 msgr2=0x7fcd20102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 -- 172.21.15.82:0/3511430666 shutdown_connections 2024-06-06T02:33:01.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.895+0000 7fcd25c00640 1 -- 172.21.15.82:0/3511430666 wait complete. 2024-06-06T02:33:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.896+0000 7fcd25c00640 1 Processor -- start 2024-06-06T02:33:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 -- start start 2024-06-06T02:33:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:01.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd20109860 0x7fcd201a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd2010a1b0 0x7fcd2019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20114f30 con 0x7fcd2010a1b0 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20114db0 con 0x7fcd20109860 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd25c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcd201150b0 con 0x7fcd20104f30 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.897+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:60662/0 (socket says 172.21.15.82:60662) 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 -- 172.21.15.82:0/1642648219 learned_addr learned my addr 172.21.15.82:0/1642648219 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd25200640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd2010a1b0 0x7fcd2019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd17400640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd20109860 0x7fcd201a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 -- 172.21.15.82:0/1642648219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd20109860 msgr2=0x7fcd201a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd20109860 0x7fcd201a1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:01.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 -- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd2010a1b0 msgr2=0x7fcd2019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd2010a1b0 0x7fcd2019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 -- 172.21.15.82:0/1642648219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2019bf90 con 0x7fcd20104f30 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.898+0000 7fcd1fe00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd10000c00 tx=0x7fcd10003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.899+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1003f070 con 0x7fcd20104f30 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.899+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd1003bb20 con 0x7fcd20104f30 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.899+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2019c1c0 con 0x7fcd20104f30 2024-06-06T02:33:01.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.899+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10035030 con 0x7fcd20104f30 2024-06-06T02:33:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.899+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2019c6a0 con 0x7fcd20104f30 2024-06-06T02:33:01.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.900+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd201063e0 con 0x7fcd20104f30 2024-06-06T02:33:01.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.903+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcd10042070 con 0x7fcd20104f30 2024-06-06T02:33:01.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.904+0000 7fcd1d600640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 0x7fcd040b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:01.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.904+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fcd10102860 con 0x7fcd20104f30 2024-06-06T02:33:01.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.905+0000 7fcd17400640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 0x7fcd040b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:01.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.905+0000 7fcd17400640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 0x7fcd040b4d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd20103d80 tx=0x7fcd08005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:01.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:01.906+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcd100ca330 con 0x7fcd20104f30 2024-06-06T02:33:02.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.112+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd2010d170 con 0x7fcd20104f30 2024-06-06T02:33:02.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.114+0000 7fcd1d600640 1 -- 172.21.15.82:0/1642648219 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7fcd100ce630 con 0x7fcd20104f30 2024-06-06T02:33:02.114 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-06-06T02:33:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 msgr2=0x7fcd040b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 0x7fcd040b4d00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd20103d80 tx=0x7fcd08005f30 comp rx=0 tx=0).stop 2024-06-06T02:33:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 msgr2=0x7fcd201a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:02.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd10000c00 tx=0x7fcd10003c10 comp rx=0 tx=0).stop 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 shutdown_connections 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd2010a1b0 0x7fcd2019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd20109860 0x7fcd201a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcd040b27f0 0x7fcd040b4d00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 --2- 172.21.15.82:0/1642648219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd20104f30 0x7fcd201a1620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:02.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.117+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 >> 172.21.15.82:0/1642648219 conn(0x7fcd20100990 msgr2=0x7fcd20101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:02.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.118+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 shutdown_connections 2024-06-06T02:33:02.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:02.118+0000 7fcd25c00640 1 -- 172.21.15.82:0/1642648219 wait complete. 2024-06-06T02:33:02.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:01 smithi103 ceph-mon[36349]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:02.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:01 smithi082 ceph-mon[31579]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:02.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:01 smithi184 ceph-mon[36922]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:03.058 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-06-06T02:33:03.058 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-06-06T02:33:03.058 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-06-06T02:33:03.058 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-06-06T02:33:03.058 INFO:tasks.cephadm:Adding mds.b on smithi103 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.e on smithi103 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.h on smithi103 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.k on smithi103 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.c on smithi184 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.f on smithi184 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.i on smithi184 2024-06-06T02:33:03.059 INFO:tasks.cephadm:Adding mds.l on smithi184 2024-06-06T02:33:03.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l' 2024-06-06T02:33:03.306 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:33:03.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:02 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1642648219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:33:03.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:02 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1642648219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:33:03.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:02 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1642648219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:33:04.134 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:03 smithi184 ceph-mon[36922]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:04.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:03 smithi103 ceph-mon[36349]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:04.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:03 smithi082 ceph-mon[31579]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- 172.21.15.184:0/3594685559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103030 msgr2=0x7f1948103440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3594685559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103030 0x7f1948103440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f193c009930 tx=0x7f193c02a420 comp rx=0 tx=0).stop 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- 172.21.15.184:0/3594685559 shutdown_connections 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3594685559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103980 0x7f194810a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3594685559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103030 0x7f1948103440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3594685559 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948102130 0x7f1948102540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.006 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- 172.21.15.184:0/3594685559 >> 172.21.15.184:0/3594685559 conn(0x7f19480fcb10 msgr2=0x7f19480fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- 172.21.15.184:0/3594685559 shutdown_connections 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- 172.21.15.184:0/3594685559 wait complete. 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 Processor -- start 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 -- start start 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948102130 0x7f1948199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.997+0000 7f194eaaf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103030 0x7f1948199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194eaaf640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194eaaf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f194810ea20 con 0x7f1948102130 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194eaaf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f194810e8a0 con 0x7f1948103030 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194eaaf640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f194810eba0 con 0x7f1948103980 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:05.007 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:56916/0 (socket says 172.21.15.184:56916) 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 -- 172.21.15.184:0/3621451105 learned_addr learned my addr 172.21.15.184:0/3621451105 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f1947fff640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103030 0x7f1948199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 -- 172.21.15.184:0/3621451105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103030 msgr2=0x7f1948199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103030 0x7f1948199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 -- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948102130 msgr2=0x7f1948199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948102130 0x7f1948199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 -- 172.21.15.184:0/3621451105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19481a1150 con 0x7f1948103980 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194d04c640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f194000eaa0 tx=0x7f194000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194000cdb0 con 0x7f1948103980 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1940005020 con 0x7f1948103980 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19481a1440 con 0x7f1948103980 2024-06-06T02:33:05.008 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.998+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400116d0 con 0x7f1948103980 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:04.999+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19481a19b0 con 0x7f1948103980 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.000+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194806adf0 con 0x7f1948103980 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.001+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f19400051d0 con 0x7f1948103980 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.001+0000 7f1945ffb640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 0x7f19300b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.002+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f19400e2020 con 0x7f1948103980 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.002+0000 7f194c84b640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 0x7f19300b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.003+0000 7f194c84b640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 0x7f19300b4d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1948102fc0 tx=0x7f1938006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:05.009 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.006+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1940016030 con 0x7f1948103980 2024-06-06T02:33:05.201 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.202+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}) -- 0x7f1948062ba0 con 0x7f19300b27f0 2024-06-06T02:33:05.219 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.220+0000 7f1945ffb640 1 -- 172.21.15.184:0/3621451105 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f1948062ba0 con 0x7f19300b27f0 2024-06-06T02:33:05.220 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mds.all update... 2024-06-06T02:33:05.221 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 msgr2=0x7f19300b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 0x7f19300b4d00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1948102fc0 tx=0x7f1938006c90 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 msgr2=0x7f19481a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f194000eaa0 tx=0x7f194000ef60 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 shutdown_connections 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f19300b27f0 0x7f19300b4d00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1948103980 0x7f19481a0b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1948103030 0x7f1948199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 --2- 172.21.15.184:0/3621451105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1948102130 0x7f1948199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 >> 172.21.15.184:0/3621451105 conn(0x7f19480fcb10 msgr2=0x7f19481062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 shutdown_connections 2024-06-06T02:33:05.222 INFO:teuthology.orchestra.run.smithi184.stderr:2024-06-06T02:33:05.222+0000 7f194eaaf640 1 -- 172.21.15.184:0/3621451105 wait complete. 2024-06-06T02:33:05.921 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.a.service 2024-06-06T02:33:05.928 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.d.service 2024-06-06T02:33:05.973 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.g.service 2024-06-06T02:33:06.020 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.j.service 2024-06-06T02:33:06.065 DEBUG:teuthology.orchestra.run.smithi103:mds.b> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.b.service 2024-06-06T02:33:06.068 DEBUG:teuthology.orchestra.run.smithi103:mds.e> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.e.service 2024-06-06T02:33:06.111 DEBUG:teuthology.orchestra.run.smithi103:mds.h> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.h.service 2024-06-06T02:33:06.154 DEBUG:teuthology.orchestra.run.smithi103:mds.k> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.k.service 2024-06-06T02:33:06.197 DEBUG:teuthology.orchestra.run.smithi184:mds.c> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.c.service 2024-06-06T02:33:06.199 DEBUG:teuthology.orchestra.run.smithi184:mds.f> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.f.service 2024-06-06T02:33:06.242 DEBUG:teuthology.orchestra.run.smithi184:mds.i> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.i.service 2024-06-06T02:33:06.275 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:06.275 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:06.276 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:06 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.287 DEBUG:teuthology.orchestra.run.smithi184:mds.l> sudo journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.l.service 2024-06-06T02:33:06.330 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-06T02:33:06.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:33:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-06-06T02:33:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:06.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:06 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:06.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='client.24592 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:33:06.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-06-06T02:33:06.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:06.519 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:06 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:06.765 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:07.548 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:07 smithi184 ceph-mon[36922]: Deploying daemon mds.l on smithi184 2024-06-06T02:33:07.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:07 smithi103 ceph-mon[36349]: Deploying daemon mds.l on smithi184 2024-06-06T02:33:07.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:07 smithi082 ceph-mon[31579]: Deploying daemon mds.l on smithi184 2024-06-06T02:33:08.147 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 systemd[1]: Starting Ceph mds.l for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:08.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:08 smithi082 ceph-mon[31579]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:08.550 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:08 smithi184 ceph-mon[36922]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:08.550 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 podman[66803]: 2024-06-06 02:33:08.161333348 +0000 UTC m=+0.017714321 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:08.551 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 podman[66803]: 2024-06-06 02:33:08.281951058 +0000 UTC m=+0.138332054 container create 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-06-06T02:33:08.551 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 podman[66803]: 2024-06-06 02:33:08.551407272 +0000 UTC m=+0.407788226 container init 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:33:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:08 smithi103 ceph-mon[36349]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:08.897 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 podman[66803]: 2024-06-06 02:33:08.553988752 +0000 UTC m=+0.410369707 container start 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-06-06T02:33:08.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 ceph-mds[66822]: -- 172.21.15.184:0/572403018 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6f2e9b860 con 0x55b6f704d180 2024-06-06T02:33:08.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l[66818]: starting mds.l at 2024-06-06T02:33:08.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 bash[66803]: 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e 2024-06-06T02:33:08.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:33:08 smithi184 systemd[1]: Started Ceph mds.l for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:08.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1781422561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b58109310 msgr2=0x7f6b58109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1781422561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b58109310 0x7f6b58109720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6b480098c0 tx=0x7f6b4802a390 comp rx=0 tx=0).stop 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1781422561 shutdown_connections 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1781422561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b5810e590 0x7f6b58115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1781422561 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810dc40 0x7f6b5810e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1781422561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b58109310 0x7f6b58109720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1781422561 >> 172.21.15.82:0/1781422561 conn(0x7f6b58078a80 msgr2=0x7f6b58107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1781422561 shutdown_connections 2024-06-06T02:33:08.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.993+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1781422561 wait complete. 2024-06-06T02:33:08.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.994+0000 7f6b5ca00640 1 Processor -- start 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.994+0000 7f6b5ca00640 1 -- start start 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 0x7f6b5819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 0x7f6b581a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 0x7f6b581a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581192d0 con 0x7f6b5810dc40 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58119150 con 0x7f6b5810e590 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b5ca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58119450 con 0x7f6b58109310 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 0x7f6b581a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b57200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 0x7f6b581a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 0x7f6b5819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 0x7f6b581a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33950/0 (socket says 172.21.15.82:33950) 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.995+0000 7f6b55e00640 1 -- 172.21.15.82:0/1939371589 learned_addr learned my addr 172.21.15.82:0/1939371589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:08.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 -- 172.21.15.82:0/1939371589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 msgr2=0x7f6b5819fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:08.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 0x7f6b5819fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:08.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 -- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 msgr2=0x7f6b581a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:08.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 0x7f6b581a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:08.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 -- 172.21.15.82:0/1939371589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b581a4c80 con 0x7f6b5810e590 2024-06-06T02:33:08.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b56800640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 0x7f6b5819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:08.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b57200640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 0x7f6b581a4640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000ea80 tx=0x7f6b5000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:08.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000cea0 con 0x7f6b5810e590 2024-06-06T02:33:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b50005020 con 0x7f6b5810e590 2024-06-06T02:33:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b581a4f70 con 0x7f6b5810e590 2024-06-06T02:33:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.996+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50010690 con 0x7f6b5810e590 2024-06-06T02:33:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.997+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581ac8f0 con 0x7f6b5810e590 2024-06-06T02:33:08.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:08.998+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5810a7c0 con 0x7f6b5810e590 2024-06-06T02:33:09.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.000+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6b500054d0 con 0x7f6b5810e590 2024-06-06T02:33:09.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.001+0000 7f6b4f400640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 0x7f6b3c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.002+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f6b500e2430 con 0x7f6b5810e590 2024-06-06T02:33:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.002+0000 7f6b56800640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 0x7f6b3c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.003+0000 7f6b56800640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 0x7f6b3c0b4d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802a980 tx=0x7f6b48005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.004+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b500aa5e0 con 0x7f6b5810e590 2024-06-06T02:33:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.254+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b58109720 con 0x7f6b5810e590 2024-06-06T02:33:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.255+0000 7f6b4f400640 1 -- 172.21.15.82:0/1939371589 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f6b500a9ee0 con 0x7f6b5810e590 2024-06-06T02:33:09.255 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:09.255 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T02:33:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 msgr2=0x7f6b3c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 0x7f6b3c0b4d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b4802a980 tx=0x7f6b48005040 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 msgr2=0x7f6b581a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 0x7f6b581a4640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000ea80 tx=0x7f6b5000ef40 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 shutdown_connections 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b5810e590 0x7f6b581a4640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5810dc40 0x7f6b581a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.257+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b3c0b2870 0x7f6b3c0b4d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.258+0000 7f6b5ca00640 1 --2- 172.21.15.82:0/1939371589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b58109310 0x7f6b5819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.258+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 >> 172.21.15.82:0/1939371589 conn(0x7f6b58078a80 msgr2=0x7f6b580792d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.258+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 shutdown_connections 2024-06-06T02:33:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:09.258+0000 7f6b5ca00640 1 -- 172.21.15.82:0/1939371589 wait complete. 2024-06-06T02:33:09.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6832/660710871,v1:172.21.15.184:6833/660710871] up:boot 2024-06-06T02:33:09.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: fsmap 1 up:standby 2024-06-06T02:33:09.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: Deploying daemon mds.k on smithi103 2024-06-06T02:33:09.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:09 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1939371589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6832/660710871,v1:172.21.15.184:6833/660710871] up:boot 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: fsmap 1 up:standby 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: Deploying daemon mds.k on smithi103 2024-06-06T02:33:09.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:09 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1939371589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:09.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6832/660710871,v1:172.21.15.184:6833/660710871] up:boot 2024-06-06T02:33:09.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: fsmap 1 up:standby 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: Deploying daemon mds.k on smithi103 2024-06-06T02:33:09.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:09 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1939371589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:10.867 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:10 smithi103 systemd[1]: Starting Ceph mds.k for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:11.174 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:10 smithi103 podman[65249]: 2024-06-06 02:33:10.826101944 +0000 UTC m=+0.017401034 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:11.174 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:10 smithi103 podman[65249]: 2024-06-06 02:33:10.940543716 +0000 UTC m=+0.131842789 container create 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=) 2024-06-06T02:33:11.174 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 podman[65249]: 2024-06-06 02:33:11.138933005 +0000 UTC m=+0.330232078 container init 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528) 2024-06-06T02:33:11.174 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 podman[65249]: 2024-06-06 02:33:11.141636186 +0000 UTC m=+0.332935264 container start 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-06T02:33:11.617 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 ceph-mds[65268]: -- 172.21.15.103:0/3339687555 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5643ec3fdc20 con 0x5643f05af600 2024-06-06T02:33:11.617 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k[65264]: starting mds.k at 2024-06-06T02:33:11.617 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 bash[65249]: 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d 2024-06-06T02:33:11.617 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:33:11 smithi103 systemd[1]: Started Ceph mds.k for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:12.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: Deploying daemon mds.j on smithi082 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6832/2511438275,v1:172.21.15.103:6833/2511438275] up:boot 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: fsmap 2 up:standby 2024-06-06T02:33:12.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:12 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:12.544 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:12.545 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: Deploying daemon mds.j on smithi082 2024-06-06T02:33:12.545 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6832/2511438275,v1:172.21.15.103:6833/2511438275] up:boot 2024-06-06T02:33:12.545 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: fsmap 2 up:standby 2024-06-06T02:33:12.545 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:12 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T02:33:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: Deploying daemon mds.j on smithi082 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6832/2511438275,v1:172.21.15.103:6833/2511438275] up:boot 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: fsmap 2 up:standby 2024-06-06T02:33:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:12 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-06T02:33:13.364 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:14.283 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:14 smithi082 systemd[1]: Starting Ceph mds.j for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:14.283 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:14 smithi082 ceph-mon[31579]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:14 smithi103 ceph-mon[36349]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:14 smithi184 ceph-mon[36922]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:15.247 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:14 smithi082 podman[74877]: 2024-06-06 02:33:14.871789336 +0000 UTC m=+0.038233104 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:15.247 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 podman[74877]: 2024-06-06 02:33:15.010588168 +0000 UTC m=+0.177031993 container create 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:33:15.520 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 podman[74877]: 2024-06-06 02:33:15.349091808 +0000 UTC m=+0.515535599 container init 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:33:15.520 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 podman[74877]: 2024-06-06 02:33:15.360114107 +0000 UTC m=+0.526557872 container start 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:33:15.520 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 ceph-mds[74914]: -- 172.21.15.82:0/2470987565 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587325db860 con 0x55873678d600 2024-06-06T02:33:15.520 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j[74910]: starting mds.j at 2024-06-06T02:33:15.832 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 bash[74877]: 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a 2024-06-06T02:33:15.833 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:33:15 smithi082 systemd[1]: Started Ceph mds.j for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 -- 172.21.15.82:0/3277603809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e80753f0 msgr2=0x7fc7e810efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 --2- 172.21.15.82:0/3277603809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e80753f0 0x7fc7e810efb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009900 tx=0x7fc7d402a480 comp rx=0 tx=0).stop 2024-06-06T02:33:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 -- 172.21.15.82:0/3277603809 shutdown_connections 2024-06-06T02:33:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 --2- 172.21.15.82:0/3277603809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e810f4f0 0x7fc7e8111910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 --2- 172.21.15.82:0/3277603809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e80753f0 0x7fc7e810efb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 --2- 172.21.15.82:0/3277603809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e8074eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 -- 172.21.15.82:0/3277603809 >> 172.21.15.82:0/3277603809 conn(0x7fc7e8079d40 msgr2=0x7fc7e807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 -- 172.21.15.82:0/3277603809 shutdown_connections 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.886+0000 7fc7f0200640 1 -- 172.21.15.82:0/3277603809 wait complete. 2024-06-06T02:33:15.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.887+0000 7fc7f0200640 1 Processor -- start 2024-06-06T02:33:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 -- start start 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e80753f0 0x7fc7e81a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e810f4f0 0x7fc7e819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8115080 con 0x7fc7e810f4f0 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8114f00 con 0x7fc7e80753f0 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7f0200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8115200 con 0x7fc7e8074aa0 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7ed800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7ed800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:32912/0 (socket says 172.21.15.82:32912) 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.888+0000 7fc7ed800640 1 -- 172.21.15.82:0/116461114 learned_addr learned my addr 172.21.15.82:0/116461114 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ee200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e810f4f0 0x7fc7e819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ece00640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e80753f0 0x7fc7e81a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 -- 172.21.15.82:0/116461114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e80753f0 msgr2=0x7fc7e81a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e80753f0 0x7fc7e81a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 -- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e810f4f0 msgr2=0x7fc7e819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e810f4f0 0x7fc7e819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 -- 172.21.15.82:0/116461114 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e819bf80 con 0x7fc7e8074aa0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.889+0000 7fc7ed800640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00ea60 tx=0x7fc7dc00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.890+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00cde0 con 0x7fc7e8074aa0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.890+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc0035f0 con 0x7fc7e8074aa0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.890+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e819c270 con 0x7fc7e8074aa0 2024-06-06T02:33:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.890+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc010690 con 0x7fc7e8074aa0 2024-06-06T02:33:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.890+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e81a8580 con 0x7fc7e8074aa0 2024-06-06T02:33:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.892+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e8074eb0 con 0x7fc7e8074aa0 2024-06-06T02:33:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.893+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc7dc004020 con 0x7fc7e8074aa0 2024-06-06T02:33:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.895+0000 7fc7e6000640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 0x7fc7d00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.895+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fc7dc0e20a0 con 0x7fc7e8074aa0 2024-06-06T02:33:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.895+0000 7fc7ece00640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 0x7fc7d00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.896+0000 7fc7ece00640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 0x7fc7d00b4d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4031440 tx=0x7fc7d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:15.899+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7dc0aa1c0 con 0x7fc7e8074aa0 2024-06-06T02:33:16.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.149+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7e810a670 con 0x7fc7e8074aa0 2024-06-06T02:33:16.150 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:16.150 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T02:33:16.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.150+0000 7fc7e6000640 1 -- 172.21.15.82:0/116461114 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7fc7dc0a9ac0 con 0x7fc7e8074aa0 2024-06-06T02:33:16.150 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 msgr2=0x7fc7d00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 0x7fc7d00b4d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4031440 tx=0x7fc7d4005a20 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 msgr2=0x7fc7e81a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00ea60 tx=0x7fc7dc00ef20 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 shutdown_connections 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7e810f4f0 0x7fc7e819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e80753f0 0x7fc7e81a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc7d00b27f0 0x7fc7d00b4d00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 --2- 172.21.15.82:0/116461114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7e8074aa0 0x7fc7e81a16f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 >> 172.21.15.82:0/116461114 conn(0x7fc7e8079d40 msgr2=0x7fc7e80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:16.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 shutdown_connections 2024-06-06T02:33:16.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:16.153+0000 7fc7f0200640 1 -- 172.21.15.82:0/116461114 wait complete. 2024-06-06T02:33:16.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:16.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/116461114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:16.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:16.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/116461114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/116461114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:17.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:17 smithi082 ceph-mon[31579]: Deploying daemon mds.d on smithi082 2024-06-06T02:33:17.534 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:17 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6834/2462955509,v1:172.21.15.82:6835/2462955509] up:boot 2024-06-06T02:33:17.534 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:17 smithi082 ceph-mon[31579]: fsmap 3 up:standby 2024-06-06T02:33:17.534 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:17 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T02:33:17.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:17 smithi103 ceph-mon[36349]: Deploying daemon mds.d on smithi082 2024-06-06T02:33:17.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:17 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6834/2462955509,v1:172.21.15.82:6835/2462955509] up:boot 2024-06-06T02:33:17.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:17 smithi103 ceph-mon[36349]: fsmap 3 up:standby 2024-06-06T02:33:17.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:17 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T02:33:17.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:17 smithi184 ceph-mon[36922]: Deploying daemon mds.d on smithi082 2024-06-06T02:33:17.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:17 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6834/2462955509,v1:172.21.15.82:6835/2462955509] up:boot 2024-06-06T02:33:17.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:17 smithi184 ceph-mon[36922]: fsmap 3 up:standby 2024-06-06T02:33:17.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:17 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-06T02:33:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:18 smithi103 ceph-mon[36349]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:18 smithi082 ceph-mon[31579]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:18.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:18 smithi184 ceph-mon[36922]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:18.998 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:19.746 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 podman[75264]: 2024-06-06 02:33:19.449190142 +0000 UTC m=+0.156965311 container create 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:33:19.746 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 podman[75264]: 2024-06-06 02:33:19.745380434 +0000 UTC m=+0.453155609 container init 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, ceph=True) 2024-06-06T02:33:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:20.093 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 podman[75264]: 2024-06-06 02:33:19.755854628 +0000 UTC m=+0.463629830 container start 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:33:20.093 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 bash[75264]: 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 2024-06-06T02:33:20.094 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 systemd[1]: Started Ceph mds.d for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:20.094 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 ceph-mds[75301]: -- 172.21.15.82:0/3620449187 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d2d1d6b860 con 0x55d2d5f1d600 2024-06-06T02:33:20.094 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:33:19 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d[75296]: starting mds.d at 2024-06-06T02:33:20.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:20.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:20 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:20.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:20.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.604 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:20.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:20.605 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:20 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:20.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:20 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:21.603 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:21 smithi103 ceph-mon[36349]: Deploying daemon mds.e on smithi103 2024-06-06T02:33:21.603 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:21 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6836/2409954600,v1:172.21.15.82:6837/2409954600] up:boot 2024-06-06T02:33:21.603 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:21 smithi103 ceph-mon[36349]: fsmap 4 up:standby 2024-06-06T02:33:21.603 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:21 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T02:33:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:21 smithi082 ceph-mon[31579]: Deploying daemon mds.e on smithi103 2024-06-06T02:33:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:21 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6836/2409954600,v1:172.21.15.82:6837/2409954600] up:boot 2024-06-06T02:33:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:21 smithi082 ceph-mon[31579]: fsmap 4 up:standby 2024-06-06T02:33:21.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:21 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T02:33:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:21 smithi184 ceph-mon[36922]: Deploying daemon mds.e on smithi103 2024-06-06T02:33:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:21 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6836/2409954600,v1:172.21.15.82:6837/2409954600] up:boot 2024-06-06T02:33:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:21 smithi184 ceph-mon[36922]: fsmap 4 up:standby 2024-06-06T02:33:21.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:21 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-06T02:33:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 -- 172.21.15.82:0/2457365361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f281050f0 msgr2=0x7f1f28105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 --2- 172.21.15.82:0/2457365361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f281050f0 0x7f1f28105500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009c10 tx=0x7f1f2002a6f0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 -- 172.21.15.82:0/2457365361 shutdown_connections 2024-06-06T02:33:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 --2- 172.21.15.82:0/2457365361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f2810a370 0x7f1f28111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 --2- 172.21.15.82:0/2457365361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f28109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 --2- 172.21.15.82:0/2457365361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f281050f0 0x7f1f28105500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 -- 172.21.15.82:0/2457365361 >> 172.21.15.82:0/2457365361 conn(0x7f1f28100b70 msgr2=0x7f1f28102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 -- 172.21.15.82:0/2457365361 shutdown_connections 2024-06-06T02:33:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.233+0000 7f1f2f000640 1 -- 172.21.15.82:0/2457365361 wait complete. 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.235+0000 7f1f2f000640 1 Processor -- start 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.235+0000 7f1f2f000640 1 -- start start 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 0x7f1f2819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 0x7f1f281a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281150b0 con 0x7f1f28109a20 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28114f30 con 0x7f1f2810a370 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2f000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28115230 con 0x7f1f281050f0 2024-06-06T02:33:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 0x7f1f2819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50808/0 (socket says 172.21.15.82:50808) 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 -- 172.21.15.82:0/177174222 learned_addr learned my addr 172.21.15.82:0/177174222 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f2d000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 0x7f1f281a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 -- 172.21.15.82:0/177174222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 msgr2=0x7f1f2819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 0x7f1f2819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.236+0000 7f1f27400640 1 -- 172.21.15.82:0/177174222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 msgr2=0x7f1f281a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f27400640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 0x7f1f281a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f27400640 1 -- 172.21.15.82:0/177174222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f281a0ad0 con 0x7f1f28109a20 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f27e00640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 0x7f1f2819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f2d000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 0x7f1f281a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f27400640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9c0 tx=0x7f1f1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000ccc0 con 0x7f1f28109a20 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f281a0dc0 con 0x7f1f28109a20 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f100108e0 con 0x7f1f28109a20 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10018730 con 0x7f1f28109a20 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.237+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a8740 con 0x7f1f28109a20 2024-06-06T02:33:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.239+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f28105500 con 0x7f1f28109a20 2024-06-06T02:33:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.241+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1f10010430 con 0x7f1f28109a20 2024-06-06T02:33:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.243+0000 7f1f24c00640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 0x7f1f0c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.243+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f1f100e2530 con 0x7f1f28109a20 2024-06-06T02:33:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.244+0000 7f1f27e00640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 0x7f1f0c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.244+0000 7f1f27e00640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 0x7f1f0c0b4d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009be0 tx=0x7f1f20005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.245+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1f100aa000 con 0x7f1f28109a20 2024-06-06T02:33:22.334 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 podman[65566]: 2024-06-06 02:33:22.207222884 +0000 UTC m=+0.133548750 container create 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-06-06T02:33:22.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.494+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f2810d330 con 0x7f1f28109a20 2024-06-06T02:33:22.494 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:22 smithi082 ceph-mon[31579]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.496+0000 7f1f24c00640 1 -- 172.21.15.82:0/177174222 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3871 (secure 0 0 0) 0x7f1f100ae300 con 0x7f1f28109a20 2024-06-06T02:33:22.496 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:22.496 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-06-06T02:33:22.496 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.499+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 msgr2=0x7f1f0c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.499+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 0x7f1f0c0b4d00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009be0 tx=0x7f1f20005fd0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.499+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 msgr2=0x7f1f2819c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.499+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e9c0 tx=0x7f1f1000ee80 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 shutdown_connections 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f2810a370 0x7f1f281a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f28109a20 0x7f1f2819c190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f0c0b27f0 0x7f1f0c0b4d00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 --2- 172.21.15.82:0/177174222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f281050f0 0x7f1f2819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 >> 172.21.15.82:0/177174222 conn(0x7f1f28100b70 msgr2=0x7f1f28102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 shutdown_connections 2024-06-06T02:33:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:22.500+0000 7f1f2f000640 1 -- 172.21.15.82:0/177174222 wait complete. 2024-06-06T02:33:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:22 smithi103 ceph-mon[36349]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:22.617 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 podman[65566]: 2024-06-06 02:33:22.451583055 +0000 UTC m=+0.377908854 container init 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-06-06T02:33:22.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 podman[65566]: 2024-06-06 02:33:22.454369957 +0000 UTC m=+0.380695755 container start 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:33:22.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 ceph-mds[65585]: -- 172.21.15.103:0/1346390806 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d73bf3b860 con 0x55d7400ed180 2024-06-06T02:33:22.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e[65581]: starting mds.e at 2024-06-06T02:33:22.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 bash[65566]: 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e 2024-06-06T02:33:22.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:33:22 smithi103 systemd[1]: Started Ceph mds.e for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:22.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:22 smithi184 ceph-mon[36922]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/177174222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:23.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:23 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/177174222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:23.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:23 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:23.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/177174222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:23.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:23.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:23 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:24 smithi184 ceph-mon[36922]: Deploying daemon mds.f on smithi184 2024-06-06T02:33:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:24 smithi184 ceph-mon[36922]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:24 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6834/407132761,v1:172.21.15.103:6835/407132761] up:boot 2024-06-06T02:33:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:24 smithi184 ceph-mon[36922]: fsmap 5 up:standby 2024-06-06T02:33:24.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T02:33:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:24 smithi103 ceph-mon[36349]: Deploying daemon mds.f on smithi184 2024-06-06T02:33:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:24 smithi103 ceph-mon[36349]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:24 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6834/407132761,v1:172.21.15.103:6835/407132761] up:boot 2024-06-06T02:33:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:24 smithi103 ceph-mon[36349]: fsmap 5 up:standby 2024-06-06T02:33:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T02:33:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:24 smithi082 ceph-mon[31579]: Deploying daemon mds.f on smithi184 2024-06-06T02:33:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:24 smithi082 ceph-mon[31579]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:24 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6834/407132761,v1:172.21.15.103:6835/407132761] up:boot 2024-06-06T02:33:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:24 smithi082 ceph-mon[31579]: fsmap 5 up:standby 2024-06-06T02:33:24.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-06T02:33:24.875 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:24 smithi184 systemd[1]: Starting Ceph mds.f for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:25.138 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:24 smithi184 podman[67107]: 2024-06-06 02:33:24.778562418 +0000 UTC m=+0.017344721 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:25.138 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:24 smithi184 podman[67107]: 2024-06-06 02:33:24.903697964 +0000 UTC m=+0.142480310 container create e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-06-06T02:33:25.138 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 podman[67107]: 2024-06-06 02:33:25.139763855 +0000 UTC m=+0.378546159 container init e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-06T02:33:25.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:25.397 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 podman[67107]: 2024-06-06 02:33:25.142342268 +0000 UTC m=+0.381124574 container start e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:33:25.397 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 ceph-mds[67127]: -- 172.21.15.184:0/225313696 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5a0beb860 con 0x55e5a4d9d600 2024-06-06T02:33:25.398 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: starting mds.f at 2024-06-06T02:33:25.398 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 bash[67107]: e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 2024-06-06T02:33:25.398 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:33:25 smithi184 systemd[1]: Started Ceph mds.f for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:25.781 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:26.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:26.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: Deploying daemon mds.c on smithi184 2024-06-06T02:33:26.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6834/1227923673,v1:172.21.15.184:6835/1227923673] up:boot 2024-06-06T02:33:26.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: fsmap 6 up:standby 2024-06-06T02:33:26.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: Deploying daemon mds.c on smithi184 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6834/1227923673,v1:172.21.15.184:6835/1227923673] up:boot 2024-06-06T02:33:26.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: fsmap 6 up:standby 2024-06-06T02:33:26.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:33:26.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:26.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: Deploying daemon mds.c on smithi184 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6834/1227923673,v1:172.21.15.184:6835/1227923673] up:boot 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: fsmap 6 up:standby 2024-06-06T02:33:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:33:27.568 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 systemd[1]: Starting Ceph mds.c for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:27.864 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 podman[67421]: 2024-06-06 02:33:27.471595328 +0000 UTC m=+0.017281415 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:27.865 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 podman[67421]: 2024-06-06 02:33:27.587406135 +0000 UTC m=+0.133092220 container create 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-06-06T02:33:27.865 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 podman[67421]: 2024-06-06 02:33:27.865838615 +0000 UTC m=+0.411524702 container init 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.35.3) 2024-06-06T02:33:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 -- 172.21.15.82:0/3617055058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8107650 msgr2=0x7fc6f8107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 --2- 172.21.15.82:0/3617055058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8107650 0x7fc6f8107a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00098c0 tx=0x7fc6e002a390 comp rx=0 tx=0).stop 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 -- 172.21.15.82:0/3617055058 shutdown_connections 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 --2- 172.21.15.82:0/3617055058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107fa0 0x7fc6f810f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 --2- 172.21.15.82:0/3617055058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8107650 0x7fc6f8107a60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 --2- 172.21.15.82:0/3617055058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8101140 0x7fc6f8101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 -- 172.21.15.82:0/3617055058 >> 172.21.15.82:0/3617055058 conn(0x7fc6f80fcfd0 msgr2=0x7fc6f80ff3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 -- 172.21.15.82:0/3617055058 shutdown_connections 2024-06-06T02:33:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.046+0000 7fc6fe000640 1 -- 172.21.15.82:0/3617055058 wait complete. 2024-06-06T02:33:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.048+0000 7fc6fe000640 1 Processor -- start 2024-06-06T02:33:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.048+0000 7fc6fe000640 1 -- start start 2024-06-06T02:33:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.048+0000 7fc6fe000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.048+0000 7fc6fe000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107650 0x7fc6f81a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fe000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8107fa0 0x7fc6f819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fe000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8112cf0 con 0x7fc6f8101140 2024-06-06T02:33:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fe000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8112b70 con 0x7fc6f8107fa0 2024-06-06T02:33:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fe000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f8112e70 con 0x7fc6f8107650 2024-06-06T02:33:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50832/0 (socket says 172.21.15.82:50832) 2024-06-06T02:33:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 -- 172.21.15.82:0/494884667 learned_addr learned my addr 172.21.15.82:0/494884667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6efe00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107650 0x7fc6f81a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fd600640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8107fa0 0x7fc6f819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 -- 172.21.15.82:0/494884667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107650 msgr2=0x7fc6f81a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107650 0x7fc6f81a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 -- 172.21.15.82:0/494884667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8107fa0 msgr2=0x7fc6f819b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8107fa0 0x7fc6f819b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.049+0000 7fc6fcc00640 1 -- 172.21.15.82:0/494884667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f819bee0 con 0x7fc6f8101140 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6fcc00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c420 tx=0x7fc6e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8003970 con 0x7fc6f8101140 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6e8004020 con 0x7fc6f8101140 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f819c1d0 con 0x7fc6f8101140 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f81a8460 con 0x7fc6f8101140 2024-06-06T02:33:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.050+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e800b980 con 0x7fc6f8101140 2024-06-06T02:33:28.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.051+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f81041d0 con 0x7fc6f8101140 2024-06-06T02:33:28.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.056+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc6e801d020 con 0x7fc6f8101140 2024-06-06T02:33:28.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.057+0000 7fc6f6000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 0x7fc6dc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:28.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.058+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fc6e80e2290 con 0x7fc6f8101140 2024-06-06T02:33:28.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.058+0000 7fc6efe00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 0x7fc6dc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:28.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.058+0000 7fc6efe00640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 0x7fc6dc0b4d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6e002a980 tx=0x7fc6e0005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:28.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.060+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6e80aa3b0 con 0x7fc6f8101140 2024-06-06T02:33:28.147 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 podman[67421]: 2024-06-06 02:33:27.868446126 +0000 UTC m=+0.414132221 container start 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T02:33:28.148 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 ceph-mds[67440]: -- 172.21.15.184:0/233012019 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564773837860 con 0x5647779e9a80 2024-06-06T02:33:28.148 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: starting mds.c at 2024-06-06T02:33:28.148 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 bash[67421]: 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d 2024-06-06T02:33:28.148 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:33:27 smithi184 systemd[1]: Started Ceph mds.c for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.307+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6f8101550 con 0x7fc6f8101140 2024-06-06T02:33:28.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.310+0000 7fc6f6000640 1 -- 172.21.15.82:0/494884667 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5524 (secure 0 0 0) 0x7fc6e80b2430 con 0x7fc6f8101140 2024-06-06T02:33:28.309 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:28.309 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-06-06T02:33:28.309 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2024-06-06T02:33:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 msgr2=0x7fc6dc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 0x7fc6dc0b4d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6e002a980 tx=0x7fc6e0005040 comp rx=0 tx=0).stop 2024-06-06T02:33:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 msgr2=0x7fc6f81a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c420 tx=0x7fc6e8009f90 comp rx=0 tx=0).stop 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 shutdown_connections 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6f8107fa0 0x7fc6f819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6dc0b2870 0x7fc6dc0b4d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6f8107650 0x7fc6f81a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 --2- 172.21.15.82:0/494884667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f8101140 0x7fc6f81a1660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 >> 172.21.15.82:0/494884667 conn(0x7fc6f80fcfd0 msgr2=0x7fc6f8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.313+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 shutdown_connections 2024-06-06T02:33:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:28.314+0000 7fc6fe000640 1 -- 172.21.15.82:0/494884667 wait complete. 2024-06-06T02:33:28.611 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:28.611 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:28.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:28.612 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:28.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:29 smithi082 ceph-mon[31579]: Deploying daemon mds.h on smithi103 2024-06-06T02:33:29.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:29 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/494884667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:29.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:29 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6836/387834603,v1:172.21.15.184:6837/387834603] up:boot 2024-06-06T02:33:29.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:29 smithi082 ceph-mon[31579]: fsmap 7 up:standby 2024-06-06T02:33:29.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:33:29.517 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:29 smithi103 ceph-mon[36349]: Deploying daemon mds.h on smithi103 2024-06-06T02:33:29.517 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:29 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/494884667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:29.517 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:29 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6836/387834603,v1:172.21.15.184:6837/387834603] up:boot 2024-06-06T02:33:29.517 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:29 smithi103 ceph-mon[36349]: fsmap 7 up:standby 2024-06-06T02:33:29.517 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:33:29.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:29 smithi184 ceph-mon[36922]: Deploying daemon mds.h on smithi103 2024-06-06T02:33:29.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:29 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/494884667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:29.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:29 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6836/387834603,v1:172.21.15.184:6837/387834603] up:boot 2024-06-06T02:33:29.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:29 smithi184 ceph-mon[36922]: fsmap 7 up:standby 2024-06-06T02:33:29.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:33:30.117 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:29 smithi103 systemd[1]: Starting Ceph mds.h for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:30.463 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:30 smithi103 ceph-mon[36349]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:30.463 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 podman[65867]: 2024-06-06 02:33:30.07886092 +0000 UTC m=+0.017328377 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:30.463 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 podman[65867]: 2024-06-06 02:33:30.203836173 +0000 UTC m=+0.142303662 container create b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-06T02:33:30.464 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 podman[65867]: 2024-06-06 02:33:30.464736646 +0000 UTC m=+0.403204094 container init b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T02:33:30.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:30 smithi082 ceph-mon[31579]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:30.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:30 smithi184 ceph-mon[36922]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:30.867 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 podman[65867]: 2024-06-06 02:33:30.467480263 +0000 UTC m=+0.405947711 container start b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:33:30.867 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 ceph-mds[65886]: -- 172.21.15.103:0/3021311277 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ec4bdb5860 con 0x55ec4ff67600 2024-06-06T02:33:30.867 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h[65882]: starting mds.h at 2024-06-06T02:33:30.867 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 bash[65867]: b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f 2024-06-06T02:33:30.867 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:33:30 smithi103 systemd[1]: Started Ceph mds.h for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:31.152 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:31.597 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: Deploying daemon mds.i on smithi184 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6836/2953735672,v1:172.21.15.103:6837/2953735672] up:boot 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: fsmap 8 up:standby 2024-06-06T02:33:31.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:31 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T02:33:31.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: Deploying daemon mds.i on smithi184 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6836/2953735672,v1:172.21.15.103:6837/2953735672] up:boot 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: fsmap 8 up:standby 2024-06-06T02:33:31.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:31 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:32.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:32.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: Deploying daemon mds.i on smithi184 2024-06-06T02:33:32.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:32.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6836/2953735672,v1:172.21.15.103:6837/2953735672] up:boot 2024-06-06T02:33:32.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: fsmap 8 up:standby 2024-06-06T02:33:32.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:31 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-06T02:33:32.898 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:32 smithi184 systemd[1]: Starting Ceph mds.i for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:33.205 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:32 smithi184 podman[67725]: 2024-06-06 02:33:32.835571175 +0000 UTC m=+0.016969628 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:33.206 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:32 smithi184 podman[67725]: 2024-06-06 02:33:32.962397578 +0000 UTC m=+0.143796018 container create 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=) 2024-06-06T02:33:33.206 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 podman[67725]: 2024-06-06 02:33:33.207083444 +0000 UTC m=+0.388481885 container init 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T02:33:33.647 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 podman[67725]: 2024-06-06 02:33:33.209806138 +0000 UTC m=+0.391204583 container start 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-06-06T02:33:33.647 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 ceph-mds[67744]: -- 172.21.15.184:0/1144100109 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0948cf860 con 0x55a098a81180 2024-06-06T02:33:33.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: starting mds.i at 2024-06-06T02:33:33.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 bash[67725]: 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 2024-06-06T02:33:33.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:33:33 smithi184 systemd[1]: Started Ceph mds.i for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:33.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 -- 172.21.15.82:0/1707245577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c074cd0 msgr2=0x7f2a4c0750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 --2- 172.21.15.82:0/1707245577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c0750e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009900 tx=0x7f2a3c02a480 comp rx=0 tx=0).stop 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 -- 172.21.15.82:0/1707245577 shutdown_connections 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 --2- 172.21.15.82:0/1707245577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c10f490 0x7f2a4c1118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 --2- 172.21.15.82:0/1707245577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c075620 0x7f2a4c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 --2- 172.21.15.82:0/1707245577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c0750e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 -- 172.21.15.82:0/1707245577 >> 172.21.15.82:0/1707245577 conn(0x7f2a4c079d40 msgr2=0x7f2a4c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:33.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 -- 172.21.15.82:0/1707245577 shutdown_connections 2024-06-06T02:33:33.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.793+0000 7f2a51200640 1 -- 172.21.15.82:0/1707245577 wait complete. 2024-06-06T02:33:33.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.794+0000 7f2a51200640 1 Processor -- start 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.794+0000 7f2a51200640 1 -- start start 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 0x7f2a4c1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 0x7f2a4c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c115080 con 0x7f2a4c074cd0 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c114f00 con 0x7f2a4c10f490 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a51200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c115200 con 0x7f2a4c075620 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a49e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a49e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49774/0 (socket says 172.21.15.82:49774) 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a49e00640 1 -- 172.21.15.82:0/957415650 learned_addr learned my addr 172.21.15.82:0/957415650 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a49400640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 0x7f2a4c1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.795+0000 7f2a4a800640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 0x7f2a4c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:33.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 -- 172.21.15.82:0/957415650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 msgr2=0x7f2a4c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 0x7f2a4c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 -- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 msgr2=0x7f2a4c1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 -- 172.21.15.82:0/957415650 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c19bf60 con 0x7f2a4c075620 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a4a800640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 0x7f2a4c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49e00640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a49400640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 0x7f2a4c1a1c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800e9c0 tx=0x7f2a3800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800cd80 con 0x7f2a4c075620 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.796+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a380035f0 con 0x7f2a4c075620 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.797+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c19c250 con 0x7f2a4c075620 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.797+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38010690 con 0x7f2a4c075620 2024-06-06T02:33:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.797+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1a8560 con 0x7f2a4c075620 2024-06-06T02:33:33.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.798+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4c0750e0 con 0x7f2a4c075620 2024-06-06T02:33:33.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.802+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2a380037a0 con 0x7f2a4c075620 2024-06-06T02:33:33.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.803+0000 7f2a42a00640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 0x7f2a300b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:33.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.804+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f2a380e20d0 con 0x7f2a4c075620 2024-06-06T02:33:33.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.804+0000 7f2a49e00640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 0x7f2a300b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:33.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.805+0000 7f2a49e00640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 0x7f2a300b4d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009230 tx=0x7f2a3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:33.808+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a380aa290 con 0x7f2a4c075620 2024-06-06T02:33:34.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.086+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a4c10a610 con 0x7f2a4c075620 2024-06-06T02:33:34.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.087+0000 7f2a42a00640 1 -- 172.21.15.82:0/957415650 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8007 (secure 0 0 0) 0x7f2a380a9b90 con 0x7f2a4c075620 2024-06-06T02:33:34.087 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:34.088 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-06-06T02:33:34.088 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-06-06T02:33:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 msgr2=0x7f2a300b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 0x7f2a300b4d00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009230 tx=0x7f2a3c0058d0 comp rx=0 tx=0).stop 2024-06-06T02:33:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 msgr2=0x7f2a4c1a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:34.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 0x7f2a4c1a1c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800e9c0 tx=0x7f2a3800ee80 comp rx=0 tx=0).stop 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 shutdown_connections 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a4c10f490 0x7f2a4c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2a300b27f0 0x7f2a300b4d00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a4c075620 0x7f2a4c1a1c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 --2- 172.21.15.82:0/957415650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a4c074cd0 0x7f2a4c1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 >> 172.21.15.82:0/957415650 conn(0x7f2a4c079d40 msgr2=0x7f2a4c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 shutdown_connections 2024-06-06T02:33:34.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:34.090+0000 7f2a51200640 1 -- 172.21.15.82:0/957415650 wait complete. 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:34.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:34.613 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: Deploying daemon mds.g on smithi082 2024-06-06T02:33:34.613 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:boot 2024-06-06T02:33:34.613 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: fsmap 9 up:standby 2024-06-06T02:33:34.613 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:33:34.613 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:34 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/957415650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: Deploying daemon mds.g on smithi082 2024-06-06T02:33:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:boot 2024-06-06T02:33:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: fsmap 9 up:standby 2024-06-06T02:33:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:33:34.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:34 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/957415650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: Deploying daemon mds.g on smithi082 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:boot 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: fsmap 9 up:standby 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:33:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:34 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/957415650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:36 smithi103 ceph-mon[36349]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:36 smithi082 ceph-mon[31579]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:36 smithi184 ceph-mon[36922]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:36.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:37.032 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:36 smithi082 systemd[1]: Starting Ceph mds.g for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:37.284 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 podman[76014]: 2024-06-06 02:33:37.0237203 +0000 UTC m=+0.031791588 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:37.285 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 podman[76014]: 2024-06-06 02:33:37.144885388 +0000 UTC m=+0.152956713 container create 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-06-06T02:33:37.613 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:37.762 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 podman[76014]: 2024-06-06 02:33:37.407412155 +0000 UTC m=+0.415483544 container init 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=) 2024-06-06T02:33:37.763 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 podman[76014]: 2024-06-06 02:33:37.417456374 +0000 UTC m=+0.425527666 container start 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-06T02:33:37.763 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 bash[76014]: 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d 2024-06-06T02:33:37.763 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 systemd[1]: Started Ceph mds.g for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:37.763 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 ceph-mds[76075]: -- 172.21.15.82:0/1150418628 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cade511860 con 0x55cae26c3a80 2024-06-06T02:33:37.763 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:33:37 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: starting mds.g at 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:38.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:38.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:39.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:39 smithi082 ceph-mon[31579]: Deploying daemon mds.a on smithi082 2024-06-06T02:33:39.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:39 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:boot 2024-06-06T02:33:39.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:39 smithi082 ceph-mon[31579]: fsmap 10 up:standby 2024-06-06T02:33:39.566 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:39 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:33:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:39 smithi184 ceph-mon[36922]: Deploying daemon mds.a on smithi082 2024-06-06T02:33:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:39 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:boot 2024-06-06T02:33:39.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:39 smithi184 ceph-mon[36922]: fsmap 10 up:standby 2024-06-06T02:33:39.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:39 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:33:39.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:39 smithi103 ceph-mon[36349]: Deploying daemon mds.a on smithi082 2024-06-06T02:33:39.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:39 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:boot 2024-06-06T02:33:39.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:39 smithi103 ceph-mon[36349]: fsmap 10 up:standby 2024-06-06T02:33:39.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:39 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:33:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 -- 172.21.15.82:0/840117586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 msgr2=0x7f6ec80750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 --2- 172.21.15.82:0/840117586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec80750e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009860 tx=0x7f6ec002a3d0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 -- 172.21.15.82:0/840117586 shutdown_connections 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 --2- 172.21.15.82:0/840117586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec810f2e0 0x7f6ec8111740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 --2- 172.21.15.82:0/840117586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec8075620 0x7f6ec810eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 --2- 172.21.15.82:0/840117586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec80750e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.911+0000 7f6ecda00640 1 -- 172.21.15.82:0/840117586 >> 172.21.15.82:0/840117586 conn(0x7f6ec80fe790 msgr2=0x7f6ec8100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.912+0000 7f6ecda00640 1 -- 172.21.15.82:0/840117586 shutdown_connections 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.912+0000 7f6ecda00640 1 -- 172.21.15.82:0/840117586 wait complete. 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 Processor -- start 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 -- start start 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec81a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8114f00 con 0x7f6ec8075620 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8114d80 con 0x7f6ec8074cd0 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.913+0000 7f6ecda00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec8115080 con 0x7f6ec810f2e0 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ec7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:34330/0 (socket says 172.21.15.82:34330) 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 -- 172.21.15.82:0/919926921 learned_addr learned my addr 172.21.15.82:0/919926921 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ec7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49802/0 (socket says 172.21.15.82:49802) 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ec7e00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec81a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 -- 172.21.15.82:0/919926921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 msgr2=0x7f6ec81a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec81a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 -- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 msgr2=0x7f6ec81a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 -- 172.21.15.82:0/919926921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec819bf20 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ec7400640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.914+0000 7f6ecd000640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e940 tx=0x7f6eb800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.915+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800cd80 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.915+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6eb80035f0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.915+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec819c1b0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.915+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8010670 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.915+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec81a8410 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.916+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec8076240 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.919+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6eb8003ac0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.920+0000 7f6ec4c00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 0x7f6eac0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.920+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f6eb80e20a0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.920+0000 7f6ec7e00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 0x7f6eac0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.921+0000 7f6ec7e00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 0x7f6eac0b4d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ec002a9c0 tx=0x7f6ec0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:39.922+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6eb80aa1c0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.170+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ec810a460 con 0x7f6ec810f2e0 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.171+0000 7f6ec4c00640 1 -- 172.21.15.82:0/919926921 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8833 (secure 0 0 0) 0x7f6eb80a9ac0 con 0x7f6ec810f2e0 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:40.179 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 msgr2=0x7f6eac0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 0x7f6eac0b4d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6ec002a9c0 tx=0x7f6ec0005c90 comp rx=0 tx=0).stop 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 msgr2=0x7f6ec819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800e940 tx=0x7f6eb800ee00 comp rx=0 tx=0).stop 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 shutdown_connections 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6eac0b27f0 0x7f6eac0b4d00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ec810f2e0 0x7f6ec819b7f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ec8075620 0x7f6ec81a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 --2- 172.21.15.82:0/919926921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ec8074cd0 0x7f6ec81a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:40.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 >> 172.21.15.82:0/919926921 conn(0x7f6ec80fe790 msgr2=0x7f6ec80ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:40.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 shutdown_connections 2024-06-06T02:33:40.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:40.175+0000 7f6ecda00640 1 -- 172.21.15.82:0/919926921 wait complete. 2024-06-06T02:33:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:40 smithi082 ceph-mon[31579]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:40.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:40 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/919926921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:40 smithi184 ceph-mon[36922]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:40 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/919926921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:40 smithi103 ceph-mon[36349]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:40 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/919926921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:42.559 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:42 smithi082 ceph-mon[31579]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:42 smithi184 ceph-mon[36922]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:42 smithi103 ceph-mon[36349]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:42.872 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:42 smithi082 podman[76466]: 2024-06-06 02:33:42.595023959 +0000 UTC m=+0.163071001 container create 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-06T02:33:43.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:33:43.369 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:42 smithi082 podman[76466]: 2024-06-06 02:33:42.907994562 +0000 UTC m=+0.476041627 container init 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-06T02:33:43.369 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:42 smithi082 podman[76466]: 2024-06-06 02:33:42.918317253 +0000 UTC m=+0.486364305 container start 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-06-06T02:33:43.370 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:43 smithi082 bash[76466]: 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 2024-06-06T02:33:43.370 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:43 smithi082 ceph-mds[76485]: -- 172.21.15.82:0/3266196572 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d3465ff860 con 0x55d34a7b1600 2024-06-06T02:33:43.370 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:43 smithi082 systemd[1]: Started Ceph mds.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:43.370 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:33:43 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: starting mds.a at 2024-06-06T02:33:43.749 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:44.236 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: Deploying daemon mds.b on smithi103 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6840/109083450,v1:172.21.15.82:6841/109083450] up:boot 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: fsmap 11 up:standby 2024-06-06T02:33:44.237 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:44 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:33:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: Deploying daemon mds.b on smithi103 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6840/109083450,v1:172.21.15.82:6841/109083450] up:boot 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: fsmap 11 up:standby 2024-06-06T02:33:44.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:44 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:33:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: Deploying daemon mds.b on smithi103 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6840/109083450,v1:172.21.15.82:6841/109083450] up:boot 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: fsmap 11 up:standby 2024-06-06T02:33:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:44 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:33:45.117 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 systemd[1]: Starting Ceph mds.b for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:33:45.511 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 podman[66181]: 2024-06-06 02:33:45.257703941 +0000 UTC m=+0.110571411 container create 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:33:45.511 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 podman[66181]: 2024-06-06 02:33:45.16460086 +0000 UTC m=+0.017468350 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:33:45.511 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 podman[66181]: 2024-06-06 02:33:45.477174797 +0000 UTC m=+0.330042268 container init 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-06T02:33:45.512 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 podman[66181]: 2024-06-06 02:33:45.47969616 +0000 UTC m=+0.332563637 container start 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:33:45.867 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 ceph-mds[66200]: -- 172.21.15.103:0/3551395993 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56367ddc3860 con 0x563681f75180 2024-06-06T02:33:45.867 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: starting mds.b at 2024-06-06T02:33:45.867 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 bash[66181]: 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a 2024-06-06T02:33:45.867 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:33:45 smithi103 systemd[1]: Started Ceph mds.b for b8ccb8a2-23ab-11ef-bc9b-c7b262605968. 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 -- 172.21.15.82:0/2470152628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 msgr2=0x7f4ff8101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 --2- 172.21.15.82:0/2470152628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff8101e30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009900 tx=0x7f4fe802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 -- 172.21.15.82:0/2470152628 shutdown_connections 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 --2- 172.21.15.82:0/2470152628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 --2- 172.21.15.82:0/2470152628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff810f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 --2- 172.21.15.82:0/2470152628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff8101e30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 -- 172.21.15.82:0/2470152628 >> 172.21.15.82:0/2470152628 conn(0x7f4ff8078a80 msgr2=0x7f4ff8078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 -- 172.21.15.82:0/2470152628 shutdown_connections 2024-06-06T02:33:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.997+0000 7f4ffda00640 1 -- 172.21.15.82:0/2470152628 wait complete. 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.998+0000 7f4ffda00640 1 Processor -- start 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 -- start start 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8115010 con 0x7f4ff8102370 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8114e90 con 0x7f4ff810f5d0 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ffda00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff8115190 con 0x7f4ff8101a20 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ff6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ff7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ff6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:32914/0 (socket says 172.21.15.82:32914) 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ff6a00640 1 -- 172.21.15.82:0/36009491 learned_addr learned my addr 172.21.15.82:0/36009491 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:45.999+0000 7f4ff6000640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 -- 172.21.15.82:0/36009491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 msgr2=0x7f4ff81a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 -- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 msgr2=0x7f4ff819c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff819c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 -- 172.21.15.82:0/36009491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81a0a30 con 0x7f4ff8101a20 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6000640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff819c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff7400640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4ff6a00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8005940 tx=0x7f4fe80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe803f030 con 0x7f4ff8101a20 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.000+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fe80044c0 con 0x7f4ff8101a20 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.001+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81a0cc0 con 0x7f4ff8101a20 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.001+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8035070 con 0x7f4ff8101a20 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.001+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff81a11f0 con 0x7f4ff8101a20 2024-06-06T02:33:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.002+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff8101e30 con 0x7f4ff8101a20 2024-06-06T02:33:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.004+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4fe8042030 con 0x7f4ff8101a20 2024-06-06T02:33:46.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.006+0000 7f4fef400640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 0x7f4fdc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:46.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.006+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f4fe8101e10 con 0x7f4ff8101a20 2024-06-06T02:33:46.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.006+0000 7f4ff6000640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 0x7f4fdc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:46.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.007+0000 7f4ff6000640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 0x7f4fdc0b4d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8110370 tx=0x7f4fe4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:46.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.010+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4fe8105030 con 0x7f4ff8101a20 2024-06-06T02:33:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.261+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff810a760 con 0x7f4ff8101a20 2024-06-06T02:33:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.261+0000 7f4fef400640 1 -- 172.21.15.82:0/36009491 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10482 (secure 0 0 0) 0x7f4fe80c9f30 con 0x7f4ff8101a20 2024-06-06T02:33:46.262 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:46.262 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24643,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[]} 2024-06-06T02:33:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-06-06T02:33:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 msgr2=0x7f4fdc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 0x7f4fdc0b4d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8110370 tx=0x7f4fe4005f90 comp rx=0 tx=0).stop 2024-06-06T02:33:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 msgr2=0x7f4ff819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8005940 tx=0x7f4fe80040c0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 shutdown_connections 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ff810f5d0 0x7f4ff81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ff8102370 0x7f4ff819c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4fdc0b2870 0x7f4fdc0b4d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 --2- 172.21.15.82:0/36009491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ff8101a20 0x7f4ff819bbb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.264+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 >> 172.21.15.82:0/36009491 conn(0x7f4ff8078a80 msgr2=0x7f4ff8110c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.265+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 shutdown_connections 2024-06-06T02:33:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:46.265+0000 7f4ffda00640 1 -- 172.21.15.82:0/36009491 wait complete. 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:46 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:46 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:46.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:46.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:46 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:47.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-06-06T02:33:47.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:47 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:boot 2024-06-06T02:33:47.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:47 smithi184 ceph-mon[36922]: fsmap 12 up:standby 2024-06-06T02:33:47.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:47 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:33:47.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:47 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/36009491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:47.565 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:47 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:boot 2024-06-06T02:33:47.565 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:47 smithi103 ceph-mon[36349]: fsmap 12 up:standby 2024-06-06T02:33:47.565 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:47 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:33:47.565 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:47 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/36009491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:47.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:47 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:boot 2024-06-06T02:33:47.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:47 smithi082 ceph-mon[31579]: fsmap 12 up:standby 2024-06-06T02:33:47.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:47 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:33:47.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:47 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/36009491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:33:48.220 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:48.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:48 smithi082 ceph-mon[31579]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:48.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.563 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:48 smithi103 ceph-mon[36349]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:48 smithi184 ceph-mon[36922]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:48.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:50.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.454+0000 7fe7ab200640 1 -- 172.21.15.82:0/2099631364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac107990 msgr2=0x7fe7ac107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.454+0000 7fe7ab200640 1 --2- 172.21.15.82:0/2099631364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac107990 0x7fe7ac107da0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe79c009890 tx=0x7fe79c02a360 comp rx=0 tx=0).stop 2024-06-06T02:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 -- 172.21.15.82:0/2099631364 shutdown_connections 2024-06-06T02:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 --2- 172.21.15.82:0/2099631364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 --2- 172.21.15.82:0/2099631364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 --2- 172.21.15.82:0/2099631364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac107990 0x7fe7ac107da0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 -- 172.21.15.82:0/2099631364 >> 172.21.15.82:0/2099631364 conn(0x7fe7ac0fd6f0 msgr2=0x7fe7ac0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 -- 172.21.15.82:0/2099631364 shutdown_connections 2024-06-06T02:33:50.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.455+0000 7fe7ab200640 1 -- 172.21.15.82:0/2099631364 wait complete. 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.456+0000 7fe7ab200640 1 Processor -- start 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.456+0000 7fe7ab200640 1 -- start start 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac107990 0x7fe7ac19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac111ba0 con 0x7fe7ac101960 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac111a20 con 0x7fe7ac1022b0 2024-06-06T02:33:50.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7ab200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac111d20 con 0x7fe7ac107990 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7a9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7a9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41970/0 (socket says 172.21.15.82:41970) 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7a9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44270/0 (socket says 172.21.15.82:44270) 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7a9400640 1 -- 172.21.15.82:0/113072316 learned_addr learned my addr 172.21.15.82:0/113072316 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.457+0000 7fe7aa800640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac107990 0x7fe7ac19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 -- 172.21.15.82:0/113072316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac107990 msgr2=0x7fe7ac19dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:50.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac107990 0x7fe7ac19dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 -- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 msgr2=0x7fe7ac199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 -- 172.21.15.82:0/113072316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac19e5e0 con 0x7fe7ac1022b0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a9400640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe798009fd0 tx=0x7fe79800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79800ccc0 con 0x7fe7ac1022b0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe79800ce60 con 0x7fe7ac1022b0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac19e8d0 con 0x7fe7ac1022b0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798010430 con 0x7fe7ac1022b0 2024-06-06T02:33:50.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.458+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac1a6250 con 0x7fe7ac1022b0 2024-06-06T02:33:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.460+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac101d70 con 0x7fe7ac1022b0 2024-06-06T02:33:50.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.462+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe798003710 con 0x7fe7ac1022b0 2024-06-06T02:33:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.464+0000 7fe7a2a00640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 0x7fe7900b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:50.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.464+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fe7980e2060 con 0x7fe7ac1022b0 2024-06-06T02:33:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.464+0000 7fe7a9e00640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 0x7fe7900b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:50.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.465+0000 7fe7a9e00640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 0x7fe7900b4d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe79c02a950 tx=0x7fe79c0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.468+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7980aa180 con 0x7fe7ac1022b0 2024-06-06T02:33:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:50 smithi103 ceph-mon[36349]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:50 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:50.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:50 smithi082 ceph-mon[31579]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:50.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:50 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:50 smithi184 ceph-mon[36922]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:50 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:50.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.687+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe7ac1a64b0 con 0x7fe7ac1022b0 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.688+0000 7fe7a2a00640 1 -- 172.21.15.82:0/113072316 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fe7980b2070 con 0x7fe7ac1022b0 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:33:50.688 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 msgr2=0x7fe7900b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 0x7fe7900b4d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe79c02a950 tx=0x7fe79c0056d0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 msgr2=0x7fe7ac199cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe798009fd0 tx=0x7fe79800ed90 comp rx=0 tx=0).stop 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 shutdown_connections 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe7900b2870 0x7fe7900b4d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7ac107990 0x7fe7ac19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7ac1022b0 0x7fe7ac199cd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 --2- 172.21.15.82:0/113072316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ac101960 0x7fe7ac199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:50.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 >> 172.21.15.82:0/113072316 conn(0x7fe7ac0fd6f0 msgr2=0x7fe7ac1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:50.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 shutdown_connections 2024-06-06T02:33:50.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:50.691+0000 7fe7ab200640 1 -- 172.21.15.82:0/113072316 wait complete. 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/113072316' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T02:33:51.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:51 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:51.622 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.622 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.622 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:51.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:51.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/113072316' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T02:33:51.623 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:51 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:51.668 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-06T02:33:51.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:51.742 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/113072316' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-06T02:33:51.743 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:51 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:33:52.747 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:52 smithi103 ceph-mon[36349]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:52 smithi082 ceph-mon[31579]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:52 smithi184 ceph-mon[36922]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:54.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:54 smithi082 ceph-mon[31579]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:54.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:54 smithi103 ceph-mon[36349]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:54.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:54 smithi184 ceph-mon[36922]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 -- 172.21.15.82:0/1796694705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11301077f0 msgr2=0x7f1130107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 --2- 172.21.15.82:0/1796694705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11301077f0 0x7f1130107c00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1118009c40 tx=0x7f111802a710 comp rx=0 tx=0).stop 2024-06-06T02:33:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 -- 172.21.15.82:0/1796694705 shutdown_connections 2024-06-06T02:33:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 --2- 172.21.15.82:0/1796694705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1130108140 0x7f113010faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 --2- 172.21.15.82:0/1796694705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11301077f0 0x7f1130107c00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 --2- 172.21.15.82:0/1796694705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 0x7f11301032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 -- 172.21.15.82:0/1796694705 >> 172.21.15.82:0/1796694705 conn(0x7f1130079cb0 msgr2=0x7f113007a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 -- 172.21.15.82:0/1796694705 shutdown_connections 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.039+0000 7f1134e00640 1 -- 172.21.15.82:0/1796694705 wait complete. 2024-06-06T02:33:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.040+0000 7f1134e00640 1 Processor -- start 2024-06-06T02:33:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.040+0000 7f1134e00640 1 -- start start 2024-06-06T02:33:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 0x7f11301a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 0x7f113019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1130112e50 con 0x7f1130108140 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1130112cd0 con 0x7f1130102ec0 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f1134e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1130112fd0 con 0x7f11301077f0 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f112de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 0x7f11301a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f112d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f112e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 0x7f113019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f112d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35000/0 (socket says 172.21.15.82:35000) 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.041+0000 7f112d400640 1 -- 172.21.15.82:0/2412816730 learned_addr learned my addr 172.21.15.82:0/2412816730 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 -- 172.21.15.82:0/2412816730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 msgr2=0x7f11301a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 0x7f11301a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 -- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 msgr2=0x7f113019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 0x7f113019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 -- 172.21.15.82:0/2412816730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113019bff0 con 0x7f11301077f0 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112e800640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 0x7f113019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.042+0000 7f112d400640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f111802ad00 tx=0x7f1118003c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.043+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118041030 con 0x7f11301077f0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.043+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113019c280 con 0x7f11301077f0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.043+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11180318f0 con 0x7f11301077f0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.043+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118036040 con 0x7f11301077f0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.043+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113019c7b0 con 0x7f11301077f0 2024-06-06T02:33:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.045+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11301032d0 con 0x7f11301077f0 2024-06-06T02:33:55.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.047+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1118044070 con 0x7f11301077f0 2024-06-06T02:33:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.048+0000 7f1126a00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 0x7f11100b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.048+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f11181029b0 con 0x7f11301077f0 2024-06-06T02:33:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.048+0000 7f112de00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 0x7f11100b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.049+0000 7f112de00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 0x7f11100b4d00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f113019cac0 tx=0x7f1120005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.052+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f113019c7b0 con 0x7f11301077f0 2024-06-06T02:33:55.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.279+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f11301a8740 con 0x7f11301077f0 2024-06-06T02:33:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.540+0000 7f1126a00640 1 -- 172.21.15.82:0/2412816730 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f11180caad0 con 0x7f11301077f0 2024-06-06T02:33:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-06-06T02:33:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 msgr2=0x7f11100b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 0x7f11100b4d00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f113019cac0 tx=0x7f1120005f90 comp rx=0 tx=0).stop 2024-06-06T02:33:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 msgr2=0x7f11301a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:55.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f111802ad00 tx=0x7f1118003c90 comp rx=0 tx=0).stop 2024-06-06T02:33:55.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 shutdown_connections 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1130108140 0x7f113019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11100b27f0 0x7f11100b4d00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11301077f0 0x7f11301a1ca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 --2- 172.21.15.82:0/2412816730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1130102ec0 0x7f11301a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.547+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 >> 172.21.15.82:0/2412816730 conn(0x7f1130079cb0 msgr2=0x7f11301053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.548+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 shutdown_connections 2024-06-06T02:33:55.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:55.548+0000 7f1134e00640 1 -- 172.21.15.82:0/2412816730 wait complete. 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2412816730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:55.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:55.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:55 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:55.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2412816730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:55.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:55 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:55.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2412816730' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:33:55.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:55 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:33:56.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-06T02:33:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:33:56.813 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:56 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T02:33:56.814 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:56 smithi184 ceph-mon[36922]: osdmap e72: 12 total, 12 up, 12 in 2024-06-06T02:33:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:56 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T02:33:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:56 smithi103 ceph-mon[36349]: osdmap e72: 12 total, 12 up, 12 in 2024-06-06T02:33:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:56 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-06T02:33:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:56 smithi082 ceph-mon[31579]: osdmap e72: 12 total, 12 up, 12 in 2024-06-06T02:33:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:57 smithi103 ceph-mon[36349]: osdmap e73: 12 total, 12 up, 12 in 2024-06-06T02:33:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:57 smithi103 ceph-mon[36349]: pgmap v324: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:57 smithi082 ceph-mon[31579]: osdmap e73: 12 total, 12 up, 12 in 2024-06-06T02:33:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:57 smithi082 ceph-mon[31579]: pgmap v324: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:57 smithi184 ceph-mon[36922]: osdmap e73: 12 total, 12 up, 12 in 2024-06-06T02:33:57.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:57 smithi184 ceph-mon[36922]: pgmap v324: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:58 smithi103 ceph-mon[36349]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:33:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:58 smithi103 ceph-mon[36349]: osdmap e74: 12 total, 12 up, 12 in 2024-06-06T02:33:58.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:58 smithi082 ceph-mon[31579]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:33:58.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:58 smithi082 ceph-mon[31579]: osdmap e74: 12 total, 12 up, 12 in 2024-06-06T02:33:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:58 smithi184 ceph-mon[36922]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:33:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:58 smithi184 ceph-mon[36922]: osdmap e74: 12 total, 12 up, 12 in 2024-06-06T02:33:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 -- 172.21.15.82:0/936524078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4108ac0 msgr2=0x7fa1c4108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 --2- 172.21.15.82:0/936524078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4108ac0 0x7fa1c4108ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009890 tx=0x7fa1b402a360 comp rx=0 tx=0).stop 2024-06-06T02:33:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 -- 172.21.15.82:0/936524078 shutdown_connections 2024-06-06T02:33:59.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 --2- 172.21.15.82:0/936524078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c41033e0 0x7fa1c410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 --2- 172.21.15.82:0/936524078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c4102a90 0x7fa1c4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 --2- 172.21.15.82:0/936524078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4108ac0 0x7fa1c4108ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 -- 172.21.15.82:0/936524078 >> 172.21.15.82:0/936524078 conn(0x7fa1c40fe7e0 msgr2=0x7fa1c4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 -- 172.21.15.82:0/936524078 shutdown_connections 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.139+0000 7fa1c9400640 1 -- 172.21.15.82:0/936524078 wait complete. 2024-06-06T02:33:59.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.141+0000 7fa1c9400640 1 Processor -- start 2024-06-06T02:33:59.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.141+0000 7fa1c9400640 1 -- start start 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 0x7fa1c4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 0x7fa1c4199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 0x7fa1c419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112cd0 con 0x7fa1c4108ac0 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112b50 con 0x7fa1c4102a90 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c9400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c4112e50 con 0x7fa1c41033e0 2024-06-06T02:33:59.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 0x7fa1c419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:59.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 0x7fa1c4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:59.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 0x7fa1c4199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:59.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 0x7fa1c4199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:52386/0 (socket says 172.21.15.82:52386) 2024-06-06T02:33:59.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.142+0000 7fa1c3e00640 1 -- 172.21.15.82:0/2312127414 learned_addr learned my addr 172.21.15.82:0/2312127414 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 -- 172.21.15.82:0/2312127414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 msgr2=0x7fa1c4199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 0x7fa1c4199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 -- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 msgr2=0x7fa1c419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 0x7fa1c419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 -- 172.21.15.82:0/2312127414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c419e5c0 con 0x7fa1c41033e0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c8a00640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 0x7fa1c419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c3400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 0x7fa1c4199cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000e9c0 tx=0x7fa1b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.143+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b000ccc0 con 0x7fa1c41033e0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.144+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1b000ce60 con 0x7fa1c41033e0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.144+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c419e8b0 con 0x7fa1c41033e0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.144+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0004a00 con 0x7fa1c41033e0 2024-06-06T02:33:59.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.144+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c41a6230 con 0x7fa1c41033e0 2024-06-06T02:33:59.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.145+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c4102ea0 con 0x7fa1c41033e0 2024-06-06T02:33:59.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.148+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa1b0005020 con 0x7fa1c41033e0 2024-06-06T02:33:59.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.150+0000 7fa1c0c00640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 0x7fa1a80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:33:59.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.150+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7fa1b00e1ed0 con 0x7fa1c41033e0 2024-06-06T02:33:59.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.150+0000 7fa1c3e00640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 0x7fa1a80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:33:59.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.151+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa1b00a9f10 con 0x7fa1c41033e0 2024-06-06T02:33:59.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.151+0000 7fa1c3e00640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 0x7fa1a80b4d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40095f0 tx=0x7fa1b4005890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:33:59.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.361+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa1c419aab0 con 0x7fa1c41033e0 2024-06-06T02:33:59.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.601+0000 7fa1c0c00640 1 -- 172.21.15.82:0/2312127414 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7fa1c419aab0 con 0x7fa1c41033e0 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.608+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 msgr2=0x7fa1a80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.608+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 0x7fa1a80b4d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40095f0 tx=0x7fa1b4005890 comp rx=0 tx=0).stop 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.608+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 msgr2=0x7fa1c4199cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.608+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 0x7fa1c4199cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000e9c0 tx=0x7fa1b000ee80 comp rx=0 tx=0).stop 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 shutdown_connections 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1c4108ac0 0x7fa1c419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1a80b2870 0x7fa1a80b4d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1c41033e0 0x7fa1c4199cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 --2- 172.21.15.82:0/2312127414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1c4102a90 0x7fa1c4199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:33:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.609+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 >> 172.21.15.82:0/2312127414 conn(0x7fa1c40fe7e0 msgr2=0x7fa1c4100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:33:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.610+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 shutdown_connections 2024-06-06T02:33:59.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:33:59.610+0000 7fa1c9400640 1 -- 172.21.15.82:0/2312127414 wait complete. 2024-06-06T02:33:59.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:59 smithi082 ceph-mon[31579]: pgmap v326: 33 pgs: 9 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:59.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2312127414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:33:59.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:33:59 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:33:59.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:59 smithi103 ceph-mon[36349]: pgmap v326: 33 pgs: 9 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:59.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:59 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2312127414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:33:59.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:33:59 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:33:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:59 smithi184 ceph-mon[36922]: pgmap v326: 33 pgs: 9 creating+peering, 6 active+clean, 18 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:33:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:59 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2312127414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:33:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:33:59 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-06T02:34:00.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-06T02:34:00.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:00 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T02:34:00.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:00 smithi103 ceph-mon[36349]: osdmap e75: 12 total, 12 up, 12 in 2024-06-06T02:34:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:00 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T02:34:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:00 smithi082 ceph-mon[31579]: osdmap e75: 12 total, 12 up, 12 in 2024-06-06T02:34:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:00 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-06T02:34:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:00 smithi184 ceph-mon[36922]: osdmap e75: 12 total, 12 up, 12 in 2024-06-06T02:34:01.022 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:01.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:01 smithi103 ceph-mon[36349]: osdmap e76: 12 total, 12 up, 12 in 2024-06-06T02:34:01.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:01 smithi103 ceph-mon[36349]: pgmap v329: 97 pgs: 23 creating+peering, 24 active+clean, 50 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:01.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:01 smithi082 ceph-mon[31579]: osdmap e76: 12 total, 12 up, 12 in 2024-06-06T02:34:01.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:01 smithi082 ceph-mon[31579]: pgmap v329: 97 pgs: 23 creating+peering, 24 active+clean, 50 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:01.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:01 smithi184 ceph-mon[36922]: osdmap e76: 12 total, 12 up, 12 in 2024-06-06T02:34:01.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:01 smithi184 ceph-mon[36922]: pgmap v329: 97 pgs: 23 creating+peering, 24 active+clean, 50 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:02.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:02 smithi082 ceph-mon[31579]: osdmap e77: 12 total, 12 up, 12 in 2024-06-06T02:34:02.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:02 smithi184 ceph-mon[36922]: osdmap e77: 12 total, 12 up, 12 in 2024-06-06T02:34:03.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:02 smithi103 ceph-mon[36349]: osdmap e77: 12 total, 12 up, 12 in 2024-06-06T02:34:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 -- 172.21.15.82:0/474677082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 msgr2=0x7f34b410f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 --2- 172.21.15.82:0/474677082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b410f4e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009900 tx=0x7f34ac02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 -- 172.21.15.82:0/474677082 shutdown_connections 2024-06-06T02:34:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 --2- 172.21.15.82:0/474677082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b410f4e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 --2- 172.21.15.82:0/474677082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b410ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 --2- 172.21.15.82:0/474677082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 -- 172.21.15.82:0/474677082 >> 172.21.15.82:0/474677082 conn(0x7f34b40fd6f0 msgr2=0x7f34b40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 -- 172.21.15.82:0/474677082 shutdown_connections 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.321+0000 7f34b8a00640 1 -- 172.21.15.82:0/474677082 wait complete. 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.322+0000 7f34b8a00640 1 Processor -- start 2024-06-06T02:34:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.322+0000 7f34b8a00640 1 -- start start 2024-06-06T02:34:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b4199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b419dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4112c50 con 0x7f34b4103b90 2024-06-06T02:34:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4112ad0 con 0x7f34b41044e0 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b8a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4112dd0 con 0x7f34b410cff0 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37970/0 (socket says 172.21.15.82:37970) 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b3400640 1 -- 172.21.15.82:0/1466216605 learned_addr learned my addr 172.21.15.82:0/1466216605 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34aaa00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b4199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.323+0000 7f34b3e00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b419dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 -- 172.21.15.82:0/1466216605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 msgr2=0x7f34b419dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b419dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 -- 172.21.15.82:0/1466216605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 msgr2=0x7f34b4199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b4199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 -- 172.21.15.82:0/1466216605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b419e4e0 con 0x7f34b4103b90 2024-06-06T02:34:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34aaa00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b4199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.324+0000 7f34b3400640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34a400ebc0 tx=0x7f34a400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.325+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4010630 con 0x7f34b4103b90 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.325+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a4010c80 con 0x7f34b4103b90 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.325+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b419e7d0 con 0x7f34b4103b90 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.325+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4018b90 con 0x7f34b4103b90 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.325+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b41a6150 con 0x7f34b4103b90 2024-06-06T02:34:03.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.326+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b4103fa0 con 0x7f34b4103b90 2024-06-06T02:34:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.329+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f34a40107d0 con 0x7f34b4103b90 2024-06-06T02:34:03.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.330+0000 7f34b0c00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 0x7f34980b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:03.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.331+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f34a40e2af0 con 0x7f34b4103b90 2024-06-06T02:34:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.331+0000 7f34aaa00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 0x7f34980b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.331+0000 7f34aaa00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 0x7f34980b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34b4100c70 tx=0x7f349c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:03.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.332+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f34a40aa2d0 con 0x7f34b4103b90 2024-06-06T02:34:03.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.583+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f34b41080f0 con 0x7f34b4103b90 2024-06-06T02:34:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.624+0000 7f34b0c00640 1 -- 172.21.15.82:0/1466216605 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f34a40ae5d0 con 0x7f34b4103b90 2024-06-06T02:34:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-06-06T02:34:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.628+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 msgr2=0x7f34980b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.628+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 0x7f34980b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f34b4100c70 tx=0x7f349c005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.628+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 msgr2=0x7f34b4199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.628+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34a400ebc0 tx=0x7f34a400c6a0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 shutdown_connections 2024-06-06T02:34:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f34980b2940 0x7f34980b4e50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34b410cff0 0x7f34b419dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34b41044e0 0x7f34b4199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 --2- 172.21.15.82:0/1466216605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34b4103b90 0x7f34b4199670 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.629+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 >> 172.21.15.82:0/1466216605 conn(0x7f34b40fd6f0 msgr2=0x7f34b40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.630+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 shutdown_connections 2024-06-06T02:34:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:03.630+0000 7f34b8a00640 1 -- 172.21.15.82:0/1466216605 wait complete. 2024-06-06T02:34:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:03 smithi082 ceph-mon[31579]: pgmap v331: 97 pgs: 14 creating+peering, 56 active+clean, 27 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:03 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T02:34:03.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:03 smithi082 ceph-mon[31579]: daemon mds.g assigned to filesystem cephfs as rank 0 2024-06-06T02:34:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:03 smithi184 ceph-mon[36922]: pgmap v331: 97 pgs: 14 creating+peering, 56 active+clean, 27 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:03 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T02:34:03.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:03 smithi184 ceph-mon[36922]: daemon mds.g assigned to filesystem cephfs as rank 0 2024-06-06T02:34:04.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:03 smithi103 ceph-mon[36349]: pgmap v331: 97 pgs: 14 creating+peering, 56 active+clean, 27 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:04.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:03 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-06T02:34:04.018 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:03 smithi103 ceph-mon[36349]: daemon mds.g assigned to filesystem cephfs as rank 0 2024-06-06T02:34:04.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:34:04.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:04 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T02:34:04.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:04 smithi184 ceph-mon[36922]: osdmap e78: 12 total, 12 up, 12 in 2024-06-06T02:34:04.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:04 smithi184 ceph-mon[36922]: fsmap cephfs:1 {0=g=up:creating} 11 up:standby 2024-06-06T02:34:04.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:04 smithi184 ceph-mon[36922]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:34:04.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:04 smithi184 ceph-mon[36922]: daemon mds.g is now active in filesystem cephfs as rank 0 2024-06-06T02:34:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:04 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T02:34:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:04 smithi103 ceph-mon[36349]: osdmap e78: 12 total, 12 up, 12 in 2024-06-06T02:34:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:04 smithi103 ceph-mon[36349]: fsmap cephfs:1 {0=g=up:creating} 11 up:standby 2024-06-06T02:34:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:04 smithi103 ceph-mon[36349]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:34:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:04 smithi103 ceph-mon[36349]: daemon mds.g is now active in filesystem cephfs as rank 0 2024-06-06T02:34:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:04 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1466216605' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-06T02:34:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:04 smithi082 ceph-mon[31579]: osdmap e78: 12 total, 12 up, 12 in 2024-06-06T02:34:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:04 smithi082 ceph-mon[31579]: fsmap cephfs:1 {0=g=up:creating} 11 up:standby 2024-06-06T02:34:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:04 smithi082 ceph-mon[31579]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-06-06T02:34:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:04 smithi082 ceph-mon[31579]: daemon mds.g is now active in filesystem cephfs as rank 0 2024-06-06T02:34:05.160 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:05 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:active 2024-06-06T02:34:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:05 smithi082 ceph-mon[31579]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:05 smithi082 ceph-mon[31579]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:05.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:05 smithi082 ceph-mon[31579]: pgmap v333: 97 pgs: 10 creating+peering, 87 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s wr, 5 op/s 2024-06-06T02:34:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:05 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:active 2024-06-06T02:34:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:05 smithi103 ceph-mon[36349]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:05 smithi103 ceph-mon[36349]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:06.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:05 smithi103 ceph-mon[36349]: pgmap v333: 97 pgs: 10 creating+peering, 87 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s wr, 5 op/s 2024-06-06T02:34:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:05 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] up:active 2024-06-06T02:34:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:05 smithi184 ceph-mon[36922]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:05 smithi184 ceph-mon[36922]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:06.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:05 smithi184 ceph-mon[36922]: pgmap v333: 97 pgs: 10 creating+peering, 87 active+clean; 578 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 793 B/s wr, 5 op/s 2024-06-06T02:34:06.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:06 smithi082 ceph-mon[31579]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T02:34:06.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:06 smithi082 ceph-mon[31579]: Cluster is now healthy 2024-06-06T02:34:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:06 smithi103 ceph-mon[36349]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T02:34:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:06 smithi103 ceph-mon[36349]: Cluster is now healthy 2024-06-06T02:34:07.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:06 smithi184 ceph-mon[36922]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-06-06T02:34:07.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:06 smithi184 ceph-mon[36922]: Cluster is now healthy 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.448+0000 7fed56800640 1 -- 172.21.15.82:0/4092993408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 msgr2=0x7fed50107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.448+0000 7fed56800640 1 --2- 172.21.15.82:0/4092993408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed50107c30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed38009890 tx=0x7fed3802a360 comp rx=0 tx=0).stop 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.448+0000 7fed56800640 1 -- 172.21.15.82:0/4092993408 shutdown_connections 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.448+0000 7fed56800640 1 --2- 172.21.15.82:0/4092993408 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50108170 0x7fed5010fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.449+0000 7fed56800640 1 --2- 172.21.15.82:0/4092993408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed50107c30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.449+0000 7fed56800640 1 --2- 172.21.15.82:0/4092993408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50102ef0 0x7fed50103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.449+0000 7fed56800640 1 -- 172.21.15.82:0/4092993408 >> 172.21.15.82:0/4092993408 conn(0x7fed50079d40 msgr2=0x7fed5007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.449+0000 7fed56800640 1 -- 172.21.15.82:0/4092993408 shutdown_connections 2024-06-06T02:34:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.449+0000 7fed56800640 1 -- 172.21.15.82:0/4092993408 wait complete. 2024-06-06T02:34:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.450+0000 7fed56800640 1 Processor -- start 2024-06-06T02:34:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.450+0000 7fed56800640 1 -- start start 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed501a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50108170 0x7fed5019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fed50112e60 con 0x7fed50108170 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed50112ce0 con 0x7fed50102ef0 2024-06-06T02:34:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed56800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fed50112fe0 con 0x7fed50107820 2024-06-06T02:34:07.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed4f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:07.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed4f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43662/0 (socket says 172.21.15.82:43662) 2024-06-06T02:34:07.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed4f400640 1 -- 172.21.15.82:0/1608775589 learned_addr learned my addr 172.21.15.82:0/1608775589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed46a00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed501a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.451+0000 7fed4fe00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50108170 0x7fed5019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 -- 172.21.15.82:0/1608775589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 msgr2=0x7fed501a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed501a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 -- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50108170 msgr2=0x7fed5019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50108170 0x7fed5019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 -- 172.21.15.82:0/1608775589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5019bfa0 con 0x7fed50102ef0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed46a00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed501a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4f400640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed4000e9c0 tx=0x7fed4000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000ccc0 con 0x7fed50102ef0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5019c290 con 0x7fed50102ef0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.452+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed400054d0 con 0x7fed50102ef0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.453+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40010430 con 0x7fed50102ef0 2024-06-06T02:34:07.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.453+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed501a85a0 con 0x7fed50102ef0 2024-06-06T02:34:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.454+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed501043a0 con 0x7fed50102ef0 2024-06-06T02:34:07.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.456+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fed40004f80 con 0x7fed50102ef0 2024-06-06T02:34:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.458+0000 7fed4cc00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 0x7fed340b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.458+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fed400e28b0 con 0x7fed50102ef0 2024-06-06T02:34:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.458+0000 7fed46a00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 0x7fed340b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:07.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.459+0000 7fed46a00640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 0x7fed340b4d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed38005940 tx=0x7fed380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:07.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.459+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed400aa680 con 0x7fed50102ef0 2024-06-06T02:34:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.669+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed50103300 con 0x7fed50102ef0 2024-06-06T02:34:07.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.671+0000 7fed4cc00640 1 -- 172.21.15.82:0/1608775589 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22219 (secure 0 0 0) 0x7fed400a9f80 con 0x7fed50102ef0 2024-06-06T02:34:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:34:07.672 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":78,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:03.585867+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:34:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 msgr2=0x7fed340b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 0x7fed340b4d00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed38005940 tx=0x7fed380058d0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 msgr2=0x7fed501a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed4000e9c0 tx=0x7fed4000ee80 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 shutdown_connections 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed50108170 0x7fed5019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fed340b27f0 0x7fed340b4d00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed50107820 0x7fed501a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 --2- 172.21.15.82:0/1608775589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50102ef0 0x7fed501a1710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.674+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 >> 172.21.15.82:0/1608775589 conn(0x7fed50079d40 msgr2=0x7fed5010e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.675+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 shutdown_connections 2024-06-06T02:34:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:07.675+0000 7fed56800640 1 -- 172.21.15.82:0/1608775589 wait complete. 2024-06-06T02:34:07.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:07 smithi184 ceph-mon[36922]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-06-06T02:34:08.067 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:07 smithi082 ceph-mon[31579]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-06-06T02:34:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:07 smithi103 ceph-mon[36349]: pgmap v334: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 6 op/s 2024-06-06T02:34:08.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:34:08.678 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:34:08 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: 2024-06-06T02:34:08.383+0000 7fede5600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-06T02:34:08.955 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:09.103 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:08 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1608775589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:09.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:08 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1608775589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:09.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:08 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1608775589' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:09.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:09 smithi082 ceph-mon[31579]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T02:34:10.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:09 smithi103 ceph-mon[36349]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T02:34:10.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:09 smithi184 ceph-mon[36922]: pgmap v335: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-06-06T02:34:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 -- 172.21.15.82:0/2898854966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc678104f30 msgr2=0x7fc678105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 --2- 172.21.15.82:0/2898854966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc678104f30 0x7fc678105340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc668009d00 tx=0x7fc66802a910 comp rx=0 tx=0).stop 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 -- 172.21.15.82:0/2898854966 shutdown_connections 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 --2- 172.21.15.82:0/2898854966 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc67810a1b0 0x7fc678111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 --2- 172.21.15.82:0/2898854966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 0x7fc678109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 --2- 172.21.15.82:0/2898854966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc678104f30 0x7fc678105340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 -- 172.21.15.82:0/2898854966 >> 172.21.15.82:0/2898854966 conn(0x7fc678100990 msgr2=0x7fc678102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 -- 172.21.15.82:0/2898854966 shutdown_connections 2024-06-06T02:34:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.259+0000 7fc67ca00640 1 -- 172.21.15.82:0/2898854966 wait complete. 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.260+0000 7fc67ca00640 1 Processor -- start 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.260+0000 7fc67ca00640 1 -- start start 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 0x7fc67819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67810a1b0 0x7fc6781a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc678114ec0 con 0x7fc67810a1b0 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc678114d40 con 0x7fc678104f30 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc67ca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc678115040 con 0x7fc678109860 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc676800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc677200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67810a1b0 0x7fc6781a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc676800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43678/0 (socket says 172.21.15.82:43678) 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc676800640 1 -- 172.21.15.82:0/578625617 learned_addr learned my addr 172.21.15.82:0/578625617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.261+0000 7fc675e00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 0x7fc67819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 -- 172.21.15.82:0/578625617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 msgr2=0x7fc67819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 0x7fc67819bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 -- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67810a1b0 msgr2=0x7fc6781a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67810a1b0 0x7fc6781a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 -- 172.21.15.82:0/578625617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6781a08e0 con 0x7fc678104f30 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc676800640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc66802f550 tx=0x7fc668031780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668003b70 con 0x7fc678104f30 2024-06-06T02:34:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc668003d10 con 0x7fc678104f30 2024-06-06T02:34:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6781a0b70 con 0x7fc678104f30 2024-06-06T02:34:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66802fac0 con 0x7fc678104f30 2024-06-06T02:34:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.262+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6781a10b0 con 0x7fc678104f30 2024-06-06T02:34:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.264+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc678105340 con 0x7fc678104f30 2024-06-06T02:34:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.267+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc668030b80 con 0x7fc678104f30 2024-06-06T02:34:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.267+0000 7fc66f400640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 0x7fc65c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:11.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.269+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc6681034e0 con 0x7fc678104f30 2024-06-06T02:34:11.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.269+0000 7fc675e00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 0x7fc65c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:11.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.269+0000 7fc675e00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 0x7fc65c0b4d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc678101e50 tx=0x7fc664005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.269+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6680cb340 con 0x7fc678104f30 2024-06-06T02:34:11.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.480+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc67810d170 con 0x7fc678104f30 2024-06-06T02:34:11.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.483+0000 7fc66f400640 1 -- 172.21.15.82:0/578625617 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22219 (secure 0 0 0) 0x7fc6680cac40 con 0x7fc678104f30 2024-06-06T02:34:11.483 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:34:11.484 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":78,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:03.585867+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.484+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 msgr2=0x7fc65c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.484+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 0x7fc65c0b4d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc678101e50 tx=0x7fc664005f30 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 msgr2=0x7fc67819ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc66802f550 tx=0x7fc668031780 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 shutdown_connections 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc67810a1b0 0x7fc6781a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc65c0b27f0 0x7fc65c0b4d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc678109860 0x7fc67819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 --2- 172.21.15.82:0/578625617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc678104f30 0x7fc67819ba60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:11.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 >> 172.21.15.82:0/578625617 conn(0x7fc678100990 msgr2=0x7fc6781011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:11.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 shutdown_connections 2024-06-06T02:34:11.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:11.485+0000 7fc67ca00640 1 -- 172.21.15.82:0/578625617 wait complete. 2024-06-06T02:34:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:11 smithi103 ceph-mon[36349]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-06T02:34:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/578625617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:12.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:11 smithi082 ceph-mon[31579]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-06T02:34:12.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/578625617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:11 smithi184 ceph-mon[36922]: pgmap v336: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-06-06T02:34:12.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/578625617' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:12.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-06-06T02:34:12.880 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:14.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:13 smithi103 ceph-mon[36349]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T02:34:14.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:13 smithi082 ceph-mon[31579]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T02:34:14.151 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:13 smithi184 ceph-mon[36922]: pgmap v337: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-06-06T02:34:15.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 -- 172.21.15.82:0/2590286730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 msgr2=0x7f0f6c10ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 --2- 172.21.15.82:0/2590286730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c10ee80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009900 tx=0x7f0f5802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 -- 172.21.15.82:0/2590286730 shutdown_connections 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 --2- 172.21.15.82:0/2590286730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 0x7f0f6c1117e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 --2- 172.21.15.82:0/2590286730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c10ee80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 --2- 172.21.15.82:0/2590286730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 -- 172.21.15.82:0/2590286730 >> 172.21.15.82:0/2590286730 conn(0x7f0f6c0fd6f0 msgr2=0x7f0f6c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 -- 172.21.15.82:0/2590286730 shutdown_connections 2024-06-06T02:34:15.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.063+0000 7f0f72a00640 1 -- 172.21.15.82:0/2590286730 wait complete. 2024-06-06T02:34:15.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T02:34:15.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-06-06T02:34:15.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:14 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T02:34:15.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.064+0000 7f0f72a00640 1 Processor -- start 2024-06-06T02:34:15.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 -- start start 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 0x7f0f6c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c114eb0 con 0x7f0f6c102160 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c114d30 con 0x7f0f6c101810 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.065+0000 7f0f72a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c115030 con 0x7f0f6c10f3c0 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51200/0 (socket says 172.21.15.82:51200) 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 -- 172.21.15.82:0/3480415002 learned_addr learned my addr 172.21.15.82:0/3480415002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f70c00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f72000640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 0x7f0f6c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 -- 172.21.15.82:0/3480415002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 msgr2=0x7f0f6c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 0x7f0f6c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 -- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 msgr2=0x7f0f6c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.066+0000 7f0f71600640 1 -- 172.21.15.82:0/3480415002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c071ee0 con 0x7f0f6c101810 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f71600640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000e9f0 tx=0x7f0f6000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000cd80 con 0x7f0f6c101810 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c0721d0 con 0x7f0f6c101810 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f600108e0 con 0x7f0f6c101810 2024-06-06T02:34:15.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60018860 con 0x7f0f6c101810 2024-06-06T02:34:15.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.067+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c0726e0 con 0x7f0f6c101810 2024-06-06T02:34:15.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.069+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c06aed0 con 0x7f0f6c101810 2024-06-06T02:34:15.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.071+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0f60010430 con 0x7f0f6c101810 2024-06-06T02:34:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.073+0000 7f0f6a000640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 0x7f0f540b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.073+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8240+0+0 (secure 0 0 0) 0x7f0f600e26a0 con 0x7f0f6c101810 2024-06-06T02:34:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.073+0000 7f0f70c00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 0x7f0f540b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:15.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.074+0000 7f0f70c00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 0x7f0f540b4d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000c00 tx=0x7f0f58031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:15.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.077+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f600aa380 con 0x7f0f6c101810 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-06-06T02:34:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:14 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T02:34:15.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-06-06T02:34:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:14 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-06-06T02:34:15.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.324+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0f6c06ea10 con 0x7f0f6c101810 2024-06-06T02:34:15.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.855+0000 7f0f6a000640 1 -- 172.21.15.82:0/3480415002 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f0f600a9c80 con 0x7f0f6c101810 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 msgr2=0x7f0f540b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 0x7f0f540b4d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000c00 tx=0x7f0f58031400 comp rx=0 tx=0).stop 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 msgr2=0x7f0f6c0743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000e9f0 tx=0x7f0f6000eeb0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 shutdown_connections 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f540b27f0 0x7f0f540b4d00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0f6c10f3c0 0x7f0f6c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f6c102160 0x7f0f6c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 --2- 172.21.15.82:0/3480415002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f6c101810 0x7f0f6c0743b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 >> 172.21.15.82:0/3480415002 conn(0x7f0f6c0fd6f0 msgr2=0x7f0f6c100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 shutdown_connections 2024-06-06T02:34:15.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:15.860+0000 7f0f72a00640 1 -- 172.21.15.82:0/3480415002 wait complete. 2024-06-06T02:34:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: osdmap e79: 12 total, 12 up, 12 in 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3480415002' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:15 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T02:34:16.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: osdmap e79: 12 total, 12 up, 12 in 2024-06-06T02:34:16.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3480415002' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:15 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: pgmap v338: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-06-06T02:34:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-06-06T02:34:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: osdmap e79: 12 total, 12 up, 12 in 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3480415002' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:15 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-06T02:34:16.840 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-06-06T02:34:16.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-06-06T02:34:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:16 smithi103 ceph-mon[36349]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T02:34:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:16 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T02:34:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:16 smithi103 ceph-mon[36349]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:16 smithi082 ceph-mon[31579]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T02:34:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:16 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T02:34:17.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:16 smithi082 ceph-mon[31579]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:16 smithi184 ceph-mon[36922]: osdmap e80: 12 total, 12 up, 12 in 2024-06-06T02:34:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:16 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-06T02:34:17.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:16 smithi184 ceph-mon[36922]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:18.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:17 smithi103 ceph-mon[36349]: pgmap v341: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-06T02:34:18.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:17 smithi082 ceph-mon[31579]: pgmap v341: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-06T02:34:18.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:17 smithi184 ceph-mon[36922]: pgmap v341: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 -- 172.21.15.82:0/2831247814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef81050f0 msgr2=0x7f1ef8105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 --2- 172.21.15.82:0/2831247814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef81050f0 0x7f1ef8105500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009960 tx=0x7f1ee802a460 comp rx=0 tx=0).stop 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 -- 172.21.15.82:0/2831247814 shutdown_connections 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 --2- 172.21.15.82:0/2831247814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef810a370 0x7f1ef8111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 --2- 172.21.15.82:0/2831247814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef8109a20 0x7f1ef8109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 --2- 172.21.15.82:0/2831247814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef81050f0 0x7f1ef8105500 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.625+0000 7f1efca00640 1 -- 172.21.15.82:0/2831247814 >> 172.21.15.82:0/2831247814 conn(0x7f1ef8100b90 msgr2=0x7f1ef8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.626+0000 7f1efca00640 1 -- 172.21.15.82:0/2831247814 shutdown_connections 2024-06-06T02:34:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.626+0000 7f1efca00640 1 -- 172.21.15.82:0/2831247814 wait complete. 2024-06-06T02:34:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.627+0000 7f1efca00640 1 Processor -- start 2024-06-06T02:34:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.627+0000 7f1efca00640 1 -- start start 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 0x7f1ef81a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef8109a20 0x7f1ef81a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef81150b0 con 0x7f1ef810a370 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8114f30 con 0x7f1ef81050f0 2024-06-06T02:34:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1efca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8115230 con 0x7f1ef8109a20 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53330/0 (socket says 172.21.15.82:53330) 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef6800640 1 -- 172.21.15.82:0/906702508 learned_addr learned my addr 172.21.15.82:0/906702508 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 0x7f1ef81a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5400640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef8109a20 0x7f1ef81a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 -- 172.21.15.82:0/906702508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef8109a20 msgr2=0x7f1ef81a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef8109a20 0x7f1ef81a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 -- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 msgr2=0x7f1ef819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef5e00640 1 -- 172.21.15.82:0/906702508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef819c010 con 0x7f1ef81050f0 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.628+0000 7f1ef6800640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1ef5e00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 0x7f1ef81a1780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ee802a980 tx=0x7f1ee8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee803f030 con 0x7f1ef81050f0 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef819c2a0 con 0x7f1ef81050f0 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ee8004440 con 0x7f1ef81050f0 2024-06-06T02:34:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8035070 con 0x7f1ef81050f0 2024-06-06T02:34:19.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.629+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef819c780 con 0x7f1ef81050f0 2024-06-06T02:34:19.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.630+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef81065a0 con 0x7f1ef81050f0 2024-06-06T02:34:19.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.633+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1ee8042030 con 0x7f1ef81050f0 2024-06-06T02:34:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.634+0000 7f1eeea00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 0x7f1edc0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.635+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1ee81026a0 con 0x7f1ef81050f0 2024-06-06T02:34:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.635+0000 7f1ef5400640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 0x7f1edc0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:19.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.635+0000 7f1ef5400640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 0x7f1edc0b4d00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40095f0 tx=0x7f1ee4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:19.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.636+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1ee80c9d30 con 0x7f1ef81050f0 2024-06-06T02:34:19.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:19.886+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f1ef810d330 con 0x7f1ef81050f0 2024-06-06T02:34:20.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:19 smithi103 ceph-mon[36349]: pgmap v342: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:20.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:19 smithi082 ceph-mon[31579]: pgmap v342: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:20.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:19 smithi184 ceph-mon[36922]: pgmap v342: 97 pgs: 2 peering, 95 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:34:20.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.883+0000 7f1eeea00640 1 -- 172.21.15.82:0/906702508 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f1ee80ce030 con 0x7f1ef81050f0 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.887+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 msgr2=0x7f1edc0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.887+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 0x7f1edc0b4d00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40095f0 tx=0x7f1ee4005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.887+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 msgr2=0x7f1ef81a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.887+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 0x7f1ef81a1780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ee802a980 tx=0x7f1ee8004040 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 shutdown_connections 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ef810a370 0x7f1ef819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1edc0b27f0 0x7f1edc0b4d00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ef8109a20 0x7f1ef81a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 --2- 172.21.15.82:0/906702508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef81050f0 0x7f1ef81a1780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:20.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 >> 172.21.15.82:0/906702508 conn(0x7f1ef8100b90 msgr2=0x7f1ef8102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 shutdown_connections 2024-06-06T02:34:20.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:20.888+0000 7f1efca00640 1 -- 172.21.15.82:0/906702508 wait complete. 2024-06-06T02:34:21.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:20 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/906702508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:20 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.346 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:20 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/906702508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.346 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:20 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:20 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/906702508' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:20 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-06-06T02:34:21.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-06-06T02:34:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: pgmap v343: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: fsmap cephfs:2 {0=g=up:active,1=i=up:creating} 10 up:standby 2024-06-06T02:34:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:21 smithi082 ceph-mon[31579]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-06T02:34:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: pgmap v343: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:22.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T02:34:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T02:34:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T02:34:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: fsmap cephfs:2 {0=g=up:active,1=i=up:creating} 10 up:standby 2024-06-06T02:34:22.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:21 smithi184 ceph-mon[36922]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-06T02:34:22.322 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: pgmap v343: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-06T02:34:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-06-06T02:34:22.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-06T02:34:22.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: fsmap cephfs:1 {0=g=up:active} 11 up:standby 2024-06-06T02:34:22.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: fsmap cephfs:2 {0=g=up:active,1=i=up:creating} 10 up:standby 2024-06-06T02:34:22.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:21 smithi103 ceph-mon[36349]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:active 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: Cluster is now healthy 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: fsmap cephfs:2 {0=g=up:active,1=i=up:active} 10 up:standby 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:creating} 9 up:standby 2024-06-06T02:34:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:22 smithi082 ceph-mon[31579]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-06T02:34:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:active 2024-06-06T02:34:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T02:34:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T02:34:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: Cluster is now healthy 2024-06-06T02:34:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: fsmap cephfs:2 {0=g=up:active,1=i=up:active} 10 up:standby 2024-06-06T02:34:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:creating} 9 up:standby 2024-06-06T02:34:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:22 smithi184 ceph-mon[36922]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] up:active 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: daemon mds.b assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: Cluster is now healthy 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: fsmap cephfs:2 {0=g=up:active,1=i=up:active} 10 up:standby 2024-06-06T02:34:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:creating} 9 up:standby 2024-06-06T02:34:23.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:22 smithi103 ceph-mon[36349]: daemon mds.b is now active in filesystem cephfs as rank 2 2024-06-06T02:34:23.620 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:34:23 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: 2024-06-06T02:34:23.386+0000 7fede5600640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-06-06T02:34:23.621 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:34:23 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: 2024-06-06T02:34:23.386+0000 7fede5600640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-06-06T02:34:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:23 smithi082 ceph-mon[31579]: pgmap v344: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 1 op/s; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:23 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:active 2024-06-06T02:34:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:23 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:23 smithi103 ceph-mon[36349]: pgmap v344: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 1 op/s; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:23 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:active 2024-06-06T02:34:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:23 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:24.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:23 smithi184 ceph-mon[36922]: pgmap v344: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s wr, 1 op/s; 201 B/s, 0 objects/s recovering 2024-06-06T02:34:24.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:23 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] up:active 2024-06-06T02:34:24.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:23 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 -- 172.21.15.82:0/963383809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f391410f5b0 msgr2=0x7f39141119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 --2- 172.21.15.82:0/963383809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f391410f5b0 0x7f39141119d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f390c009ca0 tx=0x7f390c02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 -- 172.21.15.82:0/963383809 shutdown_connections 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 --2- 172.21.15.82:0/963383809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f391410f5b0 0x7f39141119d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 --2- 172.21.15.82:0/963383809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f391410f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 --2- 172.21.15.82:0/963383809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3914101a00 0x7f3914101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 -- 172.21.15.82:0/963383809 >> 172.21.15.82:0/963383809 conn(0x7f3914078a80 msgr2=0x7f3914078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.568+0000 7f391c200640 1 -- 172.21.15.82:0/963383809 shutdown_connections 2024-06-06T02:34:24.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.569+0000 7f391c200640 1 -- 172.21.15.82:0/963383809 wait complete. 2024-06-06T02:34:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.570+0000 7f391c200640 1 Processor -- start 2024-06-06T02:34:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.570+0000 7f391c200640 1 -- start start 2024-06-06T02:34:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.570+0000 7f391c200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 0x7f39141a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.570+0000 7f391c200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f39141a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f391c200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391410f5b0 0x7f391419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f391c200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3914115060 con 0x7f3914101a00 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f391c200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3914114ee0 con 0x7f3914102350 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f391c200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39141151e0 con 0x7f391410f5b0 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3919800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 0x7f39141a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3919800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 0x7f39141a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36364/0 (socket says 172.21.15.82:36364) 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3919800640 1 -- 172.21.15.82:0/4001387865 learned_addr learned my addr 172.21.15.82:0/4001387865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f39141a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f391a200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391410f5b0 0x7f391419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 -- 172.21.15.82:0/4001387865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391410f5b0 msgr2=0x7f391419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391410f5b0 0x7f391419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 -- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 msgr2=0x7f39141a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 0x7f39141a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.571+0000 7f3918e00640 1 -- 172.21.15.82:0/4001387865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391419bee0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f3918e00640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f39141a1b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f390000e9c0 tx=0x7f390000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390000ccc0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39000108e0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391419c1d0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000187c0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.572+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39141a84e0 con 0x7f3914102350 2024-06-06T02:34:24.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.573+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3914101e10 con 0x7f3914102350 2024-06-06T02:34:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.576+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3900010430 con 0x7f3914102350 2024-06-06T02:34:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.577+0000 7f3912000640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 0x7f38fc0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.578+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39000e2960 con 0x7f3914102350 2024-06-06T02:34:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.578+0000 7f3919800640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 0x7f38fc0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.578+0000 7f3919800640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 0x7f38fc0b4d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f391419c9b0 tx=0x7f3908005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:24.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.579+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f39000a9ff0 con 0x7f3914102350 2024-06-06T02:34:24.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.835+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f391410a740 con 0x7f3914102350 2024-06-06T02:34:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.930+0000 7f3912000640 1 -- 172.21.15.82:0/4001387865 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f39000ae2f0 con 0x7f3914102350 2024-06-06T02:34:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.934+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 msgr2=0x7f38fc0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.934+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 0x7f38fc0b4d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f391419c9b0 tx=0x7f3908005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.934+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 msgr2=0x7f39141a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.934+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f39141a1b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f390000e9c0 tx=0x7f390000ee80 comp rx=0 tx=0).stop 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 shutdown_connections 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f38fc0b27f0 0x7f38fc0b4d00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f391410f5b0 0x7f391419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3914102350 0x7f39141a1b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 --2- 172.21.15.82:0/4001387865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3914101a00 0x7f39141a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 >> 172.21.15.82:0/4001387865 conn(0x7f3914078a80 msgr2=0x7f3914110a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 shutdown_connections 2024-06-06T02:34:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:24.935+0000 7f391c200640 1 -- 172.21.15.82:0/4001387865 wait complete. 2024-06-06T02:34:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:24 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4001387865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:24 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:24 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4001387865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:24 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:24 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4001387865' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:24 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-06T02:34:25.717 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-06-06T02:34:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:26.298 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:25 smithi184 ceph-mon[36922]: pgmap v345: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s; 162 B/s, 0 objects/s recovering 2024-06-06T02:34:26.298 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:25 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T02:34:26.299 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:25 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:26.299 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:25 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:26.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:25 smithi082 ceph-mon[31579]: pgmap v345: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s; 162 B/s, 0 objects/s recovering 2024-06-06T02:34:26.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:25 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T02:34:26.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:25 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:26.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:25 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:25 smithi103 ceph-mon[36349]: pgmap v345: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 5 op/s; 162 B/s, 0 objects/s recovering 2024-06-06T02:34:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:25 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-06T02:34:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:25 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 9 up:standby 2024-06-06T02:34:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:25 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:28.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:27 smithi082 ceph-mon[31579]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s rd, 2.2 KiB/s wr, 7 op/s; 147 B/s, 0 objects/s recovering 2024-06-06T02:34:28.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:27 smithi103 ceph-mon[36349]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s rd, 2.2 KiB/s wr, 7 op/s; 147 B/s, 0 objects/s recovering 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 -- 172.21.15.82:0/3640487232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea010a380 msgr2=0x7fbea0111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 --2- 172.21.15.82:0/3640487232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea010a380 0x7fbea0111ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009cd0 tx=0x7fbe9802a8e0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 -- 172.21.15.82:0/3640487232 shutdown_connections 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 --2- 172.21.15.82:0/3640487232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea010a380 0x7fbea0111ce0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 --2- 172.21.15.82:0/3640487232 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0109a30 0x7fbea0109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 --2- 172.21.15.82:0/3640487232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea0105100 0x7fbea0105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 -- 172.21.15.82:0/3640487232 >> 172.21.15.82:0/3640487232 conn(0x7fbea0100b60 msgr2=0x7fbea0102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 -- 172.21.15.82:0/3640487232 shutdown_connections 2024-06-06T02:34:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.382+0000 7fbea7400640 1 -- 172.21.15.82:0/3640487232 wait complete. 2024-06-06T02:34:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.383+0000 7fbea7400640 1 Processor -- start 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 -- start start 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 0x7fbea01a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 0x7fbea01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea010a380 0x7fbea019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbea01150b0 con 0x7fbea0105100 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0114f30 con 0x7fbea0109a30 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea7400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbea0115230 con 0x7fbea010a380 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 0x7fbea01a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.384+0000 7fbea4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 0x7fbea01a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36386/0 (socket says 172.21.15.82:36386) 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 0x7fbea01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbea4a00640 1 -- 172.21.15.82:0/3469149699 learned_addr learned my addr 172.21.15.82:0/3469149699 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbea5400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea010a380 0x7fbea019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 -- 172.21.15.82:0/3469149699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea010a380 msgr2=0x7fbea019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea010a380 0x7fbea019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 -- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 msgr2=0x7fbea01a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 0x7fbea01a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 -- 172.21.15.82:0/3469149699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea019bf90 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.385+0000 7fbe97e00640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 0x7fbea01a1c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbea006beb0 tx=0x7fbe9000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.386+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000cc40 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.386+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea019c280 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.386+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01a8590 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.386+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe9000cde0 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.386+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe90018640 con 0x7fbea0109a30 2024-06-06T02:34:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.387+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7c005290 con 0x7fbea0109a30 2024-06-06T02:34:28.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.389+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbe90010430 con 0x7fbea0109a30 2024-06-06T02:34:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.391+0000 7fbe9e000640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 0x7fbe800b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:28.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.391+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbe900e22e0 con 0x7fbea0109a30 2024-06-06T02:34:28.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.391+0000 7fbea4a00640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 0x7fbe800b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:28.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.392+0000 7fbea4a00640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 0x7fbe800b4d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbea019ca60 tx=0x7fbe88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:28.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.395+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbe900a9970 con 0x7fbea0109a30 2024-06-06T02:34:28.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:27 smithi184 ceph-mon[36922]: pgmap v346: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 374 B/s rd, 2.2 KiB/s wr, 7 op/s; 147 B/s, 0 objects/s recovering 2024-06-06T02:34:28.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.645+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fbe7c005580 con 0x7fbea0109a30 2024-06-06T02:34:28.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.955+0000 7fbe9e000640 1 -- 172.21.15.82:0/3469149699 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7fbe900adc70 con 0x7fbea0109a30 2024-06-06T02:34:28.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 msgr2=0x7fbe800b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:28.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 0x7fbe800b4d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbea019ca60 tx=0x7fbe88005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:28.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 msgr2=0x7fbea01a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:28.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 0x7fbea01a1c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbea006beb0 tx=0x7fbe9000ee50 comp rx=0 tx=0).stop 2024-06-06T02:34:28.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 shutdown_connections 2024-06-06T02:34:28.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe800b2870 0x7fbe800b4d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbea010a380 0x7fbea019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbea0109a30 0x7fbea01a1c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 --2- 172.21.15.82:0/3469149699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbea0105100 0x7fbea01a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 >> 172.21.15.82:0/3469149699 conn(0x7fbea0100b60 msgr2=0x7fbea01011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 shutdown_connections 2024-06-06T02:34:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:28.961+0000 7fbea7400640 1 -- 172.21.15.82:0/3469149699 wait complete. 2024-06-06T02:34:29.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:28 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3469149699' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:28 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:28 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3469149699' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:28 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:28 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3469149699' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:28 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-06T02:34:29.823 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-06-06T02:34:29.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-06-06T02:34:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:29 smithi082 ceph-mon[31579]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.0 KiB/s wr, 7 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:29 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T02:34:30.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:29 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:30.274 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:30.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:29 smithi103 ceph-mon[36349]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.0 KiB/s wr, 7 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:30.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:29 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T02:34:30.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:29 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:30.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:29 smithi184 ceph-mon[36922]: pgmap v347: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 2.0 KiB/s wr, 7 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:30.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:29 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-06T02:34:30.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:29 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:34:32.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:31 smithi082 ceph-mon[31579]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:32.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:31 smithi103 ceph-mon[36349]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:32.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:31 smithi184 ceph-mon[36922]: pgmap v348: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s; 134 B/s, 0 objects/s recovering 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.409+0000 7eff20a00640 1 -- 172.21.15.82:0/1936039401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 msgr2=0x7eff1c109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.409+0000 7eff20a00640 1 --2- 172.21.15.82:0/1936039401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c109c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7eff04009890 tx=0x7eff0402a370 comp rx=0 tx=0).stop 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 -- 172.21.15.82:0/1936039401 shutdown_connections 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 --2- 172.21.15.82:0/1936039401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c10a190 0x7eff1c111af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 --2- 172.21.15.82:0/1936039401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c109c50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 --2- 172.21.15.82:0/1936039401 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c104f10 0x7eff1c105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 -- 172.21.15.82:0/1936039401 >> 172.21.15.82:0/1936039401 conn(0x7eff1c100990 msgr2=0x7eff1c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:32.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 -- 172.21.15.82:0/1936039401 shutdown_connections 2024-06-06T02:34:32.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.410+0000 7eff20a00640 1 -- 172.21.15.82:0/1936039401 wait complete. 2024-06-06T02:34:32.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.411+0000 7eff20a00640 1 Processor -- start 2024-06-06T02:34:32.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.411+0000 7eff20a00640 1 -- start start 2024-06-06T02:34:32.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.411+0000 7eff20a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:32.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff20a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c1a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:32.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff20a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 0x7eff1c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:32.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff20a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c114ea0 con 0x7eff1c104f10 2024-06-06T02:34:32.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff20a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c114d20 con 0x7eff1c10a190 2024-06-06T02:34:32.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff20a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c115020 con 0x7eff1c109840 2024-06-06T02:34:32.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:32.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39406/0 (socket says 172.21.15.82:39406) 2024-06-06T02:34:32.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 -- 172.21.15.82:0/3857760302 learned_addr learned my addr 172.21.15.82:0/3857760302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:32.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1be00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 0x7eff1c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff12a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c1a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 -- 172.21.15.82:0/3857760302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 msgr2=0x7eff1c1a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c1a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 -- 172.21.15.82:0/3857760302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 msgr2=0x7eff1c19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 0x7eff1c19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1b400640 1 -- 172.21.15.82:0/3857760302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c19bec0 con 0x7eff1c104f10 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.412+0000 7eff1be00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 0x7eff1c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff1b400640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00e9f0 tx=0x7eff0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00cd80 con 0x7eff1c104f10 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff0c0108e0 con 0x7eff1c104f10 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c19c1b0 con 0x7eff1c104f10 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c018980 con 0x7eff1c104f10 2024-06-06T02:34:32.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.413+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c1a83b0 con 0x7eff1c104f10 2024-06-06T02:34:32.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.415+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c1063c0 con 0x7eff1c104f10 2024-06-06T02:34:32.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.417+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7eff0c010430 con 0x7eff1c104f10 2024-06-06T02:34:32.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.419+0000 7eff18c00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 0x7eff000b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:32.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.419+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7eff0c0e2a40 con 0x7eff1c104f10 2024-06-06T02:34:32.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.419+0000 7eff12a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 0x7eff000b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:32.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.420+0000 7eff12a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 0x7eff000b4d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff040057c0 tx=0x7eff04030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:32.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.421+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff0c0aa0d0 con 0x7eff1c104f10 2024-06-06T02:34:32.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.661+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7eff1c062ba0 con 0x7eff000b27f0 2024-06-06T02:34:32.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.691+0000 7eff18c00640 1 -- 172.21.15.82:0/3857760302 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7eff1c062ba0 con 0x7eff000b27f0 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.693+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 msgr2=0x7eff000b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 0x7eff000b4d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7eff040057c0 tx=0x7eff04030340 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 msgr2=0x7eff1c1a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff0c00e9f0 tx=0x7eff0c00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 shutdown_connections 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff1c10a190 0x7eff1c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff000b27f0 0x7eff000b4d00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff1c109840 0x7eff1c1a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 --2- 172.21.15.82:0/3857760302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1c104f10 0x7eff1c1a1600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 >> 172.21.15.82:0/3857760302 conn(0x7eff1c100990 msgr2=0x7eff1c102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 shutdown_connections 2024-06-06T02:34:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:32.694+0000 7eff20a00640 1 -- 172.21.15.82:0/3857760302 wait complete. 2024-06-06T02:34:33.119 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:34:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:34:32.671+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:34:33.119 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:34:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:34:32.671+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:34:33.119 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:34:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:34:32.671+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:34:33.119 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:34:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:34:32.671+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:34:33.119 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:34:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:34:32.671+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:34:33.535 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-06T02:34:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:34.323 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:33 smithi082 ceph-mon[31579]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:34.324 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:33 smithi082 ceph-mon[31579]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T02:34:34.324 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:33 smithi082 ceph-mon[31579]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-06T02:34:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:33 smithi103 ceph-mon[36349]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:33 smithi103 ceph-mon[36349]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T02:34:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:33 smithi103 ceph-mon[36349]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-06T02:34:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:33 smithi184 ceph-mon[36922]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:34.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:33 smithi184 ceph-mon[36922]: pgmap v349: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-06-06T02:34:34.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:33 smithi184 ceph-mon[36922]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.204+0000 7fa572400640 1 -- 172.21.15.82:0/926837150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 msgr2=0x7fa56c10f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.204+0000 7fa572400640 1 --2- 172.21.15.82:0/926837150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c10f070 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa554009900 tx=0x7fa55402a3f0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 -- 172.21.15.82:0/926837150 shutdown_connections 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 --2- 172.21.15.82:0/926837150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 0x7fa56c1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 --2- 172.21.15.82:0/926837150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c10f070 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 --2- 172.21.15.82:0/926837150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 -- 172.21.15.82:0/926837150 >> 172.21.15.82:0/926837150 conn(0x7fa56c078a90 msgr2=0x7fa56c078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.205+0000 7fa572400640 1 -- 172.21.15.82:0/926837150 shutdown_connections 2024-06-06T02:34:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.206+0000 7fa572400640 1 -- 172.21.15.82:0/926837150 wait complete. 2024-06-06T02:34:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 Processor -- start 2024-06-06T02:34:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 -- start start 2024-06-06T02:34:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 0x7fa56c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c115090 con 0x7fa56c101a00 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c114f10 con 0x7fa56c102350 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa572400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c115210 con 0x7fa56c10f5b0 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa56b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.207+0000 7fa563e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa56b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39460/0 (socket says 172.21.15.82:39460) 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58836/0 (socket says 172.21.15.82:58836) 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa56b400640 1 -- 172.21.15.82:0/3317071850 learned_addr learned my addr 172.21.15.82:0/3317071850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa56be00640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 0x7fa56c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 -- 172.21.15.82:0/3317071850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 msgr2=0x7fa56c19b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 0x7fa56c19b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 -- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 msgr2=0x7fa56c1a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 -- 172.21.15.82:0/3317071850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c19bf10 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa56b400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.208+0000 7fa563e00640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa55402a9e0 tx=0x7fa554003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.209+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55403f070 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.209+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa554031b50 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.209+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554035030 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.209+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c19c1a0 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.209+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c19c6a0 con 0x7fa56c102350 2024-06-06T02:34:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.210+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56c101e10 con 0x7fa56c102350 2024-06-06T02:34:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.212+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa554042070 con 0x7fa56c102350 2024-06-06T02:34:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.214+0000 7fa568c00640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 0x7fa5500b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.214+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa554102b30 con 0x7fa56c102350 2024-06-06T02:34:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.214+0000 7fa56b400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 0x7fa5500b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.215+0000 7fa56b400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 0x7fa5500b4e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19c9e0 tx=0x7fa55c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.215+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa554031d00 con 0x7fa56c102350 2024-06-06T02:34:36.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:35 smithi103 ceph-mon[36349]: pgmap v350: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-06-06T02:34:36.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:35 smithi082 ceph-mon[31579]: pgmap v350: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-06-06T02:34:36.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:35 smithi184 ceph-mon[36922]: pgmap v350: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-06-06T02:34:36.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.455+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa56c062ba0 con 0x7fa5500b2900 2024-06-06T02:34:36.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.509+0000 7fa568c00640 1 -- 172.21.15.82:0/3317071850 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa56c062ba0 con 0x7fa5500b2900 2024-06-06T02:34:36.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 msgr2=0x7fa5500b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:36.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 0x7fa5500b4e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19c9e0 tx=0x7fa55c005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:36.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 msgr2=0x7fa56c1a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:36.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa55402a9e0 tx=0x7fa554003b90 comp rx=0 tx=0).stop 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 shutdown_connections 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5500b2900 0x7fa5500b4e10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c10f5b0 0x7fa56c19b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa56c102350 0x7fa56c1a1bc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 --2- 172.21.15.82:0/3317071850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa56c101a00 0x7fa56c1a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 >> 172.21.15.82:0/3317071850 conn(0x7fa56c078a90 msgr2=0x7fa56c110a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.512+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 shutdown_connections 2024-06-06T02:34:36.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:36.513+0000 7fa572400640 1 -- 172.21.15.82:0/3317071850 wait complete. 2024-06-06T02:34:37.242 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:36 smithi082 ceph-mon[31579]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:37.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-06T02:34:37.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:36 smithi103 ceph-mon[36349]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:37.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:36 smithi184 ceph-mon[36922]: from='client.24743 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:37.763 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:38.230 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:37 smithi082 ceph-mon[31579]: pgmap v351: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-06-06T02:34:38.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:37 smithi103 ceph-mon[36349]: pgmap v351: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-06-06T02:34:38.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:37 smithi184 ceph-mon[36922]: pgmap v351: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2024-06-06T02:34:39.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 -- 172.21.15.82:0/1336431349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163010de20 msgr2=0x7f163010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 --2- 172.21.15.82:0/1336431349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163010de20 0x7f163010e230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1618009930 tx=0x7f161802a420 comp rx=0 tx=0).stop 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 -- 172.21.15.82:0/1336431349 shutdown_connections 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 --2- 172.21.15.82:0/1336431349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 0x7f16301160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 --2- 172.21.15.82:0/1336431349 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163010de20 0x7f163010e230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 --2- 172.21.15.82:0/1336431349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1630109540 0x7f1630109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 -- 172.21.15.82:0/1336431349 >> 172.21.15.82:0/1336431349 conn(0x7f1630076540 msgr2=0x7f1630107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 -- 172.21.15.82:0/1336431349 shutdown_connections 2024-06-06T02:34:39.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.991+0000 7f1635a00640 1 -- 172.21.15.82:0/1336431349 wait complete. 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.992+0000 7f1635a00640 1 Processor -- start 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.992+0000 7f1635a00640 1 -- start start 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 0x7f163019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 0x7f16301a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 0x7f16301a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16301194a0 con 0x7f163010de20 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1630119320 con 0x7f163010e770 2024-06-06T02:34:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1635a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1630119620 con 0x7f1630109540 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1626000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 0x7f16301a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f162ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 0x7f163019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1626000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 0x7f16301a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39480/0 (socket says 172.21.15.82:39480) 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.993+0000 7f1626000640 1 -- 172.21.15.82:0/1639497783 learned_addr learned my addr 172.21.15.82:0/1639497783 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162f400640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 0x7f16301a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 -- 172.21.15.82:0/1639497783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 msgr2=0x7f16301a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 0x7f16301a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 -- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 msgr2=0x7f16301a0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 0x7f16301a0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 -- 172.21.15.82:0/1639497783 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16301a4d90 con 0x7f1630109540 2024-06-06T02:34:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.994+0000 7f162ea00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 0x7f163019ff20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f162000ea20 tx=0x7f162000eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.995+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162000cd50 con 0x7f1630109540 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.995+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16301a5080 con 0x7f1630109540 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.995+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16200035f0 con 0x7f1630109540 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.995+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620010690 con 0x7f1630109540 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.995+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16301aca00 con 0x7f1630109540 2024-06-06T02:34:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.996+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163010a9a0 con 0x7f1630109540 2024-06-06T02:34:39.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:39.998+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f16200037a0 con 0x7f1630109540 2024-06-06T02:34:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.000+0000 7f1627e00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 0x7f16140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.000+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f16200e27f0 con 0x7f1630109540 2024-06-06T02:34:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.000+0000 7f1626000640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 0x7f16140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:40.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.001+0000 7f1626000640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 0x7f16140b4e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1630108600 tx=0x7f1618005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:40.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.002+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1620054df0 con 0x7f1630109540 2024-06-06T02:34:40.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.239+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1630062ba0 con 0x7f16140b2900 2024-06-06T02:34:40.249 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/32358b90-303c-4c69-86dd-39b3cf31a3df 2024-06-06T02:34:40.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.249+0000 7f1627e00640 1 -- 172.21.15.82:0/1639497783 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1630062ba0 con 0x7f16140b2900 2024-06-06T02:34:40.250 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:40 smithi082 ceph-mon[31579]: pgmap v352: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:34:40.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.252+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 msgr2=0x7f16140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:40.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.252+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 0x7f16140b4e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1630108600 tx=0x7f1618005e80 comp rx=0 tx=0).stop 2024-06-06T02:34:40.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.252+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 msgr2=0x7f163019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:40.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.252+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 0x7f163019ff20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f162000ea20 tx=0x7f162000eee0 comp rx=0 tx=0).stop 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 shutdown_connections 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f163010e770 0x7f16301a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f163010de20 0x7f16301a0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16140b2900 0x7f16140b4e10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 --2- 172.21.15.82:0/1639497783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1630109540 0x7f163019ff20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 >> 172.21.15.82:0/1639497783 conn(0x7f1630076540 msgr2=0x7f1630076c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 shutdown_connections 2024-06-06T02:34:40.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:40.253+0000 7f1635a00640 1 -- 172.21.15.82:0/1639497783 wait complete. 2024-06-06T02:34:40.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:40 smithi103 ceph-mon[36349]: pgmap v352: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:34:40.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:40 smithi184 ceph-mon[36922]: pgmap v352: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:34:41.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-06T02:34:41.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:41 smithi103 ceph-mon[36349]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:41.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:41 smithi082 ceph-mon[31579]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:41.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:41 smithi184 ceph-mon[36922]: from='client.24784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:41.474 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:42 smithi103 ceph-mon[36349]: pgmap v353: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-06-06T02:34:42.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:42 smithi082 ceph-mon[31579]: pgmap v353: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-06-06T02:34:42.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:42 smithi184 ceph-mon[36922]: pgmap v353: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-06-06T02:34:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 -- 172.21.15.82:0/3867205860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c075620 msgr2=0x7fc70c10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:43.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 --2- 172.21.15.82:0/3867205860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c075620 0x7fc70c10ef50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009900 tx=0x7fc6fc02a490 comp rx=0 tx=0).stop 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 -- 172.21.15.82:0/3867205860 shutdown_connections 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 --2- 172.21.15.82:0/3867205860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 0x7fc70c1118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 --2- 172.21.15.82:0/3867205860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c075620 0x7fc70c10ef50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 --2- 172.21.15.82:0/3867205860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c074cd0 0x7fc70c0750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 -- 172.21.15.82:0/3867205860 >> 172.21.15.82:0/3867205860 conn(0x7fc70c079d40 msgr2=0x7fc70c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 -- 172.21.15.82:0/3867205860 shutdown_connections 2024-06-06T02:34:43.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.720+0000 7fc710e00640 1 -- 172.21.15.82:0/3867205860 wait complete. 2024-06-06T02:34:43.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.721+0000 7fc710e00640 1 Processor -- start 2024-06-06T02:34:43.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 -- start start 2024-06-06T02:34:43.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c075620 0x7fc70c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 0x7fc70c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c1150b0 con 0x7fc70c074cd0 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c114f30 con 0x7fc70c10f490 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc710e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c115230 con 0x7fc70c075620 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc709e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc709e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46706/0 (socket says 172.21.15.82:46706) 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc709e00640 1 -- 172.21.15.82:0/3880462978 learned_addr learned my addr 172.21.15.82:0/3880462978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.722+0000 7fc709400640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c075620 0x7fc70c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc70a800640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 0x7fc70c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 -- 172.21.15.82:0/3880462978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c075620 msgr2=0x7fc70c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:43.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c075620 0x7fc70c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 -- 172.21.15.82:0/3880462978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 msgr2=0x7fc70c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 0x7fc70c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 -- 172.21.15.82:0/3880462978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c19c010 con 0x7fc70c074cd0 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.723+0000 7fc709e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e9f0 tx=0x7fc6f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.724+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400cd80 con 0x7fc70c074cd0 2024-06-06T02:34:43.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.724+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6f40054d0 con 0x7fc70c074cd0 2024-06-06T02:34:43.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.724+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4010690 con 0x7fc70c074cd0 2024-06-06T02:34:43.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.724+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c19c300 con 0x7fc70c074cd0 2024-06-06T02:34:43.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.724+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70c19c7c0 con 0x7fc70c074cd0 2024-06-06T02:34:43.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.725+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70c0750e0 con 0x7fc70c074cd0 2024-06-06T02:34:43.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.728+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc6f4004e30 con 0x7fc70c074cd0 2024-06-06T02:34:43.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.730+0000 7fc702a00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 0x7fc6f00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:43.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.730+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc6f40e29f0 con 0x7fc70c074cd0 2024-06-06T02:34:43.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.731+0000 7fc709400640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 0x7fc6f00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:43.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.731+0000 7fc709400640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 0x7fc6f00b4d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc031440 tx=0x7fc6fc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:43.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.733+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6f4054df0 con 0x7fc70c074cd0 2024-06-06T02:34:43.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:43.971+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc70c062ba0 con 0x7fc6f00b2880 2024-06-06T02:34:44.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.018+0000 7fc702a00640 1 -- 172.21.15.82:0/3880462978 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc70c062ba0 con 0x7fc6f00b2880 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 msgr2=0x7fc6f00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 0x7fc6f00b4d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc031440 tx=0x7fc6fc005a20 comp rx=0 tx=0).stop 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 msgr2=0x7fc70c1a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400e9f0 tx=0x7fc6f400edf0 comp rx=0 tx=0).stop 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 shutdown_connections 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc70c10f490 0x7fc70c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:44.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc6f00b2880 0x7fc6f00b4d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:44.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc70c075620 0x7fc70c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:44.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 --2- 172.21.15.82:0/3880462978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70c074cd0 0x7fc70c1a1780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:44.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 >> 172.21.15.82:0/3880462978 conn(0x7fc70c079d40 msgr2=0x7fc70c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:44.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 shutdown_connections 2024-06-06T02:34:44.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:44.021+0000 7fc710e00640 1 -- 172.21.15.82:0/3880462978 wait complete. 2024-06-06T02:34:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:44 smithi103 ceph-mon[36349]: pgmap v354: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:44.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:44 smithi082 ceph-mon[31579]: pgmap v354: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:44.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:44 smithi184 ceph-mon[36922]: pgmap v354: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:44.866 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-06T02:34:45.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:45 smithi082 ceph-mon[31579]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:45.316 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:45.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:45 smithi103 ceph-mon[36349]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:45.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:45 smithi184 ceph-mon[36922]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:46.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:46 smithi082 ceph-mon[31579]: pgmap v355: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-06T02:34:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:46 smithi103 ceph-mon[36349]: pgmap v355: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-06T02:34:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:46 smithi184 ceph-mon[36922]: pgmap v355: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-06-06T02:34:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 -- 172.21.15.82:0/3806794012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc102ef0 msgr2=0x7f42dc103300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3806794012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc102ef0 0x7f42dc103300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009d00 tx=0x7f42cc02a910 comp rx=0 tx=0).stop 2024-06-06T02:34:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 -- 172.21.15.82:0/3806794012 shutdown_connections 2024-06-06T02:34:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3806794012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc108170 0x7f42dc10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3806794012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc107820 0x7f42dc107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3806794012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc102ef0 0x7f42dc103300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 -- 172.21.15.82:0/3806794012 >> 172.21.15.82:0/3806794012 conn(0x7f42dc0fe9b0 msgr2=0x7f42dc100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 -- 172.21.15.82:0/3806794012 shutdown_connections 2024-06-06T02:34:47.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.588+0000 7f42e1e00640 1 -- 172.21.15.82:0/3806794012 wait complete. 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 Processor -- start 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 -- start start 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 0x7f42dc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 0x7f42dc19fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc108170 0x7f42dc1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc112ea0 con 0x7f42dc107820 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc112d20 con 0x7f42dc102ef0 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.590+0000 7f42e1e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc113020 con 0x7f42dc108170 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 0x7f42dc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 0x7f42dc19fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 0x7f42dc19f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41286/0 (socket says 172.21.15.82:41286) 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42daa00640 1 -- 172.21.15.82:0/3507492256 learned_addr learned my addr 172.21.15.82:0/3507492256 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42db400640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc108170 0x7f42dc1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 -- 172.21.15.82:0/3507492256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc108170 msgr2=0x7f42dc1997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc108170 0x7f42dc1997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 -- 172.21.15.82:0/3507492256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 msgr2=0x7f42dc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 0x7f42dc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 -- 172.21.15.82:0/3507492256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc199f00 con 0x7f42dc107820 2024-06-06T02:34:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.591+0000 7f42da000640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 0x7f42dc19fad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f42dc06a2d0 tx=0x7f42c800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:47.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.592+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c800cc40 con 0x7f42dc107820 2024-06-06T02:34:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.592+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42c800cde0 con 0x7f42dc107820 2024-06-06T02:34:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.592+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc19a190 con 0x7f42dc107820 2024-06-06T02:34:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.592+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8004a00 con 0x7f42dc107820 2024-06-06T02:34:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.592+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc1a63f0 con 0x7f42dc107820 2024-06-06T02:34:47.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.593+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42dc1043a0 con 0x7f42dc107820 2024-06-06T02:34:47.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.596+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f42c8004ba0 con 0x7f42dc107820 2024-06-06T02:34:47.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.598+0000 7f42e0a00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 0x7f42c00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:47.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.598+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f42c80e2280 con 0x7f42dc107820 2024-06-06T02:34:47.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.598+0000 7f42daa00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 0x7f42c00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:47.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.599+0000 7f42daa00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 0x7f42c00b4e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42cc005e30 tx=0x7f42cc031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:47.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.602+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f42c80a9e00 con 0x7f42dc107820 2024-06-06T02:34:47.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.845+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f42dc062ba0 con 0x7f42c00b2900 2024-06-06T02:34:47.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.856+0000 7f42e0a00640 1 -- 172.21.15.82:0/3507492256 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f42dc062ba0 con 0x7f42c00b2900 2024-06-06T02:34:47.856 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/aa56730a-0b0b-49a1-b2a3-7d6ed36a3030 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 msgr2=0x7f42c00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 0x7f42c00b4e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42cc005e30 tx=0x7f42cc031000 comp rx=0 tx=0).stop 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 msgr2=0x7f42dc19fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 0x7f42dc19fad0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f42dc06a2d0 tx=0x7f42c800ee50 comp rx=0 tx=0).stop 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 shutdown_connections 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f42c00b2900 0x7f42c00b4e10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc108170 0x7f42dc1997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42dc107820 0x7f42dc19fad0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 --2- 172.21.15.82:0/3507492256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42dc102ef0 0x7f42dc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:47.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 >> 172.21.15.82:0/3507492256 conn(0x7f42dc0fe9b0 msgr2=0x7f42dc100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:47.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 shutdown_connections 2024-06-06T02:34:47.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:47.859+0000 7f42e1e00640 1 -- 172.21.15.82:0/3507492256 wait complete. 2024-06-06T02:34:48.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:48 smithi082 ceph-mon[31579]: pgmap v356: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:48.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:48 smithi103 ceph-mon[36349]: pgmap v356: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:48.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:48 smithi184 ceph-mon[36922]: pgmap v356: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:48.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:34:49.111 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:49.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:49 smithi103 ceph-mon[36349]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:49.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:49 smithi082 ceph-mon[31579]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:49.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:49 smithi184 ceph-mon[36922]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:34:50.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:50 smithi103 ceph-mon[36349]: pgmap v357: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:50.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:50 smithi082 ceph-mon[31579]: pgmap v357: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:50.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:50 smithi184 ceph-mon[36922]: pgmap v357: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-06-06T02:34:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.365+0000 7f90c7200640 1 -- 172.21.15.82:0/130804816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8102a90 msgr2=0x7f90c8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.365+0000 7f90c7200640 1 --2- 172.21.15.82:0/130804816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8102a90 0x7f90c8102ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009900 tx=0x7f90b402a410 comp rx=0 tx=0).stop 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 -- 172.21.15.82:0/130804816 shutdown_connections 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 --2- 172.21.15.82:0/130804816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 --2- 172.21.15.82:0/130804816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8102a90 0x7f90c8102ea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 --2- 172.21.15.82:0/130804816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8108ac0 0x7f90c8108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 -- 172.21.15.82:0/130804816 >> 172.21.15.82:0/130804816 conn(0x7f90c80fe7e0 msgr2=0x7f90c8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 -- 172.21.15.82:0/130804816 shutdown_connections 2024-06-06T02:34:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.366+0000 7f90c7200640 1 -- 172.21.15.82:0/130804816 wait complete. 2024-06-06T02:34:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.367+0000 7f90c7200640 1 Processor -- start 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.367+0000 7f90c7200640 1 -- start start 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.367+0000 7f90c7200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c8199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8108ac0 0x7f90c819df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8112d20 con 0x7f90c8108ac0 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8112ba0 con 0x7f90c81033e0 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c7200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8112ea0 con 0x7f90c8102a90 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55296/0 (socket says 172.21.15.82:55296) 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8108ac0 0x7f90c819df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 -- 172.21.15.82:0/677472791 learned_addr learned my addr 172.21.15.82:0/677472791 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5400640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c8199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 -- 172.21.15.82:0/677472791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 msgr2=0x7f90c8199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c8199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 -- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8108ac0 msgr2=0x7f90c819df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8108ac0 0x7f90c819df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5e00640 1 -- 172.21.15.82:0/677472791 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c819e590 con 0x7f90c8102a90 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.368+0000 7f90c5400640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:34:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90c5e00640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90b800e9f0 tx=0x7f90b800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b800cd80 con 0x7f90c8102a90 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90b80035f0 con 0x7f90c8102a90 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c819e880 con 0x7f90c8102a90 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8010670 con 0x7f90c8102a90 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.369+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c819ed40 con 0x7f90c8102a90 2024-06-06T02:34:51.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.370+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c8102ea0 con 0x7f90c8102a90 2024-06-06T02:34:51.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.373+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f90b8004000 con 0x7f90c8102a90 2024-06-06T02:34:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.374+0000 7f90bea00640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 0x7f90ac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.374+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f90b80e2750 con 0x7f90c8102a90 2024-06-06T02:34:51.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.374+0000 7f90c5400640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 0x7f90ac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:51.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.375+0000 7f90c5400640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 0x7f90ac0b4d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90b402aa00 tx=0x7f90b4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.378+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f90b80aa2d0 con 0x7f90c8102a90 2024-06-06T02:34:51.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.624+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90c810b000 con 0x7f90c8102a90 2024-06-06T02:34:51.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.625+0000 7f90bea00640 1 -- 172.21.15.82:0/677472791 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7f90b80a9bd0 con 0x7f90c8102a90 2024-06-06T02:34:51.625 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:34:51.626 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:34:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:34:51.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 msgr2=0x7f90ac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 0x7f90ac0b4d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90b402aa00 tx=0x7f90b4000bc0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 msgr2=0x7f90c8199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90b800e9f0 tx=0x7f90b800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 shutdown_connections 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f90c8108ac0 0x7f90c819df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90c81033e0 0x7f90c8199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f90ac0b2880 0x7f90ac0b4d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 --2- 172.21.15.82:0/677472791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90c8102a90 0x7f90c8199720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:51.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 >> 172.21.15.82:0/677472791 conn(0x7f90c80fe7e0 msgr2=0x7f90c8100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:51.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 shutdown_connections 2024-06-06T02:34:51.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:51.629+0000 7f90c7200640 1 -- 172.21.15.82:0/677472791 wait complete. 2024-06-06T02:34:52.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:52 smithi082 ceph-mon[31579]: pgmap v358: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-06-06T02:34:52.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:52 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/677472791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:34:52.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:52 smithi103 ceph-mon[36349]: pgmap v358: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-06-06T02:34:52.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:52 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/677472791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:34:52.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:34:52.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:52 smithi184 ceph-mon[36922]: pgmap v358: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-06-06T02:34:52.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:52 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/677472791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:34:52.821 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:54.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:54 smithi082 ceph-mon[31579]: pgmap v359: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:54.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:54 smithi103 ceph-mon[36349]: pgmap v359: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:54.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:54 smithi184 ceph-mon[36922]: pgmap v359: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 -- 172.21.15.82:0/3074555328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 msgr2=0x7fe66410e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 --2- 172.21.15.82:0/3074555328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe66410e050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe650009930 tx=0x7fe65002a420 comp rx=0 tx=0).stop 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 -- 172.21.15.82:0/3074555328 shutdown_connections 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 --2- 172.21.15.82:0/3074555328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe664115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 --2- 172.21.15.82:0/3074555328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe66410e050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 --2- 172.21.15.82:0/3074555328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe664109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 -- 172.21.15.82:0/3074555328 >> 172.21.15.82:0/3074555328 conn(0x7fe664078a80 msgr2=0x7fe664107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 -- 172.21.15.82:0/3074555328 shutdown_connections 2024-06-06T02:34:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.102+0000 7fe66aa00640 1 -- 172.21.15.82:0/3074555328 wait complete. 2024-06-06T02:34:55.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 Processor -- start 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 -- start start 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe6641a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe6641a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641192e0 con 0x7fe664109310 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe664119160 con 0x7fe66410e590 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe66aa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe664119460 con 0x7fe66410dc40 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.104+0000 7fe669600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe6641a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe669600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54384/0 (socket says 172.21.15.82:54384) 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe669600640 1 -- 172.21.15.82:0/1521890360 learned_addr learned my addr 172.21.15.82:0/1521890360 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe668c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe6641a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 -- 172.21.15.82:0/1521890360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 msgr2=0x7fe6641a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe6641a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 -- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 msgr2=0x7fe66419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 -- 172.21.15.82:0/1521890360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6641a4bb0 con 0x7fe66410e590 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe669600640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.105+0000 7fe66a000640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe6641a4570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ea80 tx=0x7fe65c00ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.106+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00cea0 con 0x7fe66410e590 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.106+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6641a4ea0 con 0x7fe66410e590 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.106+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe65c010430 con 0x7fe66410e590 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.106+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00f620 con 0x7fe66410e590 2024-06-06T02:34:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.106+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6641ac820 con 0x7fe66410e590 2024-06-06T02:34:55.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.107+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66410a7c0 con 0x7fe66410e590 2024-06-06T02:34:55.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.109+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe65c0108e0 con 0x7fe66410e590 2024-06-06T02:34:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.111+0000 7fe662000640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 0x7fe64c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.111+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe65c0e2ab0 con 0x7fe66410e590 2024-06-06T02:34:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.111+0000 7fe669600640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 0x7fe64c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:55.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.112+0000 7fe669600640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 0x7fe64c0b4e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe658011550 tx=0x7fe658005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:55.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.112+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe65c0aa630 con 0x7fe66410e590 2024-06-06T02:34:55.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.320+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe664109720 con 0x7fe66410e590 2024-06-06T02:34:55.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.322+0000 7fe662000640 1 -- 172.21.15.82:0/1521890360 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fe664109720 con 0x7fe66410e590 2024-06-06T02:34:55.323 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:34:55.323 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:34:55.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 msgr2=0x7fe64c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:55.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 0x7fe64c0b4e10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe658011550 tx=0x7fe658005f90 comp rx=0 tx=0).stop 2024-06-06T02:34:55.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 msgr2=0x7fe6641a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:55.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe6641a4570 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00ea80 tx=0x7fe65c00ef40 comp rx=0 tx=0).stop 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 shutdown_connections 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe66410e590 0x7fe6641a4570 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe64c0b2900 0x7fe64c0b4e10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe66410dc40 0x7fe6641a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 --2- 172.21.15.82:0/1521890360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe664109310 0x7fe66419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 >> 172.21.15.82:0/1521890360 conn(0x7fe664078a80 msgr2=0x7fe664079130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 shutdown_connections 2024-06-06T02:34:55.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:55.325+0000 7fe66aa00640 1 -- 172.21.15.82:0/1521890360 wait complete. 2024-06-06T02:34:56.124 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T02:34:56.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T02:34:56.359 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:56 smithi184 ceph-mon[36922]: pgmap v360: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-06-06T02:34:56.359 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:56 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1521890360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.359 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:56 smithi103 ceph-mon[36349]: pgmap v360: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-06-06T02:34:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:56 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1521890360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:56 smithi082 ceph-mon[31579]: pgmap v360: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-06-06T02:34:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:56 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1521890360' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:34:56.865 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:34:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:58 smithi103 ceph-mon[36349]: pgmap v361: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-06T02:34:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:34:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:58 smithi082 ceph-mon[31579]: pgmap v361: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-06T02:34:58.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:34:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:58 smithi184 ceph-mon[36922]: pgmap v361: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-06-06T02:34:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:34:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:34:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 -- 172.21.15.82:0/3267383903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848010d020 msgr2=0x7f848010f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 --2- 172.21.15.82:0/3267383903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848010d020 0x7f848010f510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8478009be0 tx=0x7f847802a6c0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 -- 172.21.15.82:0/3267383903 shutdown_connections 2024-06-06T02:34:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 --2- 172.21.15.82:0/3267383903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848010d020 0x7f848010f510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 --2- 172.21.15.82:0/3267383903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f848010ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 --2- 172.21.15.82:0/3267383903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8480103bc0 0x7f8480103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.183+0000 7f8486600640 1 -- 172.21.15.82:0/3267383903 >> 172.21.15.82:0/3267383903 conn(0x7f84800fd6a0 msgr2=0x7f84800ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.184+0000 7f8486600640 1 -- 172.21.15.82:0/3267383903 shutdown_connections 2024-06-06T02:34:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.184+0000 7f8486600640 1 -- 172.21.15.82:0/3267383903 wait complete. 2024-06-06T02:34:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 Processor -- start 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 -- start start 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8480103bc0 0x7f84801a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f848010d020 0x7f848019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8480112c80 con 0x7f8480103bc0 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8480112b00 con 0x7f848010d020 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.185+0000 7f8486600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8480112e00 con 0x7f8480104510 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45386/0 (socket says 172.21.15.82:45386) 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 -- 172.21.15.82:0/3112824052 learned_addr learned my addr 172.21.15.82:0/3112824052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8485200640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8480103bc0 0x7f84801a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8485c00640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f848010d020 0x7f848019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 -- 172.21.15.82:0/3112824052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f848010d020 msgr2=0x7f848019b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f848010d020 0x7f848019b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 -- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8480103bc0 msgr2=0x7f84801a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8480103bc0 0x7f84801a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.186+0000 7f8477e00640 1 -- 172.21.15.82:0/3112824052 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848019bdc0 con 0x7f8480104510 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f8477e00640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f846800e9c0 tx=0x7f846800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846800cd80 con 0x7f8480104510 2024-06-06T02:34:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848019c0b0 con 0x7f8480104510 2024-06-06T02:34:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84680054d0 con 0x7f8480104510 2024-06-06T02:34:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84801a82b0 con 0x7f8480104510 2024-06-06T02:34:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.187+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468010430 con 0x7f8480104510 2024-06-06T02:34:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.188+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848006b8f0 con 0x7f8480104510 2024-06-06T02:34:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.191+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8468004fb0 con 0x7f8480104510 2024-06-06T02:34:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.192+0000 7f847e000640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 0x7f84640b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:34:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.192+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f84680e28f0 con 0x7f8480104510 2024-06-06T02:34:59.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.192+0000 7f8485200640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 0x7f84640b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:34:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.193+0000 7f8485200640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 0x7f84640b4e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8470009530 tx=0x7f8470009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:34:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.194+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8468054df0 con 0x7f8480104510 2024-06-06T02:34:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.405+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84800ffb20 con 0x7f84640b2900 2024-06-06T02:34:59.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.414+0000 7f847e000640 1 -- 172.21.15.82:0/3112824052 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259004 (secure 0 0 0) 0x7f84800ffb20 con 0x7f84640b2900 2024-06-06T02:34:59.417 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:34:59.418 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:34:59.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 msgr2=0x7f84640b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 0x7f84640b4e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8470009530 tx=0x7f8470009260 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 msgr2=0x7f84801a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f846800e9c0 tx=0x7f846800ee80 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 shutdown_connections 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f848010d020 0x7f848019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84640b2900 0x7f84640b4e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8480104510 0x7f84801a1a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 --2- 172.21.15.82:0/3112824052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8480103bc0 0x7f84801a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 >> 172.21.15.82:0/3112824052 conn(0x7f84800fd6a0 msgr2=0x7f84800ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 shutdown_connections 2024-06-06T02:34:59.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:34:59.418+0000 7f8486600640 1 -- 172.21.15.82:0/3112824052 wait complete. 2024-06-06T02:35:00.194 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2024-06-06T02:34:58.780786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653027,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":289,"num_read_kb":235,"num_write":289,"num_write_kb":2259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355636,"kb_used_data":10644,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586188,"statfs":{"total":1151940427776,"available":1151576256512,"internally_reserved":0,"allocated":10899456,"data_stored":7054605,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13304,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":50,"num_write":13,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006378"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843782+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:34:15.843782+0000","last_peered":"2024-06-06T02:34:15.843782+0000","last_clean":"2024-06-06T02:34:15.843782+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:34:15.843782+0000","last_undegraded":"2024-06-06T02:34:15.843782+0000","last_fullsized":"2024-06-06T02:34:15.843782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846677+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:34:15.846677+0000","last_peered":"2024-06-06T02:34:15.846677+0000","last_clean":"2024-06-06T02:34:15.846677+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:34:15.846677+0000","last_undegraded":"2024-06-06T02:34:15.846677+0000","last_fullsized":"2024-06-06T02:34:15.846677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846053+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:34:15.846053+0000","last_peered":"2024-06-06T02:34:15.846053+0000","last_clean":"2024-06-06T02:34:15.846053+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:34:15.846053+0000","last_undegraded":"2024-06-06T02:34:15.846053+0000","last_fullsized":"2024-06-06T02:34:15.846053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.894122+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:34:15.894122+0000","last_peered":"2024-06-06T02:34:15.894122+0000","last_clean":"2024-06-06T02:34:15.894122+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:34:15.894122+0000","last_undegraded":"2024-06-06T02:34:15.894122+0000","last_fullsized":"2024-06-06T02:34:15.894122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846703+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:34:15.846703+0000","last_peered":"2024-06-06T02:34:15.846703+0000","last_clean":"2024-06-06T02:34:15.846703+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:34:15.846703+0000","last_undegraded":"2024-06-06T02:34:15.846703+0000","last_fullsized":"2024-06-06T02:34:15.846703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843072+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:34:15.843072+0000","last_peered":"2024-06-06T02:34:15.843072+0000","last_clean":"2024-06-06T02:34:15.843072+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:34:15.843072+0000","last_undegraded":"2024-06-06T02:34:15.843072+0000","last_fullsized":"2024-06-06T02:34:15.843072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845847+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:34:15.845847+0000","last_peered":"2024-06-06T02:34:15.845847+0000","last_clean":"2024-06-06T02:34:15.845847+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:34:15.845847+0000","last_undegraded":"2024-06-06T02:34:15.845847+0000","last_fullsized":"2024-06-06T02:34:15.845847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.854759+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:34:15.854759+0000","last_peered":"2024-06-06T02:34:15.854759+0000","last_clean":"2024-06-06T02:34:15.854759+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:34:15.854759+0000","last_undegraded":"2024-06-06T02:34:15.854759+0000","last_fullsized":"2024-06-06T02:34:15.854759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846621+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:34:15.846621+0000","last_peered":"2024-06-06T02:34:15.846621+0000","last_clean":"2024-06-06T02:34:15.846621+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:34:15.846621+0000","last_undegraded":"2024-06-06T02:34:15.846621+0000","last_fullsized":"2024-06-06T02:34:15.846621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843295+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:34:15.843295+0000","last_peered":"2024-06-06T02:34:15.843295+0000","last_clean":"2024-06-06T02:34:15.843295+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:34:15.843295+0000","last_undegraded":"2024-06-06T02:34:15.843295+0000","last_fullsized":"2024-06-06T02:34:15.843295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847166+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:34:15.847166+0000","last_peered":"2024-06-06T02:34:15.847166+0000","last_clean":"2024-06-06T02:34:15.847166+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:34:15.847166+0000","last_undegraded":"2024-06-06T02:34:15.847166+0000","last_fullsized":"2024-06-06T02:34:15.847166+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.894245+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:34:15.894245+0000","last_peered":"2024-06-06T02:34:15.894245+0000","last_clean":"2024-06-06T02:34:15.894245+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:34:15.894245+0000","last_undegraded":"2024-06-06T02:34:15.894245+0000","last_fullsized":"2024-06-06T02:34:15.894245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840535+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:34:15.840535+0000","last_peered":"2024-06-06T02:34:15.840535+0000","last_clean":"2024-06-06T02:34:15.840535+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:34:15.840535+0000","last_undegraded":"2024-06-06T02:34:15.840535+0000","last_fullsized":"2024-06-06T02:34:15.840535+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843244+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:34:15.843244+0000","last_peered":"2024-06-06T02:34:15.843244+0000","last_clean":"2024-06-06T02:34:15.843244+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:34:15.843244+0000","last_undegraded":"2024-06-06T02:34:15.843244+0000","last_fullsized":"2024-06-06T02:34:15.843244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.853106+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:34:15.853106+0000","last_peered":"2024-06-06T02:34:15.853106+0000","last_clean":"2024-06-06T02:34:15.853106+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:34:15.853106+0000","last_undegraded":"2024-06-06T02:34:15.853106+0000","last_fullsized":"2024-06-06T02:34:15.853106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845995+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:34:15.845995+0000","last_peered":"2024-06-06T02:34:15.845995+0000","last_clean":"2024-06-06T02:34:15.845995+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:34:15.845995+0000","last_undegraded":"2024-06-06T02:34:15.845995+0000","last_fullsized":"2024-06-06T02:34:15.845995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843931+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:34:15.843931+0000","last_peered":"2024-06-06T02:34:15.843931+0000","last_clean":"2024-06-06T02:34:15.843931+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:34:15.843931+0000","last_undegraded":"2024-06-06T02:34:15.843931+0000","last_fullsized":"2024-06-06T02:34:15.843931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.856726+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:34:15.856726+0000","last_peered":"2024-06-06T02:34:15.856726+0000","last_clean":"2024-06-06T02:34:15.856726+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:34:15.856726+0000","last_undegraded":"2024-06-06T02:34:15.856726+0000","last_fullsized":"2024-06-06T02:34:15.856726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842740+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:34:15.842740+0000","last_peered":"2024-06-06T02:34:15.842740+0000","last_clean":"2024-06-06T02:34:15.842740+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:34:15.842740+0000","last_undegraded":"2024-06-06T02:34:15.842740+0000","last_fullsized":"2024-06-06T02:34:15.842740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.857234+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:34:15.857234+0000","last_peered":"2024-06-06T02:34:15.857234+0000","last_clean":"2024-06-06T02:34:15.857234+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:34:15.857234+0000","last_undegraded":"2024-06-06T02:34:15.857234+0000","last_fullsized":"2024-06-06T02:34:15.857234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840353+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:34:15.840353+0000","last_peered":"2024-06-06T02:34:15.840353+0000","last_clean":"2024-06-06T02:34:15.840353+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:34:15.840353+0000","last_undegraded":"2024-06-06T02:34:15.840353+0000","last_fullsized":"2024-06-06T02:34:15.840353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846634+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:34:15.846634+0000","last_peered":"2024-06-06T02:34:15.846634+0000","last_clean":"2024-06-06T02:34:15.846634+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:34:15.846634+0000","last_undegraded":"2024-06-06T02:34:15.846634+0000","last_fullsized":"2024-06-06T02:34:15.846634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895035+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:34:15.895035+0000","last_peered":"2024-06-06T02:34:15.895035+0000","last_clean":"2024-06-06T02:34:15.895035+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:34:15.895035+0000","last_undegraded":"2024-06-06T02:34:15.895035+0000","last_fullsized":"2024-06-06T02:34:15.895035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840601+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:34:15.840601+0000","last_peered":"2024-06-06T02:34:15.840601+0000","last_clean":"2024-06-06T02:34:15.840601+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:34:15.840601+0000","last_undegraded":"2024-06-06T02:34:15.840601+0000","last_fullsized":"2024-06-06T02:34:15.840601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895516+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:34:15.895516+0000","last_peered":"2024-06-06T02:34:15.895516+0000","last_clean":"2024-06-06T02:34:15.895516+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:34:15.895516+0000","last_undegraded":"2024-06-06T02:34:15.895516+0000","last_fullsized":"2024-06-06T02:34:15.895516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843372+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:34:15.843372+0000","last_peered":"2024-06-06T02:34:15.843372+0000","last_clean":"2024-06-06T02:34:15.843372+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:34:15.843372+0000","last_undegraded":"2024-06-06T02:34:15.843372+0000","last_fullsized":"2024-06-06T02:34:15.843372+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855601+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:34:15.855601+0000","last_peered":"2024-06-06T02:34:15.855601+0000","last_clean":"2024-06-06T02:34:15.855601+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:34:15.855601+0000","last_undegraded":"2024-06-06T02:34:15.855601+0000","last_fullsized":"2024-06-06T02:34:15.855601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840711+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:34:15.840711+0000","last_peered":"2024-06-06T02:34:15.840711+0000","last_clean":"2024-06-06T02:34:15.840711+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:34:15.840711+0000","last_undegraded":"2024-06-06T02:34:15.840711+0000","last_fullsized":"2024-06-06T02:34:15.840711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.844551+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:34:15.844551+0000","last_peered":"2024-06-06T02:34:15.844551+0000","last_clean":"2024-06-06T02:34:15.844551+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:34:15.844551+0000","last_undegraded":"2024-06-06T02:34:15.844551+0000","last_fullsized":"2024-06-06T02:34:15.844551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842461+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:34:15.842461+0000","last_peered":"2024-06-06T02:34:15.842461+0000","last_clean":"2024-06-06T02:34:15.842461+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:34:15.842461+0000","last_undegraded":"2024-06-06T02:34:15.842461+0000","last_fullsized":"2024-06-06T02:34:15.842461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.850719+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:34:15.850719+0000","last_peered":"2024-06-06T02:34:15.850719+0000","last_clean":"2024-06-06T02:34:15.850719+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:34:15.850719+0000","last_undegraded":"2024-06-06T02:34:15.850719+0000","last_fullsized":"2024-06-06T02:34:15.850719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843355+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:34:15.843355+0000","last_peered":"2024-06-06T02:34:15.843355+0000","last_clean":"2024-06-06T02:34:15.843355+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:34:15.843355+0000","last_undegraded":"2024-06-06T02:34:15.843355+0000","last_fullsized":"2024-06-06T02:34:15.843355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846685+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:34:15.846685+0000","last_peered":"2024-06-06T02:34:15.846685+0000","last_clean":"2024-06-06T02:34:15.846685+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:34:15.846685+0000","last_undegraded":"2024-06-06T02:34:15.846685+0000","last_fullsized":"2024-06-06T02:34:15.846685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:56.000437+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:34:56.000437+0000","last_peered":"2024-06-06T02:34:56.000437+0000","last_clean":"2024-06-06T02:34:56.000437+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:34:56.000437+0000","last_undegraded":"2024-06-06T02:34:56.000437+0000","last_fullsized":"2024-06-06T02:34:56.000437+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840937+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:34:15.840937+0000","last_peered":"2024-06-06T02:34:15.840937+0000","last_clean":"2024-06-06T02:34:15.840937+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:34:15.840937+0000","last_undegraded":"2024-06-06T02:34:15.840937+0000","last_fullsized":"2024-06-06T02:34:15.840937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925035+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925035+0000","last_peered":"2024-06-06T02:34:21.925035+0000","last_clean":"2024-06-06T02:34:21.925035+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925035+0000","last_undegraded":"2024-06-06T02:34:21.925035+0000","last_fullsized":"2024-06-06T02:34:21.925035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.923844+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.923844+0000","last_peered":"2024-06-06T02:34:21.923844+0000","last_clean":"2024-06-06T02:34:21.923844+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.923844+0000","last_undegraded":"2024-06-06T02:34:21.923844+0000","last_fullsized":"2024-06-06T02:34:21.923844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895928+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:34:15.895928+0000","last_peered":"2024-06-06T02:34:15.895928+0000","last_clean":"2024-06-06T02:34:15.895928+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:34:15.895928+0000","last_undegraded":"2024-06-06T02:34:15.895928+0000","last_fullsized":"2024-06-06T02:34:15.895928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841079+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:15.841079+0000","last_peered":"2024-06-06T02:34:15.841079+0000","last_clean":"2024-06-06T02:34:15.841079+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:15.841079+0000","last_undegraded":"2024-06-06T02:34:15.841079+0000","last_fullsized":"2024-06-06T02:34:15.841079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.851121+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:34:15.851121+0000","last_peered":"2024-06-06T02:34:15.851121+0000","last_clean":"2024-06-06T02:34:15.851121+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:34:15.851121+0000","last_undegraded":"2024-06-06T02:34:15.851121+0000","last_fullsized":"2024-06-06T02:34:15.851121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":59,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:52.995097+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:34:52.995097+0000","last_peered":"2024-06-06T02:34:52.995097+0000","last_clean":"2024-06-06T02:34:52.995097+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:34:52.995097+0000","last_undegraded":"2024-06-06T02:34:52.995097+0000","last_fullsized":"2024-06-06T02:34:52.995097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846836+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:34:15.846836+0000","last_peered":"2024-06-06T02:34:15.846836+0000","last_clean":"2024-06-06T02:34:15.846836+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:34:15.846836+0000","last_undegraded":"2024-06-06T02:34:15.846836+0000","last_fullsized":"2024-06-06T02:34:15.846836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905443+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905443+0000","last_peered":"2024-06-06T02:34:20.905443+0000","last_clean":"2024-06-06T02:34:20.905443+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905443+0000","last_undegraded":"2024-06-06T02:34:20.905443+0000","last_fullsized":"2024-06-06T02:34:20.905443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847747+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:34:15.847747+0000","last_peered":"2024-06-06T02:34:15.847747+0000","last_clean":"2024-06-06T02:34:15.847747+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:34:15.847747+0000","last_undegraded":"2024-06-06T02:34:15.847747+0000","last_fullsized":"2024-06-06T02:34:15.847747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907581+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:20.907581+0000","last_peered":"2024-06-06T02:34:20.907581+0000","last_clean":"2024-06-06T02:34:20.907581+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:20.907581+0000","last_undegraded":"2024-06-06T02:34:20.907581+0000","last_fullsized":"2024-06-06T02:34:20.907581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846387+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:34:15.846387+0000","last_peered":"2024-06-06T02:34:15.846387+0000","last_clean":"2024-06-06T02:34:15.846387+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:34:15.846387+0000","last_undegraded":"2024-06-06T02:34:15.846387+0000","last_fullsized":"2024-06-06T02:34:15.846387+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'29","reported_seq":141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:54.025877+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:34:54.025877+0000","last_peered":"2024-06-06T02:34:54.025877+0000","last_clean":"2024-06-06T02:34:54.025877+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:34:54.025877+0000","last_undegraded":"2024-06-06T02:34:54.025877+0000","last_fullsized":"2024-06-06T02:34:54.025877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58815,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":70,"num_read_kb":91,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847004+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:34:15.847004+0000","last_peered":"2024-06-06T02:34:15.847004+0000","last_clean":"2024-06-06T02:34:15.847004+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:34:15.847004+0000","last_undegraded":"2024-06-06T02:34:15.847004+0000","last_fullsized":"2024-06-06T02:34:15.847004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.922794+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:21.922794+0000","last_peered":"2024-06-06T02:34:21.922794+0000","last_clean":"2024-06-06T02:34:21.922794+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:21.922794+0000","last_undegraded":"2024-06-06T02:34:21.922794+0000","last_fullsized":"2024-06-06T02:34:21.922794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.839679+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:34:15.839679+0000","last_peered":"2024-06-06T02:34:15.839679+0000","last_clean":"2024-06-06T02:34:15.839679+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:34:15.839679+0000","last_undegraded":"2024-06-06T02:34:15.839679+0000","last_fullsized":"2024-06-06T02:34:15.839679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911451+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911451+0000","last_peered":"2024-06-06T02:34:20.911451+0000","last_clean":"2024-06-06T02:34:20.911451+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911451+0000","last_undegraded":"2024-06-06T02:34:20.911451+0000","last_fullsized":"2024-06-06T02:34:20.911451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846433+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:34:15.846433+0000","last_peered":"2024-06-06T02:34:15.846433+0000","last_clean":"2024-06-06T02:34:15.846433+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:34:15.846433+0000","last_undegraded":"2024-06-06T02:34:15.846433+0000","last_fullsized":"2024-06-06T02:34:15.846433+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":61,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:53.011016+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:34:53.011016+0000","last_peered":"2024-06-06T02:34:53.011016+0000","last_clean":"2024-06-06T02:34:53.011016+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:34:53.011016+0000","last_undegraded":"2024-06-06T02:34:53.011016+0000","last_fullsized":"2024-06-06T02:34:53.011016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845741+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:34:15.845741+0000","last_peered":"2024-06-06T02:34:15.845741+0000","last_clean":"2024-06-06T02:34:15.845741+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:34:15.845741+0000","last_undegraded":"2024-06-06T02:34:15.845741+0000","last_fullsized":"2024-06-06T02:34:15.845741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924710+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:21.924710+0000","last_peered":"2024-06-06T02:34:21.924710+0000","last_clean":"2024-06-06T02:34:21.924710+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:21.924710+0000","last_undegraded":"2024-06-06T02:34:21.924710+0000","last_fullsized":"2024-06-06T02:34:21.924710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840601+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:34:15.840601+0000","last_peered":"2024-06-06T02:34:15.840601+0000","last_clean":"2024-06-06T02:34:15.840601+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:34:15.840601+0000","last_undegraded":"2024-06-06T02:34:15.840601+0000","last_fullsized":"2024-06-06T02:34:15.840601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:23.913598+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:23.913598+0000","last_peered":"2024-06-06T02:34:23.913598+0000","last_clean":"2024-06-06T02:34:23.913598+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:23.913598+0000","last_undegraded":"2024-06-06T02:34:23.913598+0000","last_fullsized":"2024-06-06T02:34:23.913598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.844303+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:34:15.844303+0000","last_peered":"2024-06-06T02:34:15.844303+0000","last_clean":"2024-06-06T02:34:15.844303+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:34:15.844303+0000","last_undegraded":"2024-06-06T02:34:15.844303+0000","last_fullsized":"2024-06-06T02:34:15.844303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840985+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.840985+0000","last_peered":"2024-06-06T02:34:15.840985+0000","last_clean":"2024-06-06T02:34:15.840985+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.840985+0000","last_undegraded":"2024-06-06T02:34:15.840985+0000","last_fullsized":"2024-06-06T02:34:15.840985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846917+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:34:15.846917+0000","last_peered":"2024-06-06T02:34:15.846917+0000","last_clean":"2024-06-06T02:34:15.846917+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:34:15.846917+0000","last_undegraded":"2024-06-06T02:34:15.846917+0000","last_fullsized":"2024-06-06T02:34:15.846917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841165+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:15.841165+0000","last_peered":"2024-06-06T02:34:15.841165+0000","last_clean":"2024-06-06T02:34:15.841165+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:15.841165+0000","last_undegraded":"2024-06-06T02:34:15.841165+0000","last_fullsized":"2024-06-06T02:34:15.841165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846578+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:34:15.846578+0000","last_peered":"2024-06-06T02:34:15.846578+0000","last_clean":"2024-06-06T02:34:15.846578+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:34:15.846578+0000","last_undegraded":"2024-06-06T02:34:15.846578+0000","last_fullsized":"2024-06-06T02:34:15.846578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924526+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:21.924526+0000","last_peered":"2024-06-06T02:34:21.924526+0000","last_clean":"2024-06-06T02:34:21.924526+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:21.924526+0000","last_undegraded":"2024-06-06T02:34:21.924526+0000","last_fullsized":"2024-06-06T02:34:21.924526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847333+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:34:15.847333+0000","last_peered":"2024-06-06T02:34:15.847333+0000","last_clean":"2024-06-06T02:34:15.847333+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:34:15.847333+0000","last_undegraded":"2024-06-06T02:34:15.847333+0000","last_fullsized":"2024-06-06T02:34:15.847333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":100,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846117+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:34:15.846117+0000","last_peered":"2024-06-06T02:34:15.846117+0000","last_clean":"2024-06-06T02:34:15.846117+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:34:15.846117+0000","last_undegraded":"2024-06-06T02:34:15.846117+0000","last_fullsized":"2024-06-06T02:34:15.846117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945295+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945295+0000","last_peered":"2024-06-06T02:34:24.945295+0000","last_clean":"2024-06-06T02:34:24.945295+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945295+0000","last_undegraded":"2024-06-06T02:34:24.945295+0000","last_fullsized":"2024-06-06T02:34:24.945295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895358+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:34:15.895358+0000","last_peered":"2024-06-06T02:34:15.895358+0000","last_clean":"2024-06-06T02:34:15.895358+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:34:15.895358+0000","last_undegraded":"2024-06-06T02:34:15.895358+0000","last_fullsized":"2024-06-06T02:34:15.895358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916416+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:34:21.916416+0000","last_peered":"2024-06-06T02:34:21.916416+0000","last_clean":"2024-06-06T02:34:21.916416+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:34:21.916416+0000","last_undegraded":"2024-06-06T02:34:21.916416+0000","last_fullsized":"2024-06-06T02:34:21.916416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.839360+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:34:15.839360+0000","last_peered":"2024-06-06T02:34:15.839360+0000","last_clean":"2024-06-06T02:34:15.839360+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:34:15.839360+0000","last_undegraded":"2024-06-06T02:34:15.839360+0000","last_fullsized":"2024-06-06T02:34:15.839360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":62,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:55.015051+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:34:55.015051+0000","last_peered":"2024-06-06T02:34:55.015051+0000","last_clean":"2024-06-06T02:34:55.015051+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:34:55.015051+0000","last_undegraded":"2024-06-06T02:34:55.015051+0000","last_fullsized":"2024-06-06T02:34:55.015051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840643+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:34:15.840643+0000","last_peered":"2024-06-06T02:34:15.840643+0000","last_clean":"2024-06-06T02:34:15.840643+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:34:15.840643+0000","last_undegraded":"2024-06-06T02:34:15.840643+0000","last_fullsized":"2024-06-06T02:34:15.840643+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846416+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:15.846416+0000","last_peered":"2024-06-06T02:34:15.846416+0000","last_clean":"2024-06-06T02:34:15.846416+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:15.846416+0000","last_undegraded":"2024-06-06T02:34:15.846416+0000","last_fullsized":"2024-06-06T02:34:15.846416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842766+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:34:15.842766+0000","last_peered":"2024-06-06T02:34:15.842766+0000","last_clean":"2024-06-06T02:34:15.842766+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:34:15.842766+0000","last_undegraded":"2024-06-06T02:34:15.842766+0000","last_fullsized":"2024-06-06T02:34:15.842766+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855581+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855581+0000","last_peered":"2024-06-06T02:34:15.855581+0000","last_clean":"2024-06-06T02:34:15.855581+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855581+0000","last_undegraded":"2024-06-06T02:34:15.855581+0000","last_fullsized":"2024-06-06T02:34:15.855581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842864+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:34:15.842864+0000","last_peered":"2024-06-06T02:34:15.842864+0000","last_clean":"2024-06-06T02:34:15.842864+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:34:15.842864+0000","last_undegraded":"2024-06-06T02:34:15.842864+0000","last_fullsized":"2024-06-06T02:34:15.842864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907772+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:20.907772+0000","last_peered":"2024-06-06T02:34:20.907772+0000","last_clean":"2024-06-06T02:34:20.907772+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:20.907772+0000","last_undegraded":"2024-06-06T02:34:20.907772+0000","last_fullsized":"2024-06-06T02:34:20.907772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840516+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:34:15.840516+0000","last_peered":"2024-06-06T02:34:15.840516+0000","last_clean":"2024-06-06T02:34:15.840516+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:34:15.840516+0000","last_undegraded":"2024-06-06T02:34:15.840516+0000","last_fullsized":"2024-06-06T02:34:15.840516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:50.645636+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:34:50.645636+0000","last_peered":"2024-06-06T02:34:50.645636+0000","last_clean":"2024-06-06T02:34:50.645636+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:34:50.645636+0000","last_undegraded":"2024-06-06T02:34:50.645636+0000","last_fullsized":"2024-06-06T02:34:50.645636+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895641+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:34:15.895641+0000","last_peered":"2024-06-06T02:34:15.895641+0000","last_clean":"2024-06-06T02:34:15.895641+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:34:15.895641+0000","last_undegraded":"2024-06-06T02:34:15.895641+0000","last_fullsized":"2024-06-06T02:34:15.895641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906706+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.906706+0000","last_peered":"2024-06-06T02:34:20.906706+0000","last_clean":"2024-06-06T02:34:20.906706+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.906706+0000","last_undegraded":"2024-06-06T02:34:20.906706+0000","last_fullsized":"2024-06-06T02:34:20.906706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846978+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:34:15.846978+0000","last_peered":"2024-06-06T02:34:15.846978+0000","last_clean":"2024-06-06T02:34:15.846978+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:34:15.846978+0000","last_undegraded":"2024-06-06T02:34:15.846978+0000","last_fullsized":"2024-06-06T02:34:15.846978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907814+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.907814+0000","last_peered":"2024-06-06T02:34:20.907814+0000","last_clean":"2024-06-06T02:34:20.907814+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.907814+0000","last_undegraded":"2024-06-06T02:34:20.907814+0000","last_fullsized":"2024-06-06T02:34:20.907814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846689+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:34:15.846689+0000","last_peered":"2024-06-06T02:34:15.846689+0000","last_clean":"2024-06-06T02:34:15.846689+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:34:15.846689+0000","last_undegraded":"2024-06-06T02:34:15.846689+0000","last_fullsized":"2024-06-06T02:34:15.846689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.913884+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.913884+0000","last_peered":"2024-06-06T02:34:20.913884+0000","last_clean":"2024-06-06T02:34:20.913884+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.913884+0000","last_undegraded":"2024-06-06T02:34:20.913884+0000","last_fullsized":"2024-06-06T02:34:20.913884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843485+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:34:15.843485+0000","last_peered":"2024-06-06T02:34:15.843485+0000","last_clean":"2024-06-06T02:34:15.843485+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:34:15.843485+0000","last_undegraded":"2024-06-06T02:34:15.843485+0000","last_fullsized":"2024-06-06T02:34:15.843485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:18.874719+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:18.874719+0000","last_peered":"2024-06-06T02:34:18.874719+0000","last_clean":"2024-06-06T02:34:18.874719+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:18.874719+0000","last_undegraded":"2024-06-06T02:34:18.874719+0000","last_fullsized":"2024-06-06T02:34:18.874719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895785+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:34:15.895785+0000","last_peered":"2024-06-06T02:34:15.895785+0000","last_clean":"2024-06-06T02:34:15.895785+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:34:15.895785+0000","last_undegraded":"2024-06-06T02:34:15.895785+0000","last_fullsized":"2024-06-06T02:34:15.895785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905135+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:20.905135+0000","last_peered":"2024-06-06T02:34:20.905135+0000","last_clean":"2024-06-06T02:34:20.905135+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:20.905135+0000","last_undegraded":"2024-06-06T02:34:20.905135+0000","last_fullsized":"2024-06-06T02:34:20.905135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846148+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:34:15.846148+0000","last_peered":"2024-06-06T02:34:15.846148+0000","last_clean":"2024-06-06T02:34:15.846148+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:34:15.846148+0000","last_undegraded":"2024-06-06T02:34:15.846148+0000","last_fullsized":"2024-06-06T02:34:15.846148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840592+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:34:15.840592+0000","last_peered":"2024-06-06T02:34:15.840592+0000","last_clean":"2024-06-06T02:34:15.840592+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:34:15.840592+0000","last_undegraded":"2024-06-06T02:34:15.840592+0000","last_fullsized":"2024-06-06T02:34:15.840592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846967+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.846967+0000","last_peered":"2024-06-06T02:34:15.846967+0000","last_clean":"2024-06-06T02:34:15.846967+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.846967+0000","last_undegraded":"2024-06-06T02:34:15.846967+0000","last_fullsized":"2024-06-06T02:34:15.846967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846380+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:34:15.846380+0000","last_peered":"2024-06-06T02:34:15.846380+0000","last_clean":"2024-06-06T02:34:15.846380+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:34:15.846380+0000","last_undegraded":"2024-06-06T02:34:15.846380+0000","last_fullsized":"2024-06-06T02:34:15.846380+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916923+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.916923+0000","last_peered":"2024-06-06T02:34:21.916923+0000","last_clean":"2024-06-06T02:34:21.916923+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.916923+0000","last_undegraded":"2024-06-06T02:34:21.916923+0000","last_fullsized":"2024-06-06T02:34:21.916923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847629+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:34:15.847629+0000","last_peered":"2024-06-06T02:34:15.847629+0000","last_clean":"2024-06-06T02:34:15.847629+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:34:15.847629+0000","last_undegraded":"2024-06-06T02:34:15.847629+0000","last_fullsized":"2024-06-06T02:34:15.847629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.896368+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:34:15.896368+0000","last_peered":"2024-06-06T02:34:15.896368+0000","last_clean":"2024-06-06T02:34:15.896368+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:34:15.896368+0000","last_undegraded":"2024-06-06T02:34:15.896368+0000","last_fullsized":"2024-06-06T02:34:15.896368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895735+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:34:15.895735+0000","last_peered":"2024-06-06T02:34:15.895735+0000","last_clean":"2024-06-06T02:34:15.895735+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:34:15.895735+0000","last_undegraded":"2024-06-06T02:34:15.895735+0000","last_fullsized":"2024-06-06T02:34:15.895735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925206+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:21.925206+0000","last_peered":"2024-06-06T02:34:21.925206+0000","last_clean":"2024-06-06T02:34:21.925206+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:21.925206+0000","last_undegraded":"2024-06-06T02:34:21.925206+0000","last_fullsized":"2024-06-06T02:34:21.925206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62425,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":213,"num_read_kb":171,"num_write":164,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187275,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710745,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":1075505,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462961,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1016904,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":484086,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":925696,"data_stored":483442,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":58815,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59459,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60393,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:35:00.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T02:35:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: pgmap v362: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-06T02:35:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='client.24814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:00.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:35:00.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:35:00.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.620 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: pgmap v362: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-06T02:35:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='client.24814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:00.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:35:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:35:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: pgmap v362: 97 pgs: 97 active+clean; 638 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-06-06T02:35:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='client.24814 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:35:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:35:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:35:02.510 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:02 smithi082 ceph-mon[31579]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-06-06T02:35:02.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:02 smithi184 ceph-mon[36922]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-06-06T02:35:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 -- 172.21.15.82:0/1602693595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410109a20 msgr2=0x7f9410109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 --2- 172.21.15.82:0/1602693595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410109a20 0x7f9410109e30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009960 tx=0x7f93f802a460 comp rx=0 tx=0).stop 2024-06-06T02:35:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 -- 172.21.15.82:0/1602693595 shutdown_connections 2024-06-06T02:35:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 --2- 172.21.15.82:0/1602693595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a370 0x7f9410111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 --2- 172.21.15.82:0/1602693595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9410109a20 0x7f9410109e30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 --2- 172.21.15.82:0/1602693595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f9410105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 -- 172.21.15.82:0/1602693595 >> 172.21.15.82:0/1602693595 conn(0x7f9410100b90 msgr2=0x7f9410102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 -- 172.21.15.82:0/1602693595 shutdown_connections 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.832+0000 7f9416c00640 1 -- 172.21.15.82:0/1602693595 wait complete. 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.833+0000 7f9416c00640 1 Processor -- start 2024-06-06T02:35:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 -- start start 2024-06-06T02:35:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9410109a20 0x7f94101a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 0x7f941019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9410115050 con 0x7f941010a370 2024-06-06T02:35:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9410114ed0 con 0x7f9410109a20 2024-06-06T02:35:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.834+0000 7f9416c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f94101151d0 con 0x7f94101050f0 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f9414c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 0x7f941019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45778/0 (socket says 172.21.15.82:45778) 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 -- 172.21.15.82:0/4119373048 learned_addr learned my addr 172.21.15.82:0/4119373048 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f9407400640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9410109a20 0x7f94101a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 -- 172.21.15.82:0/4119373048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9410109a20 msgr2=0x7f94101a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9410109a20 0x7f94101a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 -- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 msgr2=0x7f941019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 0x7f941019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f940fe00640 1 -- 172.21.15.82:0/4119373048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941019c010 con 0x7f94101050f0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.835+0000 7f9414c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 0x7f941019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f940fe00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f940000ebc0 tx=0x7f940000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400010430 con 0x7f94101050f0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9400010a80 con 0x7f94101050f0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941019c300 con 0x7f94101050f0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400018a50 con 0x7f94101050f0 2024-06-06T02:35:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.836+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94101a8610 con 0x7f94101050f0 2024-06-06T02:35:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.837+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94101065a0 con 0x7f94101050f0 2024-06-06T02:35:02.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.839+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9400010c30 con 0x7f94101050f0 2024-06-06T02:35:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.841+0000 7f940d600640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 0x7f93f40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.841+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f94000e2f50 con 0x7f94101050f0 2024-06-06T02:35:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.841+0000 7f9407400640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 0x7f93f40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.842+0000 7f9407400640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 0x7f93f40b4d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009230 tx=0x7f93f8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:02.843+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f94000aaad0 con 0x7f94101050f0 2024-06-06T02:35:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:02 smithi103 ceph-mon[36349]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-06-06T02:35:03.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.046+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9410062ba0 con 0x7f93f40b2880 2024-06-06T02:35:03.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.056+0000 7f940d600640 1 -- 172.21.15.82:0/4119373048 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259028 (secure 0 0 0) 0x7f9410062ba0 con 0x7f93f40b2880 2024-06-06T02:35:03.061 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:35:03.062 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:35:03.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.063+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 msgr2=0x7f93f40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:03.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.063+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 0x7f93f40b4d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009230 tx=0x7f93f8005d50 comp rx=0 tx=0).stop 2024-06-06T02:35:03.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 msgr2=0x7f94101a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f940000ebc0 tx=0x7f940000c2d0 comp rx=0 tx=0).stop 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 shutdown_connections 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f941010a370 0x7f941019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9410109a20 0x7f94101a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93f40b2880 0x7f93f40b4d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 --2- 172.21.15.82:0/4119373048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94101050f0 0x7f94101a1780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 >> 172.21.15.82:0/4119373048 conn(0x7f9410100b90 msgr2=0x7f9410102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 shutdown_connections 2024-06-06T02:35:03.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:03.064+0000 7f9416c00640 1 -- 172.21.15.82:0/4119373048 wait complete. 2024-06-06T02:35:03.878 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-06-06T02:35:02.783017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657284,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":320,"num_read_kb":255,"num_write":290,"num_write_kb":2264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355648,"kb_used_data":10656,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586176,"statfs":{"total":1151940427776,"available":1151576244224,"internally_reserved":0,"allocated":10911744,"data_stored":7067376,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":353154361},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8705,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":45,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843782+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:34:15.843782+0000","last_peered":"2024-06-06T02:34:15.843782+0000","last_clean":"2024-06-06T02:34:15.843782+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:34:15.843782+0000","last_undegraded":"2024-06-06T02:34:15.843782+0000","last_fullsized":"2024-06-06T02:34:15.843782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846677+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:34:15.846677+0000","last_peered":"2024-06-06T02:34:15.846677+0000","last_clean":"2024-06-06T02:34:15.846677+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:34:15.846677+0000","last_undegraded":"2024-06-06T02:34:15.846677+0000","last_fullsized":"2024-06-06T02:34:15.846677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846053+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:34:15.846053+0000","last_peered":"2024-06-06T02:34:15.846053+0000","last_clean":"2024-06-06T02:34:15.846053+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:34:15.846053+0000","last_undegraded":"2024-06-06T02:34:15.846053+0000","last_fullsized":"2024-06-06T02:34:15.846053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.894122+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:34:15.894122+0000","last_peered":"2024-06-06T02:34:15.894122+0000","last_clean":"2024-06-06T02:34:15.894122+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:34:15.894122+0000","last_undegraded":"2024-06-06T02:34:15.894122+0000","last_fullsized":"2024-06-06T02:34:15.894122+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846703+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:34:15.846703+0000","last_peered":"2024-06-06T02:34:15.846703+0000","last_clean":"2024-06-06T02:34:15.846703+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:34:15.846703+0000","last_undegraded":"2024-06-06T02:34:15.846703+0000","last_fullsized":"2024-06-06T02:34:15.846703+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843072+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:34:15.843072+0000","last_peered":"2024-06-06T02:34:15.843072+0000","last_clean":"2024-06-06T02:34:15.843072+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:34:15.843072+0000","last_undegraded":"2024-06-06T02:34:15.843072+0000","last_fullsized":"2024-06-06T02:34:15.843072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845847+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:34:15.845847+0000","last_peered":"2024-06-06T02:34:15.845847+0000","last_clean":"2024-06-06T02:34:15.845847+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:34:15.845847+0000","last_undegraded":"2024-06-06T02:34:15.845847+0000","last_fullsized":"2024-06-06T02:34:15.845847+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.854759+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:34:15.854759+0000","last_peered":"2024-06-06T02:34:15.854759+0000","last_clean":"2024-06-06T02:34:15.854759+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:34:15.854759+0000","last_undegraded":"2024-06-06T02:34:15.854759+0000","last_fullsized":"2024-06-06T02:34:15.854759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846621+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:34:15.846621+0000","last_peered":"2024-06-06T02:34:15.846621+0000","last_clean":"2024-06-06T02:34:15.846621+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:34:15.846621+0000","last_undegraded":"2024-06-06T02:34:15.846621+0000","last_fullsized":"2024-06-06T02:34:15.846621+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843295+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:34:15.843295+0000","last_peered":"2024-06-06T02:34:15.843295+0000","last_clean":"2024-06-06T02:34:15.843295+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:34:15.843295+0000","last_undegraded":"2024-06-06T02:34:15.843295+0000","last_fullsized":"2024-06-06T02:34:15.843295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847166+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:34:15.847166+0000","last_peered":"2024-06-06T02:34:15.847166+0000","last_clean":"2024-06-06T02:34:15.847166+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:34:15.847166+0000","last_undegraded":"2024-06-06T02:34:15.847166+0000","last_fullsized":"2024-06-06T02:34:15.847166+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.894245+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:34:15.894245+0000","last_peered":"2024-06-06T02:34:15.894245+0000","last_clean":"2024-06-06T02:34:15.894245+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:34:15.894245+0000","last_undegraded":"2024-06-06T02:34:15.894245+0000","last_fullsized":"2024-06-06T02:34:15.894245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840535+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:34:15.840535+0000","last_peered":"2024-06-06T02:34:15.840535+0000","last_clean":"2024-06-06T02:34:15.840535+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:34:15.840535+0000","last_undegraded":"2024-06-06T02:34:15.840535+0000","last_fullsized":"2024-06-06T02:34:15.840535+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843244+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:34:15.843244+0000","last_peered":"2024-06-06T02:34:15.843244+0000","last_clean":"2024-06-06T02:34:15.843244+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:34:15.843244+0000","last_undegraded":"2024-06-06T02:34:15.843244+0000","last_fullsized":"2024-06-06T02:34:15.843244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.853106+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:34:15.853106+0000","last_peered":"2024-06-06T02:34:15.853106+0000","last_clean":"2024-06-06T02:34:15.853106+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:34:15.853106+0000","last_undegraded":"2024-06-06T02:34:15.853106+0000","last_fullsized":"2024-06-06T02:34:15.853106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845995+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:34:15.845995+0000","last_peered":"2024-06-06T02:34:15.845995+0000","last_clean":"2024-06-06T02:34:15.845995+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:34:15.845995+0000","last_undegraded":"2024-06-06T02:34:15.845995+0000","last_fullsized":"2024-06-06T02:34:15.845995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843931+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:34:15.843931+0000","last_peered":"2024-06-06T02:34:15.843931+0000","last_clean":"2024-06-06T02:34:15.843931+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:34:15.843931+0000","last_undegraded":"2024-06-06T02:34:15.843931+0000","last_fullsized":"2024-06-06T02:34:15.843931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.856726+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:34:15.856726+0000","last_peered":"2024-06-06T02:34:15.856726+0000","last_clean":"2024-06-06T02:34:15.856726+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:34:15.856726+0000","last_undegraded":"2024-06-06T02:34:15.856726+0000","last_fullsized":"2024-06-06T02:34:15.856726+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842740+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:34:15.842740+0000","last_peered":"2024-06-06T02:34:15.842740+0000","last_clean":"2024-06-06T02:34:15.842740+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:34:15.842740+0000","last_undegraded":"2024-06-06T02:34:15.842740+0000","last_fullsized":"2024-06-06T02:34:15.842740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.857234+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:34:15.857234+0000","last_peered":"2024-06-06T02:34:15.857234+0000","last_clean":"2024-06-06T02:34:15.857234+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:34:15.857234+0000","last_undegraded":"2024-06-06T02:34:15.857234+0000","last_fullsized":"2024-06-06T02:34:15.857234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840353+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:34:15.840353+0000","last_peered":"2024-06-06T02:34:15.840353+0000","last_clean":"2024-06-06T02:34:15.840353+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:34:15.840353+0000","last_undegraded":"2024-06-06T02:34:15.840353+0000","last_fullsized":"2024-06-06T02:34:15.840353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846634+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:34:15.846634+0000","last_peered":"2024-06-06T02:34:15.846634+0000","last_clean":"2024-06-06T02:34:15.846634+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:34:15.846634+0000","last_undegraded":"2024-06-06T02:34:15.846634+0000","last_fullsized":"2024-06-06T02:34:15.846634+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895035+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:34:15.895035+0000","last_peered":"2024-06-06T02:34:15.895035+0000","last_clean":"2024-06-06T02:34:15.895035+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:34:15.895035+0000","last_undegraded":"2024-06-06T02:34:15.895035+0000","last_fullsized":"2024-06-06T02:34:15.895035+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840601+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:34:15.840601+0000","last_peered":"2024-06-06T02:34:15.840601+0000","last_clean":"2024-06-06T02:34:15.840601+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:34:15.840601+0000","last_undegraded":"2024-06-06T02:34:15.840601+0000","last_fullsized":"2024-06-06T02:34:15.840601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895516+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:34:15.895516+0000","last_peered":"2024-06-06T02:34:15.895516+0000","last_clean":"2024-06-06T02:34:15.895516+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:34:15.895516+0000","last_undegraded":"2024-06-06T02:34:15.895516+0000","last_fullsized":"2024-06-06T02:34:15.895516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843372+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:34:15.843372+0000","last_peered":"2024-06-06T02:34:15.843372+0000","last_clean":"2024-06-06T02:34:15.843372+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:34:15.843372+0000","last_undegraded":"2024-06-06T02:34:15.843372+0000","last_fullsized":"2024-06-06T02:34:15.843372+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855601+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:34:15.855601+0000","last_peered":"2024-06-06T02:34:15.855601+0000","last_clean":"2024-06-06T02:34:15.855601+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:34:15.855601+0000","last_undegraded":"2024-06-06T02:34:15.855601+0000","last_fullsized":"2024-06-06T02:34:15.855601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840711+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:34:15.840711+0000","last_peered":"2024-06-06T02:34:15.840711+0000","last_clean":"2024-06-06T02:34:15.840711+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:34:15.840711+0000","last_undegraded":"2024-06-06T02:34:15.840711+0000","last_fullsized":"2024-06-06T02:34:15.840711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.844551+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:34:15.844551+0000","last_peered":"2024-06-06T02:34:15.844551+0000","last_clean":"2024-06-06T02:34:15.844551+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:34:15.844551+0000","last_undegraded":"2024-06-06T02:34:15.844551+0000","last_fullsized":"2024-06-06T02:34:15.844551+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842461+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:34:15.842461+0000","last_peered":"2024-06-06T02:34:15.842461+0000","last_clean":"2024-06-06T02:34:15.842461+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:34:15.842461+0000","last_undegraded":"2024-06-06T02:34:15.842461+0000","last_fullsized":"2024-06-06T02:34:15.842461+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.850719+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:34:15.850719+0000","last_peered":"2024-06-06T02:34:15.850719+0000","last_clean":"2024-06-06T02:34:15.850719+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:34:15.850719+0000","last_undegraded":"2024-06-06T02:34:15.850719+0000","last_fullsized":"2024-06-06T02:34:15.850719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843355+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:34:15.843355+0000","last_peered":"2024-06-06T02:34:15.843355+0000","last_clean":"2024-06-06T02:34:15.843355+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:34:15.843355+0000","last_undegraded":"2024-06-06T02:34:15.843355+0000","last_fullsized":"2024-06-06T02:34:15.843355+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846685+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:34:15.846685+0000","last_peered":"2024-06-06T02:34:15.846685+0000","last_clean":"2024-06-06T02:34:15.846685+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:34:15.846685+0000","last_undegraded":"2024-06-06T02:34:15.846685+0000","last_fullsized":"2024-06-06T02:34:15.846685+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:01.008400+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:35:01.008400+0000","last_peered":"2024-06-06T02:35:01.008400+0000","last_clean":"2024-06-06T02:35:01.008400+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:35:01.008400+0000","last_undegraded":"2024-06-06T02:35:01.008400+0000","last_fullsized":"2024-06-06T02:35:01.008400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840937+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:34:15.840937+0000","last_peered":"2024-06-06T02:34:15.840937+0000","last_clean":"2024-06-06T02:34:15.840937+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:34:15.840937+0000","last_undegraded":"2024-06-06T02:34:15.840937+0000","last_fullsized":"2024-06-06T02:34:15.840937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925035+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925035+0000","last_peered":"2024-06-06T02:34:21.925035+0000","last_clean":"2024-06-06T02:34:21.925035+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925035+0000","last_undegraded":"2024-06-06T02:34:21.925035+0000","last_fullsized":"2024-06-06T02:34:21.925035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.923844+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.923844+0000","last_peered":"2024-06-06T02:34:21.923844+0000","last_clean":"2024-06-06T02:34:21.923844+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.923844+0000","last_undegraded":"2024-06-06T02:34:21.923844+0000","last_fullsized":"2024-06-06T02:34:21.923844+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895928+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:34:15.895928+0000","last_peered":"2024-06-06T02:34:15.895928+0000","last_clean":"2024-06-06T02:34:15.895928+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:34:15.895928+0000","last_undegraded":"2024-06-06T02:34:15.895928+0000","last_fullsized":"2024-06-06T02:34:15.895928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841079+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:15.841079+0000","last_peered":"2024-06-06T02:34:15.841079+0000","last_clean":"2024-06-06T02:34:15.841079+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:15.841079+0000","last_undegraded":"2024-06-06T02:34:15.841079+0000","last_fullsized":"2024-06-06T02:34:15.841079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.851121+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:34:15.851121+0000","last_peered":"2024-06-06T02:34:15.851121+0000","last_clean":"2024-06-06T02:34:15.851121+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:34:15.851121+0000","last_undegraded":"2024-06-06T02:34:15.851121+0000","last_fullsized":"2024-06-06T02:34:15.851121+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":64,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:58.002698+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:34:58.002698+0000","last_peered":"2024-06-06T02:34:58.002698+0000","last_clean":"2024-06-06T02:34:58.002698+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:34:58.002698+0000","last_undegraded":"2024-06-06T02:34:58.002698+0000","last_fullsized":"2024-06-06T02:34:58.002698+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846836+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:34:15.846836+0000","last_peered":"2024-06-06T02:34:15.846836+0000","last_clean":"2024-06-06T02:34:15.846836+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:34:15.846836+0000","last_undegraded":"2024-06-06T02:34:15.846836+0000","last_fullsized":"2024-06-06T02:34:15.846836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905443+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905443+0000","last_peered":"2024-06-06T02:34:20.905443+0000","last_clean":"2024-06-06T02:34:20.905443+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905443+0000","last_undegraded":"2024-06-06T02:34:20.905443+0000","last_fullsized":"2024-06-06T02:34:20.905443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847747+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:34:15.847747+0000","last_peered":"2024-06-06T02:34:15.847747+0000","last_clean":"2024-06-06T02:34:15.847747+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:34:15.847747+0000","last_undegraded":"2024-06-06T02:34:15.847747+0000","last_fullsized":"2024-06-06T02:34:15.847747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907581+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:20.907581+0000","last_peered":"2024-06-06T02:34:20.907581+0000","last_clean":"2024-06-06T02:34:20.907581+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:20.907581+0000","last_undegraded":"2024-06-06T02:34:20.907581+0000","last_fullsized":"2024-06-06T02:34:20.907581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846387+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:34:15.846387+0000","last_peered":"2024-06-06T02:34:15.846387+0000","last_clean":"2024-06-06T02:34:15.846387+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:34:15.846387+0000","last_undegraded":"2024-06-06T02:34:15.846387+0000","last_fullsized":"2024-06-06T02:34:15.846387+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'30","reported_seq":153,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:59.049531+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:34:59.049531+0000","last_peered":"2024-06-06T02:34:59.049531+0000","last_clean":"2024-06-06T02:34:59.049531+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:34:59.049531+0000","last_undegraded":"2024-06-06T02:34:59.049531+0000","last_fullsized":"2024-06-06T02:34:59.049531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63072,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":81,"num_read_kb":101,"num_write":31,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847004+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:34:15.847004+0000","last_peered":"2024-06-06T02:34:15.847004+0000","last_clean":"2024-06-06T02:34:15.847004+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:34:15.847004+0000","last_undegraded":"2024-06-06T02:34:15.847004+0000","last_fullsized":"2024-06-06T02:34:15.847004+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.922794+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:21.922794+0000","last_peered":"2024-06-06T02:34:21.922794+0000","last_clean":"2024-06-06T02:34:21.922794+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:21.922794+0000","last_undegraded":"2024-06-06T02:34:21.922794+0000","last_fullsized":"2024-06-06T02:34:21.922794+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.839679+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:34:15.839679+0000","last_peered":"2024-06-06T02:34:15.839679+0000","last_clean":"2024-06-06T02:34:15.839679+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:34:15.839679+0000","last_undegraded":"2024-06-06T02:34:15.839679+0000","last_fullsized":"2024-06-06T02:34:15.839679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911451+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911451+0000","last_peered":"2024-06-06T02:34:20.911451+0000","last_clean":"2024-06-06T02:34:20.911451+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911451+0000","last_undegraded":"2024-06-06T02:34:20.911451+0000","last_fullsized":"2024-06-06T02:34:20.911451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846433+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:34:15.846433+0000","last_peered":"2024-06-06T02:34:15.846433+0000","last_clean":"2024-06-06T02:34:15.846433+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:34:15.846433+0000","last_undegraded":"2024-06-06T02:34:15.846433+0000","last_fullsized":"2024-06-06T02:34:15.846433+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":66,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:58.021358+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:34:58.021358+0000","last_peered":"2024-06-06T02:34:58.021358+0000","last_clean":"2024-06-06T02:34:58.021358+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:34:58.021358+0000","last_undegraded":"2024-06-06T02:34:58.021358+0000","last_fullsized":"2024-06-06T02:34:58.021358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.845741+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:34:15.845741+0000","last_peered":"2024-06-06T02:34:15.845741+0000","last_clean":"2024-06-06T02:34:15.845741+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:34:15.845741+0000","last_undegraded":"2024-06-06T02:34:15.845741+0000","last_fullsized":"2024-06-06T02:34:15.845741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924710+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:21.924710+0000","last_peered":"2024-06-06T02:34:21.924710+0000","last_clean":"2024-06-06T02:34:21.924710+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:21.924710+0000","last_undegraded":"2024-06-06T02:34:21.924710+0000","last_fullsized":"2024-06-06T02:34:21.924710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840601+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:34:15.840601+0000","last_peered":"2024-06-06T02:34:15.840601+0000","last_clean":"2024-06-06T02:34:15.840601+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:34:15.840601+0000","last_undegraded":"2024-06-06T02:34:15.840601+0000","last_fullsized":"2024-06-06T02:34:15.840601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:23.913598+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:23.913598+0000","last_peered":"2024-06-06T02:34:23.913598+0000","last_clean":"2024-06-06T02:34:23.913598+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:23.913598+0000","last_undegraded":"2024-06-06T02:34:23.913598+0000","last_fullsized":"2024-06-06T02:34:23.913598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.844303+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:34:15.844303+0000","last_peered":"2024-06-06T02:34:15.844303+0000","last_clean":"2024-06-06T02:34:15.844303+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:34:15.844303+0000","last_undegraded":"2024-06-06T02:34:15.844303+0000","last_fullsized":"2024-06-06T02:34:15.844303+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840985+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.840985+0000","last_peered":"2024-06-06T02:34:15.840985+0000","last_clean":"2024-06-06T02:34:15.840985+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.840985+0000","last_undegraded":"2024-06-06T02:34:15.840985+0000","last_fullsized":"2024-06-06T02:34:15.840985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846917+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:34:15.846917+0000","last_peered":"2024-06-06T02:34:15.846917+0000","last_clean":"2024-06-06T02:34:15.846917+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:34:15.846917+0000","last_undegraded":"2024-06-06T02:34:15.846917+0000","last_fullsized":"2024-06-06T02:34:15.846917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841165+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:15.841165+0000","last_peered":"2024-06-06T02:34:15.841165+0000","last_clean":"2024-06-06T02:34:15.841165+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:15.841165+0000","last_undegraded":"2024-06-06T02:34:15.841165+0000","last_fullsized":"2024-06-06T02:34:15.841165+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846578+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:34:15.846578+0000","last_peered":"2024-06-06T02:34:15.846578+0000","last_clean":"2024-06-06T02:34:15.846578+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:34:15.846578+0000","last_undegraded":"2024-06-06T02:34:15.846578+0000","last_fullsized":"2024-06-06T02:34:15.846578+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924526+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:21.924526+0000","last_peered":"2024-06-06T02:34:21.924526+0000","last_clean":"2024-06-06T02:34:21.924526+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:21.924526+0000","last_undegraded":"2024-06-06T02:34:21.924526+0000","last_fullsized":"2024-06-06T02:34:21.924526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847333+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:34:15.847333+0000","last_peered":"2024-06-06T02:34:15.847333+0000","last_clean":"2024-06-06T02:34:15.847333+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:34:15.847333+0000","last_undegraded":"2024-06-06T02:34:15.847333+0000","last_fullsized":"2024-06-06T02:34:15.847333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":100,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846117+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:34:15.846117+0000","last_peered":"2024-06-06T02:34:15.846117+0000","last_clean":"2024-06-06T02:34:15.846117+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:34:15.846117+0000","last_undegraded":"2024-06-06T02:34:15.846117+0000","last_fullsized":"2024-06-06T02:34:15.846117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945295+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945295+0000","last_peered":"2024-06-06T02:34:24.945295+0000","last_clean":"2024-06-06T02:34:24.945295+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945295+0000","last_undegraded":"2024-06-06T02:34:24.945295+0000","last_fullsized":"2024-06-06T02:34:24.945295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895358+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:34:15.895358+0000","last_peered":"2024-06-06T02:34:15.895358+0000","last_clean":"2024-06-06T02:34:15.895358+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:34:15.895358+0000","last_undegraded":"2024-06-06T02:34:15.895358+0000","last_fullsized":"2024-06-06T02:34:15.895358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916416+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:34:21.916416+0000","last_peered":"2024-06-06T02:34:21.916416+0000","last_clean":"2024-06-06T02:34:21.916416+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:34:21.916416+0000","last_undegraded":"2024-06-06T02:34:21.916416+0000","last_fullsized":"2024-06-06T02:34:21.916416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.839360+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:34:15.839360+0000","last_peered":"2024-06-06T02:34:15.839360+0000","last_clean":"2024-06-06T02:34:15.839360+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:34:15.839360+0000","last_undegraded":"2024-06-06T02:34:15.839360+0000","last_fullsized":"2024-06-06T02:34:15.839360+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":67,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:00.024964+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:35:00.024964+0000","last_peered":"2024-06-06T02:35:00.024964+0000","last_clean":"2024-06-06T02:35:00.024964+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:35:00.024964+0000","last_undegraded":"2024-06-06T02:35:00.024964+0000","last_fullsized":"2024-06-06T02:35:00.024964+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840643+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:34:15.840643+0000","last_peered":"2024-06-06T02:34:15.840643+0000","last_clean":"2024-06-06T02:34:15.840643+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:34:15.840643+0000","last_undegraded":"2024-06-06T02:34:15.840643+0000","last_fullsized":"2024-06-06T02:34:15.840643+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846416+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:15.846416+0000","last_peered":"2024-06-06T02:34:15.846416+0000","last_clean":"2024-06-06T02:34:15.846416+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:15.846416+0000","last_undegraded":"2024-06-06T02:34:15.846416+0000","last_fullsized":"2024-06-06T02:34:15.846416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842766+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:34:15.842766+0000","last_peered":"2024-06-06T02:34:15.842766+0000","last_clean":"2024-06-06T02:34:15.842766+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:34:15.842766+0000","last_undegraded":"2024-06-06T02:34:15.842766+0000","last_fullsized":"2024-06-06T02:34:15.842766+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855581+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855581+0000","last_peered":"2024-06-06T02:34:15.855581+0000","last_clean":"2024-06-06T02:34:15.855581+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855581+0000","last_undegraded":"2024-06-06T02:34:15.855581+0000","last_fullsized":"2024-06-06T02:34:15.855581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.842864+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:34:15.842864+0000","last_peered":"2024-06-06T02:34:15.842864+0000","last_clean":"2024-06-06T02:34:15.842864+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:34:15.842864+0000","last_undegraded":"2024-06-06T02:34:15.842864+0000","last_fullsized":"2024-06-06T02:34:15.842864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907772+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:20.907772+0000","last_peered":"2024-06-06T02:34:20.907772+0000","last_clean":"2024-06-06T02:34:20.907772+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:20.907772+0000","last_undegraded":"2024-06-06T02:34:20.907772+0000","last_fullsized":"2024-06-06T02:34:20.907772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840516+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:34:15.840516+0000","last_peered":"2024-06-06T02:34:15.840516+0000","last_clean":"2024-06-06T02:34:15.840516+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:34:15.840516+0000","last_undegraded":"2024-06-06T02:34:15.840516+0000","last_fullsized":"2024-06-06T02:34:15.840516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:50.645636+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:34:50.645636+0000","last_peered":"2024-06-06T02:34:50.645636+0000","last_clean":"2024-06-06T02:34:50.645636+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:34:50.645636+0000","last_undegraded":"2024-06-06T02:34:50.645636+0000","last_fullsized":"2024-06-06T02:34:50.645636+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895641+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:34:15.895641+0000","last_peered":"2024-06-06T02:34:15.895641+0000","last_clean":"2024-06-06T02:34:15.895641+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:34:15.895641+0000","last_undegraded":"2024-06-06T02:34:15.895641+0000","last_fullsized":"2024-06-06T02:34:15.895641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906706+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.906706+0000","last_peered":"2024-06-06T02:34:20.906706+0000","last_clean":"2024-06-06T02:34:20.906706+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.906706+0000","last_undegraded":"2024-06-06T02:34:20.906706+0000","last_fullsized":"2024-06-06T02:34:20.906706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846978+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:34:15.846978+0000","last_peered":"2024-06-06T02:34:15.846978+0000","last_clean":"2024-06-06T02:34:15.846978+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:34:15.846978+0000","last_undegraded":"2024-06-06T02:34:15.846978+0000","last_fullsized":"2024-06-06T02:34:15.846978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.907814+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.907814+0000","last_peered":"2024-06-06T02:34:20.907814+0000","last_clean":"2024-06-06T02:34:20.907814+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.907814+0000","last_undegraded":"2024-06-06T02:34:20.907814+0000","last_fullsized":"2024-06-06T02:34:20.907814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846689+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:34:15.846689+0000","last_peered":"2024-06-06T02:34:15.846689+0000","last_clean":"2024-06-06T02:34:15.846689+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:34:15.846689+0000","last_undegraded":"2024-06-06T02:34:15.846689+0000","last_fullsized":"2024-06-06T02:34:15.846689+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.913884+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.913884+0000","last_peered":"2024-06-06T02:34:20.913884+0000","last_clean":"2024-06-06T02:34:20.913884+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.913884+0000","last_undegraded":"2024-06-06T02:34:20.913884+0000","last_fullsized":"2024-06-06T02:34:20.913884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.843485+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:34:15.843485+0000","last_peered":"2024-06-06T02:34:15.843485+0000","last_clean":"2024-06-06T02:34:15.843485+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:34:15.843485+0000","last_undegraded":"2024-06-06T02:34:15.843485+0000","last_fullsized":"2024-06-06T02:34:15.843485+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:18.874719+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:18.874719+0000","last_peered":"2024-06-06T02:34:18.874719+0000","last_clean":"2024-06-06T02:34:18.874719+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:18.874719+0000","last_undegraded":"2024-06-06T02:34:18.874719+0000","last_fullsized":"2024-06-06T02:34:18.874719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895785+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:34:15.895785+0000","last_peered":"2024-06-06T02:34:15.895785+0000","last_clean":"2024-06-06T02:34:15.895785+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:34:15.895785+0000","last_undegraded":"2024-06-06T02:34:15.895785+0000","last_fullsized":"2024-06-06T02:34:15.895785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905135+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:20.905135+0000","last_peered":"2024-06-06T02:34:20.905135+0000","last_clean":"2024-06-06T02:34:20.905135+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:20.905135+0000","last_undegraded":"2024-06-06T02:34:20.905135+0000","last_fullsized":"2024-06-06T02:34:20.905135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846148+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:34:15.846148+0000","last_peered":"2024-06-06T02:34:15.846148+0000","last_clean":"2024-06-06T02:34:15.846148+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:34:15.846148+0000","last_undegraded":"2024-06-06T02:34:15.846148+0000","last_fullsized":"2024-06-06T02:34:15.846148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.840592+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:34:15.840592+0000","last_peered":"2024-06-06T02:34:15.840592+0000","last_clean":"2024-06-06T02:34:15.840592+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:34:15.840592+0000","last_undegraded":"2024-06-06T02:34:15.840592+0000","last_fullsized":"2024-06-06T02:34:15.840592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846967+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.846967+0000","last_peered":"2024-06-06T02:34:15.846967+0000","last_clean":"2024-06-06T02:34:15.846967+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.846967+0000","last_undegraded":"2024-06-06T02:34:15.846967+0000","last_fullsized":"2024-06-06T02:34:15.846967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846380+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:34:15.846380+0000","last_peered":"2024-06-06T02:34:15.846380+0000","last_clean":"2024-06-06T02:34:15.846380+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:34:15.846380+0000","last_undegraded":"2024-06-06T02:34:15.846380+0000","last_fullsized":"2024-06-06T02:34:15.846380+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916923+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.916923+0000","last_peered":"2024-06-06T02:34:21.916923+0000","last_clean":"2024-06-06T02:34:21.916923+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.916923+0000","last_undegraded":"2024-06-06T02:34:21.916923+0000","last_fullsized":"2024-06-06T02:34:21.916923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847629+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:34:15.847629+0000","last_peered":"2024-06-06T02:34:15.847629+0000","last_clean":"2024-06-06T02:34:15.847629+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:34:15.847629+0000","last_undegraded":"2024-06-06T02:34:15.847629+0000","last_fullsized":"2024-06-06T02:34:15.847629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.896368+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:34:15.896368+0000","last_peered":"2024-06-06T02:34:15.896368+0000","last_clean":"2024-06-06T02:34:15.896368+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:34:15.896368+0000","last_undegraded":"2024-06-06T02:34:15.896368+0000","last_fullsized":"2024-06-06T02:34:15.896368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.895735+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:34:15.895735+0000","last_peered":"2024-06-06T02:34:15.895735+0000","last_clean":"2024-06-06T02:34:15.895735+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:34:15.895735+0000","last_undegraded":"2024-06-06T02:34:15.895735+0000","last_fullsized":"2024-06-06T02:34:15.895735+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925206+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:21.925206+0000","last_peered":"2024-06-06T02:34:21.925206+0000","last_clean":"2024-06-06T02:34:21.925206+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:21.925206+0000","last_undegraded":"2024-06-06T02:34:21.925206+0000","last_fullsized":"2024-06-06T02:34:21.925206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66682,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":244,"num_read_kb":191,"num_write":165,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":200046,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710746,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1079762,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266731,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1016904,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986240,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":488343,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":487699,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63072,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63716,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64650,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:35:03.882 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T02:35:03.883 INFO:tasks.cephadm:Setting up client nodes... 2024-06-06T02:35:03.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-06T02:35:04.356 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:04 smithi184 ceph-mon[36922]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T02:35:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:04 smithi184 ceph-mon[36922]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:04.669 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:04 smithi103 ceph-mon[36349]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T02:35:04.669 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:04 smithi103 ceph-mon[36349]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:04.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:04 smithi082 ceph-mon[31579]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-06-06T02:35:04.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:04 smithi082 ceph-mon[31579]: from='client.24820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:35:06.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:06 smithi082 ceph-mon[31579]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:35:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:06 smithi184 ceph-mon[36922]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:35:06.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 -- 172.21.15.82:0/4256216370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 msgr2=0x7f48cc1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 --2- 172.21.15.82:0/4256216370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc1063c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009900 tx=0x7f48b402a410 comp rx=0 tx=0).stop 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 -- 172.21.15.82:0/4256216370 shutdown_connections 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 --2- 172.21.15.82:0/4256216370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc106900 0x7f48cc10d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 --2- 172.21.15.82:0/4256216370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc1063c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 --2- 172.21.15.82:0/4256216370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc104e80 0x7f48cc105290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 -- 172.21.15.82:0/4256216370 >> 172.21.15.82:0/4256216370 conn(0x7f48cc1006b0 msgr2=0x7f48cc102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 -- 172.21.15.82:0/4256216370 shutdown_connections 2024-06-06T02:35:06.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.843+0000 7f48d1800640 1 -- 172.21.15.82:0/4256216370 wait complete. 2024-06-06T02:35:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.844+0000 7f48d1800640 1 Processor -- start 2024-06-06T02:35:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.844+0000 7f48d1800640 1 -- start start 2024-06-06T02:35:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:06.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc106900 0x7f48cc1a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc1109a0 con 0x7f48cc105fb0 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc110820 con 0x7f48cc104e80 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48d1800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48cc110b20 con 0x7f48cc106900 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55924/0 (socket says 172.21.15.82:55924) 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48caa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60226/0 (socket says 172.21.15.82:60226) 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48c3e00640 1 -- 172.21.15.82:0/1449657467 learned_addr learned my addr 172.21.15.82:0/1449657467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:06.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.845+0000 7f48cb400640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc106900 0x7f48cc1a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:06.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 -- 172.21.15.82:0/1449657467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc106900 msgr2=0x7f48cc1a2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:06.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc106900 0x7f48cc1a2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 -- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 msgr2=0x7f48cc19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 -- 172.21.15.82:0/1449657467 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48cc1a30a0 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48caa00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00e9c0 tx=0x7f48bc00edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00ccc0 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48bc005020 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00ce60 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.846+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48cc1a3390 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.847+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48cc1a3880 con 0x7f48cc104e80 2024-06-06T02:35:06.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.848+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48cc10c080 con 0x7f48cc104e80 2024-06-06T02:35:06.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.850+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f48bc0051d0 con 0x7f48cc104e80 2024-06-06T02:35:06.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.852+0000 7f48c3400640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 0x7f48b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:06.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.852+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48bc0e2520 con 0x7f48cc104e80 2024-06-06T02:35:06.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.852+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 0x7f48b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:06.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.853+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 0x7f48b00b4d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48b4031440 tx=0x7f48b40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:06.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:06.853+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f48bc053df0 con 0x7f48cc104e80 2024-06-06T02:35:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:06 smithi103 ceph-mon[36349]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:35:07.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.136+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f48cc02dd00 con 0x7f48cc104e80 2024-06-06T02:35:07.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.144+0000 7f48c3400640 1 -- 172.21.15.82:0/1449657467 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f48bc0aa0a0 con 0x7f48cc104e80 2024-06-06T02:35:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-06-06T02:35:07.144 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBbIGFmtI05CBAA6iWCTmqmyvjOY0J7g6eWDA== 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 msgr2=0x7f48b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 0x7f48b00b4d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48b4031440 tx=0x7f48b40314a0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 msgr2=0x7f48cc19b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00e9c0 tx=0x7f48bc00edc0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 shutdown_connections 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48b00b2880 0x7f48b00b4d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48cc106900 0x7f48cc1a2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48cc105fb0 0x7f48cc19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.147+0000 7f48d1800640 1 --2- 172.21.15.82:0/1449657467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48cc104e80 0x7f48cc19b580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.148+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 >> 172.21.15.82:0/1449657467 conn(0x7f48cc1006b0 msgr2=0x7f48cc109250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.148+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 shutdown_connections 2024-06-06T02:35:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:07.148+0000 7f48d1800640 1 -- 172.21.15.82:0/1449657467 wait complete. 2024-06-06T02:35:07.518 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:07 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1449657467' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.518 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:07 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.518 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:07 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T02:35:07.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:07 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1449657467' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:07 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:07 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T02:35:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:07 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1449657467' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:07 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-06T02:35:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:07 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-06T02:35:07.947 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:35:07.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-06T02:35:07.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-06T02:35:08.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph config log 1 --format=json 2024-06-06T02:35:08.563 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:08.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:08 smithi082 ceph-mon[31579]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:08 smithi103 ceph-mon[36349]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:08.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:08 smithi184 ceph-mon[36922]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:10.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:10 smithi082 ceph-mon[31579]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T02:35:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:10 smithi103 ceph-mon[36349]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T02:35:10.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:10 smithi184 ceph-mon[36922]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 -- 172.21.15.82:0/387450754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6288102380 msgr2=0x7f628810f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 --2- 172.21.15.82:0/387450754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6288102380 0x7f628810f010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6278009900 tx=0x7f627802a400 comp rx=0 tx=0).stop 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 -- 172.21.15.82:0/387450754 shutdown_connections 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 --2- 172.21.15.82:0/387450754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f628810f550 0x7f6288111970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 --2- 172.21.15.82:0/387450754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6288102380 0x7f628810f010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:10.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 --2- 172.21.15.82:0/387450754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 0x7f6288101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 -- 172.21.15.82:0/387450754 >> 172.21.15.82:0/387450754 conn(0x7f6288078a90 msgr2=0x7f6288078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 -- 172.21.15.82:0/387450754 shutdown_connections 2024-06-06T02:35:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.988+0000 7f6290800640 1 -- 172.21.15.82:0/387450754 wait complete. 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 Processor -- start 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 -- start start 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 0x7f62881a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6288102380 0x7f62881a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6288115030 con 0x7f628810f550 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6288114eb0 con 0x7f6288102380 2024-06-06T02:35:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.990+0000 7f6290800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f62881151b0 con 0x7f62881019a0 2024-06-06T02:35:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55954/0 (socket says 172.21.15.82:55954) 2024-06-06T02:35:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 -- 172.21.15.82:0/2646567550 learned_addr learned my addr 172.21.15.82:0/2646567550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628d400640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6288102380 0x7f62881a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628de00640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 0x7f62881a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 -- 172.21.15.82:0/2646567550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 msgr2=0x7f62881a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 0x7f62881a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 -- 172.21.15.82:0/2646567550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6288102380 msgr2=0x7f62881a1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6288102380 0x7f62881a1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 -- 172.21.15.82:0/2646567550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628819bf50 con 0x7f628810f550 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.991+0000 7f628e800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f628400eb10 tx=0x7f628400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.992+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284004b20 con 0x7f628810f550 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.992+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628819c240 con 0x7f628810f550 2024-06-06T02:35:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.992+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6284004cc0 con 0x7f628810f550 2024-06-06T02:35:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.992+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284010670 con 0x7f628810f550 2024-06-06T02:35:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.992+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a8550 con 0x7f628810f550 2024-06-06T02:35:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.993+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6288101db0 con 0x7f628810f550 2024-06-06T02:35:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.996+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6284005000 con 0x7f628810f550 2024-06-06T02:35:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.998+0000 7f6282a00640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 0x7f62700b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.998+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f62840e2a90 con 0x7f628810f550 2024-06-06T02:35:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.998+0000 7f628de00640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 0x7f62700b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:10.999+0000 7f628de00640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 0x7f62700b4e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f628819ca20 tx=0x7f627c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.000+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6284054df0 con 0x7f628810f550 2024-06-06T02:35:11.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.211+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f628819ce10 con 0x7f628810f550 2024-06-06T02:35:11.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.212+0000 7f6282a00640 1 -- 172.21.15.82:0/2646567550 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7f628819ce10 con 0x7f628810f550 2024-06-06T02:35:11.212 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:35:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 msgr2=0x7f62700b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 0x7f62700b4e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f628819ca20 tx=0x7f627c00b410 comp rx=0 tx=0).stop 2024-06-06T02:35:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 msgr2=0x7f628819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f628400eb10 tx=0x7f628400c2d0 comp rx=0 tx=0).stop 2024-06-06T02:35:11.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 shutdown_connections 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f628810f550 0x7f628819b8e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6288102380 0x7f62881a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f62700b2900 0x7f62700b4e10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 --2- 172.21.15.82:0/2646567550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62881019a0 0x7f62881a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 >> 172.21.15.82:0/2646567550 conn(0x7f6288078a90 msgr2=0x7f6288110aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.215+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 shutdown_connections 2024-06-06T02:35:11.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:11.216+0000 7f6290800640 1 -- 172.21.15.82:0/2646567550 wait complete. 2024-06-06T02:35:11.600 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2646567550' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-06-06T02:35:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2646567550' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-06-06T02:35:11.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2646567550' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-06-06T02:35:12.086 INFO:teuthology.orchestra.run.smithi082.stdout:[{"version":50,"timestamp":"2024-06-06T02:33:45.657595+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-06-06T02:35:12.087 INFO:tasks.ceph_manager:config epoch is 50 2024-06-06T02:35:12.087 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-06T02:35:12.087 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-06T02:35:12.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-06T02:35:12.533 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:12.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:12 smithi082 ceph-mon[31579]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:12 smithi103 ceph-mon[36349]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:12.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:12 smithi184 ceph-mon[36922]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-06-06T02:35:14.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:14 smithi082 ceph-mon[31579]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T02:35:14.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:14 smithi103 ceph-mon[36349]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T02:35:14.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 -- 172.21.15.82:0/3740204922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c103bc0 msgr2=0x7f035c103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:14.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 --2- 172.21.15.82:0/3740204922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c103bc0 0x7f035c103fd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f034c009900 tx=0x7f034c02a400 comp rx=0 tx=0).stop 2024-06-06T02:35:14.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 -- 172.21.15.82:0/3740204922 shutdown_connections 2024-06-06T02:35:14.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 --2- 172.21.15.82:0/3740204922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c10d020 0x7f035c10f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:14.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 --2- 172.21.15.82:0/3740204922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 0x7f035c10ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:14.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 --2- 172.21.15.82:0/3740204922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c103bc0 0x7f035c103fd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:14.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 -- 172.21.15.82:0/3740204922 >> 172.21.15.82:0/3740204922 conn(0x7f035c0fd6a0 msgr2=0x7f035c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:14.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 -- 172.21.15.82:0/3740204922 shutdown_connections 2024-06-06T02:35:14.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.874+0000 7f035be00640 1 -- 172.21.15.82:0/3740204922 wait complete. 2024-06-06T02:35:14.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.875+0000 7f035be00640 1 Processor -- start 2024-06-06T02:35:14.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.875+0000 7f035be00640 1 -- start start 2024-06-06T02:35:14.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:14.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 0x7f035c1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:14.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c10d020 0x7f035c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f035c112c80 con 0x7f035c10d020 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f035c112b00 con 0x7f035c103bc0 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f035c112e00 con 0x7f035c104510 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c10d020 0x7f035c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 0x7f035c1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47878/0 (socket says 172.21.15.82:47878) 2024-06-06T02:35:14.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.876+0000 7f035aa00640 1 -- 172.21.15.82:0/2401781246 learned_addr learned my addr 172.21.15.82:0/2401781246 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 -- 172.21.15.82:0/2401781246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 msgr2=0x7f035c1a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 0x7f035c1a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 -- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c10d020 msgr2=0x7f035c19b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c10d020 0x7f035c19b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 -- 172.21.15.82:0/2401781246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c19be40 con 0x7f035c103bc0 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035aa00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f034c005940 tx=0x7f034c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c03f030 con 0x7f035c103bc0 2024-06-06T02:35:14.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c19c0d0 con 0x7f035c103bc0 2024-06-06T02:35:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f034c003aa0 con 0x7f035c103bc0 2024-06-06T02:35:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.877+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034c035070 con 0x7f035c103bc0 2024-06-06T02:35:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.878+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c1a8330 con 0x7f035c103bc0 2024-06-06T02:35:14.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.879+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035c06b8f0 con 0x7f035c103bc0 2024-06-06T02:35:14.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.881+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f034c042030 con 0x7f035c103bc0 2024-06-06T02:35:14.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.882+0000 7f0360a00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 0x7f03400b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:14.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.883+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f034c102c90 con 0x7f035c103bc0 2024-06-06T02:35:14.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.883+0000 7f035a000640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 0x7f03400b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:14.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.884+0000 7f035a000640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 0x7f03400b4e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03480095f0 tx=0x7f0348005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:14.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:14.884+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f034c0ca1c0 con 0x7f035c103bc0 2024-06-06T02:35:14.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:14 smithi184 ceph-mon[36922]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-06-06T02:35:15.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.139+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f035c103fd0 con 0x7f035c103bc0 2024-06-06T02:35:15.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.145+0000 7f0360a00640 1 -- 172.21.15.82:0/2401781246 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288644 (secure 0 0 0) 0x7f035c103fd0 con 0x7f035c103bc0 2024-06-06T02:35:15.149 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:35:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 msgr2=0x7f03400b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 0x7f03400b4e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f03480095f0 tx=0x7f0348005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 msgr2=0x7f035c1a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f034c005940 tx=0x7f034c004270 comp rx=0 tx=0).stop 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 shutdown_connections 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035c10d020 0x7f035c19b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03400b2900 0x7f03400b4e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f035c104510 0x7f035c1a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 --2- 172.21.15.82:0/2401781246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f035c103bc0 0x7f035c1a1580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 >> 172.21.15.82:0/2401781246 conn(0x7f035c0fd6a0 msgr2=0x7f035c101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 shutdown_connections 2024-06-06T02:35:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:15.150+0000 7f035be00640 1 -- 172.21.15.82:0/2401781246 wait complete. 2024-06-06T02:35:15.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:15 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2401781246' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T02:35:15.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:15 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2401781246' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T02:35:15.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:15 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2401781246' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-06T02:35:15.993 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":664220961},{"type":"v1","addr":"172.21.15.82:6801","nonce":664220961}]},"active_addr":"172.21.15.82:6801/664220961","active_change":"2024-06-06T02:25:14.582326+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2468762628}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2356205372}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2135326991}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3546514714}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3573927841}]}]} 2024-06-06T02:35:15.999 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-06T02:35:15.999 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-06T02:35:15.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:35:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:16.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:16 smithi082 ceph-mon[31579]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-06-06T02:35:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:16 smithi103 ceph-mon[36349]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-06-06T02:35:16.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:16 smithi184 ceph-mon[36922]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 -- 172.21.15.82:0/2633697268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4104f30 msgr2=0x7f86e4105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 --2- 172.21.15.82:0/2633697268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4104f30 0x7f86e4105340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009930 tx=0x7f86cc02a440 comp rx=0 tx=0).stop 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 -- 172.21.15.82:0/2633697268 shutdown_connections 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 --2- 172.21.15.82:0/2633697268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 0x7f86e4111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 --2- 172.21.15.82:0/2633697268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4109860 0x7f86e4109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 --2- 172.21.15.82:0/2633697268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4104f30 0x7f86e4105340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 -- 172.21.15.82:0/2633697268 >> 172.21.15.82:0/2633697268 conn(0x7f86e4100990 msgr2=0x7f86e4102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:18.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 -- 172.21.15.82:0/2633697268 shutdown_connections 2024-06-06T02:35:18.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:18 smithi082 ceph-mon[31579]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.711+0000 7f86e3200640 1 -- 172.21.15.82:0/2633697268 wait complete. 2024-06-06T02:35:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.713+0000 7f86e3200640 1 Processor -- start 2024-06-06T02:35:18.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.713+0000 7f86e3200640 1 -- start start 2024-06-06T02:35:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 0x7f86e41a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 0x7f86e41a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 0x7f86e419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4114ec0 con 0x7f86e4104f30 2024-06-06T02:35:18.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4114d40 con 0x7f86e4109860 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e3200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4115040 con 0x7f86e410a1b0 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 0x7f86e41a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 0x7f86e41a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54344/0 (socket says 172.21.15.82:54344) 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 0x7f86e41a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e1e00640 1 -- 172.21.15.82:0/3187945514 learned_addr learned my addr 172.21.15.82:0/3187945514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:18.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.714+0000 7f86e2800640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 0x7f86e419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 -- 172.21.15.82:0/3187945514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 msgr2=0x7f86e419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 0x7f86e419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 -- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 msgr2=0x7f86e41a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 0x7f86e41a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 -- 172.21.15.82:0/3187945514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e419bf20 con 0x7f86e4109860 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86dbe00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 0x7f86e41a1bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86e406bce0 tx=0x7f86d400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d400cc40 con 0x7f86e4109860 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86d400cde0 con 0x7f86e4109860 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.715+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d40187a0 con 0x7f86e4109860 2024-06-06T02:35:18.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.716+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e419c210 con 0x7f86e4109860 2024-06-06T02:35:18.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.716+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e41a8520 con 0x7f86e4109860 2024-06-06T02:35:18.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.717+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e41063e0 con 0x7f86e4109860 2024-06-06T02:35:18.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.719+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f86d4010a70 con 0x7f86e4109860 2024-06-06T02:35:18.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.721+0000 7f86daa00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 0x7f86c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:18.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.721+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f86d40e2690 con 0x7f86e4109860 2024-06-06T02:35:18.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.721+0000 7f86e1e00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 0x7f86c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:18.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.722+0000 7f86e1e00640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 0x7f86c40b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c00 tx=0x7f86cc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:18.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.722+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f86d40a9bc0 con 0x7f86e4109860 2024-06-06T02:35:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:18 smithi103 ceph-mon[36349]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:18.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:18 smithi184 ceph-mon[36922]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.932+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86e4105340 con 0x7f86e4109860 2024-06-06T02:35:18.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.934+0000 7f86daa00640 1 -- 172.21.15.82:0/3187945514 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7f86d40b2290 con 0x7f86e4109860 2024-06-06T02:35:18.933 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:35:18.934 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:35:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 msgr2=0x7f86c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 0x7f86c40b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86cc000c00 tx=0x7f86cc009560 comp rx=0 tx=0).stop 2024-06-06T02:35:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 msgr2=0x7f86e41a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 0x7f86e41a1bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f86e406bce0 tx=0x7f86d400ee50 comp rx=0 tx=0).stop 2024-06-06T02:35:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 shutdown_connections 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f86c40b2880 0x7f86c40b4d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f86e410a1b0 0x7f86e419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86e4109860 0x7f86e41a1bd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 --2- 172.21.15.82:0/3187945514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e4104f30 0x7f86e41a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 >> 172.21.15.82:0/3187945514 conn(0x7f86e4100990 msgr2=0x7f86e41011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 shutdown_connections 2024-06-06T02:35:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:18.937+0000 7f86e3200640 1 -- 172.21.15.82:0/3187945514 wait complete. 2024-06-06T02:35:19.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:19 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3187945514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:19.783 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-06T02:35:19.783 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:35:19.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:19 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3187945514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:19.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:19 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3187945514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:20.225 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:20.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:20 smithi082 ceph-mon[31579]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:20 smithi103 ceph-mon[36349]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:20 smithi184 ceph-mon[36922]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 -- 172.21.15.82:0/1112676626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe774113b10 msgr2=0x7fe774115f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 --2- 172.21.15.82:0/1112676626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe774113b10 0x7fe774115f30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009be0 tx=0x7fe76c02a6c0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 -- 172.21.15.82:0/1112676626 shutdown_connections 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 --2- 172.21.15.82:0/1112676626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe774113b10 0x7fe774115f30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 --2- 172.21.15.82:0/1112676626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740775e0 0x7fe7741135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 --2- 172.21.15.82:0/1112676626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774076c90 0x7fe7740770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 -- 172.21.15.82:0/1112676626 >> 172.21.15.82:0/1112676626 conn(0x7fe774100b60 msgr2=0x7fe774102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 -- 172.21.15.82:0/1112676626 shutdown_connections 2024-06-06T02:35:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.541+0000 7fe77c000640 1 -- 172.21.15.82:0/1112676626 wait complete. 2024-06-06T02:35:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.542+0000 7fe77c000640 1 Processor -- start 2024-06-06T02:35:22.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.542+0000 7fe77c000640 1 -- start start 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 0x7fe7741a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 0x7fe7741a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741194c0 con 0x7fe774113b10 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe774119340 con 0x7fe7740775e0 2024-06-06T02:35:22.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe77c000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe774119640 con 0x7fe774076c90 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe778c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 0x7fe7741a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe779600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe779600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39256/0 (socket says 172.21.15.82:39256) 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe778c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 0x7fe7741a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:36782/0 (socket says 172.21.15.82:36782) 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.543+0000 7fe779600640 1 -- 172.21.15.82:0/2096807001 learned_addr learned my addr 172.21.15.82:0/2096807001 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe77a000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 0x7fe7741a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 -- 172.21.15.82:0/2096807001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 msgr2=0x7fe7741a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 0x7fe7741a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 -- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 msgr2=0x7fe7741a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:22.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 0x7fe7741a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 -- 172.21.15.82:0/2096807001 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7741a4cf0 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe77a000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 0x7fe7741a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe779600640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.544+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76400ccc0 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.545+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe76400ce60 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.545+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7741a4fe0 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.545+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764010430 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.545+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7741ac960 con 0x7fe774076c90 2024-06-06T02:35:22.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.546+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7740770a0 con 0x7fe774076c90 2024-06-06T02:35:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.548+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe7640046c0 con 0x7fe774076c90 2024-06-06T02:35:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.550+0000 7fe772000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 0x7fe75c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.550+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe7640e2620 con 0x7fe774076c90 2024-06-06T02:35:22.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.550+0000 7fe778c00640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 0x7fe75c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.551+0000 7fe778c00640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 0x7fe75c0b4e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7741041d0 tx=0x7fe768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:22.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.552+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7640aa1a0 con 0x7fe774076c90 2024-06-06T02:35:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:22 smithi082 ceph-mon[31579]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.757+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7741a11e0 con 0x7fe774076c90 2024-06-06T02:35:22.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.759+0000 7fe772000640 1 -- 172.21.15.82:0/2096807001 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fe7640a9aa0 con 0x7fe774076c90 2024-06-06T02:35:22.760 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:35:22.760 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:35:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 msgr2=0x7fe75c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 0x7fe75c0b4e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe7741041d0 tx=0x7fe768005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 msgr2=0x7fe77419fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9f0 tx=0x7fe76400eeb0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 shutdown_connections 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe774113b10 0x7fe7741a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7740775e0 0x7fe7741a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe75c0b2900 0x7fe75c0b4e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 --2- 172.21.15.82:0/2096807001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe774076c90 0x7fe77419fe80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 >> 172.21.15.82:0/2096807001 conn(0x7fe774100b60 msgr2=0x7fe774102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 shutdown_connections 2024-06-06T02:35:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:22.762+0000 7fe77c000640 1 -- 172.21.15.82:0/2096807001 wait complete. 2024-06-06T02:35:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:22 smithi103 ceph-mon[36349]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:22.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:22 smithi184 ceph-mon[36922]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:23.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-06T02:35:23.661 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-06T02:35:23.661 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-06T02:35:23.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-06T02:35:23.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-06T02:35:23.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-06T02:35:23.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-06T02:35:23.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-06T02:35:23.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-06T02:35:23.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-06T02:35:23.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-06T02:35:23.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-06T02:35:23.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:23 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2096807001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:23.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:23 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2096807001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:23.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:23 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2096807001' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:35:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.764 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.852 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.856 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:24 smithi103 ceph-mon[36349]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:24 smithi082 ceph-mon[31579]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:24.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:24 smithi184 ceph-mon[36922]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:26.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:26 smithi082 ceph-mon[31579]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:26 smithi103 ceph-mon[36349]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:26.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:26 smithi184 ceph-mon[36922]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:28.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:28 smithi082 ceph-mon[31579]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:28 smithi103 ceph-mon[36349]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:28.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:28 smithi184 ceph-mon[36922]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:30.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:30 smithi082 ceph-mon[31579]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:30 smithi103 ceph-mon[36349]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:30 smithi184 ceph-mon[36922]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:32.195 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:32 smithi103 ceph-mon[36349]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:32 smithi082 ceph-mon[31579]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:32 smithi184 ceph-mon[36922]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:34.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:34 smithi082 ceph-mon[31579]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:34 smithi103 ceph-mon[36349]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:34.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:34 smithi184 ceph-mon[36922]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 -- 172.21.15.82:0/1472798981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc010102aa0 msgr2=0x7fc010102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1472798981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc010102aa0 0x7fc010102eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009930 tx=0x7fbff802a420 comp rx=0 tx=0).stop 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 -- 172.21.15.82:0/1472798981 shutdown_connections 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1472798981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0101033f0 0x7fc01010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1472798981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc010102aa0 0x7fc010102eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1472798981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc010108ad0 0x7fc010108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 -- 172.21.15.82:0/1472798981 >> 172.21.15.82:0/1472798981 conn(0x7fc0100fe790 msgr2=0x7fc010100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 -- 172.21.15.82:0/1472798981 shutdown_connections 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.477+0000 7fc00fe00640 1 -- 172.21.15.82:0/1472798981 wait complete. 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.478+0000 7fc00fe00640 1 Processor -- start 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.478+0000 7fc00fe00640 1 -- start start 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 0x7fc0101a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0101033f0 0x7fc0101a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc010108ad0 0x7fc01019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112ce0 con 0x7fc010102aa0 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112b60 con 0x7fc010108ad0 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00fe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112e60 con 0x7fc0101033f0 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 0x7fc0101a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:34.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 0x7fc0101a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59660/0 (socket says 172.21.15.82:59660) 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 -- 172.21.15.82:0/1694353883 learned_addr learned my addr 172.21.15.82:0/1694353883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc007e00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0101033f0 0x7fc0101a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00f400640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc010108ad0 0x7fc01019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 -- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0101033f0 msgr2=0x7fc0101a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0101033f0 0x7fc0101a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 -- 172.21.15.82:0/1694353883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc010108ad0 msgr2=0x7fc01019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.479+0000 7fc00ea00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc010108ad0 0x7fc01019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc00ea00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01019bf10 con 0x7fc010102aa0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc00ea00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 0x7fc0101a1690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc00000e9c0 tx=0x7fc00000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00000ccc0 con 0x7fc010102aa0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0000035f0 con 0x7fc010102aa0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00000ce60 con 0x7fc010102aa0 2024-06-06T02:35:34.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01019c200 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.480+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0101a8490 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.481+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc010108030 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.484+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc000004000 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.485+0000 7fc014a00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbff40b2880 0x7fbff40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc0000e2c50 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc007e00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbff40b2880 0x7fbff40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc014a00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] conn(0x7fbff40bc500 0x7fbff40be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc00000ae50 con 0x7fbff40bc500 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc0000e3000 con 0x7fc010102aa0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.486+0000 7fc00f400640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] conn(0x7fbff40bc500 0x7fbff40be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.487+0000 7fc007e00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbff40b2880 0x7fbff40b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbff8031440 tx=0x7fbff8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:34.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.487+0000 7fc00f400640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] conn(0x7fbff40bc500 0x7fbff40be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.488+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== osd.5 v2:172.21.15.184:6808/3267310596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc00000ae50 con 0x7fbff40bc500 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.508+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 --> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0101041e0 con 0x7fbff40bc500 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc014a00640 1 -- 172.21.15.82:0/1694353883 <== osd.5 v2:172.21.15.184:6808/3267310596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0101041e0 con 0x7fbff40bc500 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] conn(0x7fbff40bc500 msgr2=0x7fbff40be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] conn(0x7fbff40bc500 0x7fbff40be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbff40b2880 msgr2=0x7fbff40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbff40b2880 0x7fbff40b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbff8031440 tx=0x7fbff8000bc0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 msgr2=0x7fc0101a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 --2- 172.21.15.82:0/1694353883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc010102aa0 0x7fc0101a1690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc00000e9c0 tx=0x7fc00000edc0 comp rx=0 tx=0).stop 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00f400640 1 -- 172.21.15.82:0/1694353883 reap_dead start 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 shutdown_connections 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.509+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 >> 172.21.15.82:0/1694353883 conn(0x7fc0100fe790 msgr2=0x7fc01010f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.510+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 shutdown_connections 2024-06-06T02:35:34.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:34.510+0000 7fc00fe00640 1 -- 172.21.15.82:0/1694353883 wait complete. 2024-06-06T02:35:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.032+0000 7fa795a00640 1 -- 172.21.15.82:0/395434871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 msgr2=0x7fa790107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.032+0000 7fa795a00640 1 --2- 172.21.15.82:0/395434871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 0x7fa790107c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa778009930 tx=0x7fa77802a420 comp rx=0 tx=0).stop 2024-06-06T02:35:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 -- 172.21.15.82:0/395434871 shutdown_connections 2024-06-06T02:35:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 --2- 172.21.15.82:0/395434871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa790108170 0x7fa79010fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 --2- 172.21.15.82:0/395434871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 0x7fa790107c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 --2- 172.21.15.82:0/395434871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa790103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 -- 172.21.15.82:0/395434871 >> 172.21.15.82:0/395434871 conn(0x7fa790079d40 msgr2=0x7fa79007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 -- 172.21.15.82:0/395434871 shutdown_connections 2024-06-06T02:35:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.033+0000 7fa795a00640 1 -- 172.21.15.82:0/395434871 wait complete. 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.034+0000 7fa795a00640 1 Processor -- start 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.034+0000 7fa795a00640 1 -- start start 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa7901a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 0x7fa7901a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa790108170 0x7fa79019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa790112eb0 con 0x7fa790108170 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa790112d30 con 0x7fa790102ef0 2024-06-06T02:35:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa795a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa790113030 con 0x7fa790107820 2024-06-06T02:35:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa7901a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa790108170 0x7fa79019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa7901a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41984/0 (socket says 172.21.15.82:41984) 2024-06-06T02:35:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 -- 172.21.15.82:0/1139523320 learned_addr learned my addr 172.21.15.82:0/1139523320 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78e000640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 0x7fa7901a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 -- 172.21.15.82:0/1139523320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 msgr2=0x7fa7901a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa790107820 0x7fa7901a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.035+0000 7fa78ea00640 1 -- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa790108170 msgr2=0x7fa79019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa78ea00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa790108170 0x7fa79019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa78ea00640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79019bf90 con 0x7fa790102ef0 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa78ea00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa7901a1700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa78000e9f0 tx=0x7fa78000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78000cd80 con 0x7fa790102ef0 2024-06-06T02:35:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7800108e0 con 0x7fa790102ef0 2024-06-06T02:35:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79019c280 con 0x7fa790102ef0 2024-06-06T02:35:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780018980 con 0x7fa790102ef0 2024-06-06T02:35:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.036+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901a8590 con 0x7fa790102ef0 2024-06-06T02:35:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.037+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa790106060 con 0x7fa790102ef0 2024-06-06T02:35:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.040+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa780010430 con 0x7fa790102ef0 2024-06-06T02:35:36.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa787400640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa7740b2880 0x7fa7740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa7800e2e00 con 0x7fa790102ef0 2024-06-06T02:35:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa78e000640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa7740b2880 0x7fa7740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa787400640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] conn(0x7fa7740bc500 0x7fa7740be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7740bf0c0 con 0x7fa7740bc500 2024-06-06T02:35:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.042+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fa7800e31f0 con 0x7fa790102ef0 2024-06-06T02:35:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.043+0000 7fa78f400640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] conn(0x7fa7740bc500 0x7fa7740be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.043+0000 7fa78e000640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa7740b2880 0x7fa7740b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa778009900 tx=0x7fa778005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:36.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.043+0000 7fa78f400640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] conn(0x7fa7740bc500 0x7fa7740be9f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:36.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.044+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== osd.4 v2:172.21.15.103:6808/3776177074 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7740bf0c0 con 0x7fa7740bc500 2024-06-06T02:35:36.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.062+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 --> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7901043a0 con 0x7fa7740bc500 2024-06-06T02:35:36.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.063+0000 7fa787400640 1 -- 172.21.15.82:0/1139523320 <== osd.4 v2:172.21.15.103:6808/3776177074 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa7901043a0 con 0x7fa7740bc500 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.063+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] conn(0x7fa7740bc500 msgr2=0x7fa7740be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.063+0000 7fa795a00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] conn(0x7fa7740bc500 0x7fa7740be9f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa7740b2880 msgr2=0x7fa7740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa7740b2880 0x7fa7740b4d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa778009900 tx=0x7fa778005a20 comp rx=0 tx=0).stop 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 msgr2=0x7fa7901a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 --2- 172.21.15.82:0/1139523320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa790102ef0 0x7fa7901a1700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa78000e9f0 tx=0x7fa78000eeb0 comp rx=0 tx=0).stop 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa78f400640 1 -- 172.21.15.82:0/1139523320 reap_dead start 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 shutdown_connections 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 >> 172.21.15.82:0/1139523320 conn(0x7fa790079d40 msgr2=0x7fa790105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 shutdown_connections 2024-06-06T02:35:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:36.064+0000 7fa795a00640 1 -- 172.21.15.82:0/1139523320 wait complete. 2024-06-06T02:35:36.842 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:36 smithi082 ceph-mon[31579]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:36 smithi103 ceph-mon[36349]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:36 smithi184 ceph-mon[36922]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:38.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 -- 172.21.15.82:0/3011136816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814109310 msgr2=0x7fb814109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 --2- 172.21.15.82:0/3011136816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814109310 0x7fb814109720 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb808009960 tx=0x7fb80802a460 comp rx=0 tx=0).stop 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 -- 172.21.15.82:0/3011136816 shutdown_connections 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 --2- 172.21.15.82:0/3011136816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb81410e590 0x7fb814115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 --2- 172.21.15.82:0/3011136816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81410dc40 0x7fb81410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 --2- 172.21.15.82:0/3011136816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814109310 0x7fb814109720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 -- 172.21.15.82:0/3011136816 >> 172.21.15.82:0/3011136816 conn(0x7fb814078a80 msgr2=0x7fb814107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 -- 172.21.15.82:0/3011136816 shutdown_connections 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.167+0000 7fb81a800640 1 -- 172.21.15.82:0/3011136816 wait complete. 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.168+0000 7fb81a800640 1 Processor -- start 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.168+0000 7fb81a800640 1 -- start start 2024-06-06T02:35:38.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb814109310 0x7fb81419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81410dc40 0x7fb8141a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 0x7fb8141a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141192d0 con 0x7fb81410e590 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb814119150 con 0x7fb814109310 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb81a800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb814119450 con 0x7fb81410dc40 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 0x7fb8141a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 0x7fb8141a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59702/0 (socket says 172.21.15.82:59702) 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb814109310 0x7fb81419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 -- 172.21.15.82:0/3731831009 learned_addr learned my addr 172.21.15.82:0/3731831009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb818a00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81410dc40 0x7fb8141a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 -- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81410dc40 msgr2=0x7fb8141a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb81410dc40 0x7fb8141a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 -- 172.21.15.82:0/3731831009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb814109310 msgr2=0x7fb81419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb814109310 0x7fb81419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.169+0000 7fb819e00640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8141a4be0 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb819e00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 0x7fb8141a45a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eb10 tx=0x7fb80c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c004b20 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb80c004cc0 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8141a4ed0 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c010690 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.170+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8141ac850 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.171+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb814062eb0 con 0x7fb81410e590 2024-06-06T02:35:38.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.174+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb80c005020 con 0x7fb81410e590 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.175+0000 7fb812000640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb7fc0b2900 0x7fb7fc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb80c0e2c40 con 0x7fb81410e590 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb819400640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb7fc0b2900 0x7fb7fc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb812000640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] conn(0x7fb7fc0bc580 0x7fb7fc0bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7fc0bf140 con 0x7fb7fc0bc580 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb80c0e2ff0 con 0x7fb81410e590 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.176+0000 7fb818a00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] conn(0x7fb7fc0bc580 0x7fb7fc0bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.177+0000 7fb819400640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb7fc0b2900 0x7fb7fc0b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb808000c00 tx=0x7fb808005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.177+0000 7fb818a00640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] conn(0x7fb7fc0bc580 0x7fb7fc0bea70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:38.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.178+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== osd.8 v2:172.21.15.184:6816/3131602198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7fc0bf140 con 0x7fb7fc0bc580 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.194+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 --> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb814063360 con 0x7fb7fc0bc580 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.195+0000 7fb812000640 1 -- 172.21.15.82:0/3731831009 <== osd.8 v2:172.21.15.184:6816/3131602198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb814063360 con 0x7fb7fc0bc580 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] conn(0x7fb7fc0bc580 msgr2=0x7fb7fc0bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] conn(0x7fb7fc0bc580 0x7fb7fc0bea70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb7fc0b2900 msgr2=0x7fb7fc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb7fc0b2900 0x7fb7fc0b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb808000c00 tx=0x7fb808005d50 comp rx=0 tx=0).stop 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 msgr2=0x7fb8141a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 --2- 172.21.15.82:0/3731831009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81410e590 0x7fb8141a45a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eb10 tx=0x7fb80c00c2d0 comp rx=0 tx=0).stop 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb819e00640 1 -- 172.21.15.82:0/3731831009 reap_dead start 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 shutdown_connections 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 >> 172.21.15.82:0/3731831009 conn(0x7fb814078a80 msgr2=0x7fb814079190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:38.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 shutdown_connections 2024-06-06T02:35:38.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:37.196+0000 7fb81a800640 1 -- 172.21.15.82:0/3731831009 wait complete. 2024-06-06T02:35:38.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:38 smithi082 ceph-mon[31579]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:38 smithi103 ceph-mon[36349]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:38.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:38 smithi184 ceph-mon[36922]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:40.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:40 smithi082 ceph-mon[31579]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:40 smithi103 ceph-mon[36349]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:40.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:40 smithi184 ceph-mon[36922]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:41.121 INFO:teuthology.orchestra.run.smithi082.stdout:227633266739 2024-06-06T02:35:41.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-06T02:35:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.084+0000 7fb1cfa00640 1 -- 172.21.15.82:0/3612363567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c8101a00 msgr2=0x7fb1c8101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.084+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/3612363567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c8101a00 0x7fb1c8101e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009ca0 tx=0x7fb1b802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 -- 172.21.15.82:0/3612363567 shutdown_connections 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/3612363567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c810f5b0 0x7fb1c81119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/3612363567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 0x7fb1c810f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/3612363567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c8101a00 0x7fb1c8101e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 -- 172.21.15.82:0/3612363567 >> 172.21.15.82:0/3612363567 conn(0x7fb1c8078a80 msgr2=0x7fb1c8078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 -- 172.21.15.82:0/3612363567 shutdown_connections 2024-06-06T02:35:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.085+0000 7fb1cfa00640 1 -- 172.21.15.82:0/3612363567 wait complete. 2024-06-06T02:35:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 Processor -- start 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 -- start start 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c8101a00 0x7fb1c81a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 0x7fb1c81a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c810f5b0 0x7fb1c819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8115060 con 0x7fb1c8102350 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8114ee0 con 0x7fb1c810f5b0 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.086+0000 7fb1cfa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c81151e0 con 0x7fb1c8101a00 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 0x7fb1c81a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c8101a00 0x7fb1c81a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 0x7fb1c81a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53704/0 (socket says 172.21.15.82:53704) 2024-06-06T02:35:42.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1c7e00640 1 -- 172.21.15.82:0/1277073437 learned_addr learned my addr 172.21.15.82:0/1277073437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c810f5b0 0x7fb1c819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 -- 172.21.15.82:0/1277073437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c8101a00 msgr2=0x7fb1c81a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c8101a00 0x7fb1c81a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 -- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 msgr2=0x7fb1c81a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1c8102350 0x7fb1c81a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.087+0000 7fb1cda00640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c819bf80 con 0x7fb1c810f5b0 2024-06-06T02:35:42.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1cda00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c810f5b0 0x7fb1c819b910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000d6b0 tx=0x7fb1c000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0017070 con 0x7fb1c810f5b0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c819c270 con 0x7fb1c810f5b0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c81a8580 con 0x7fb1c810f5b0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1c0009cd0 con 0x7fb1c810f5b0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.088+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0020060 con 0x7fb1c810f5b0 2024-06-06T02:35:42.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.089+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1c8062eb0 con 0x7fb1c810f5b0 2024-06-06T02:35:42.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.092+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb1c0003c60 con 0x7fb1c810f5b0 2024-06-06T02:35:42.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1c5600640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1ac0b2880 0x7fb1ac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:42.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb1c00e2020 con 0x7fb1c810f5b0 2024-06-06T02:35:42.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1cd000640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1ac0b2880 0x7fb1ac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:42.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1c5600640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] conn(0x7fb1ac0bc500 0x7fb1ac0be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:42.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1c001be50 con 0x7fb1ac0bc500 2024-06-06T02:35:42.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.094+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb1c00e23d0 con 0x7fb1c810f5b0 2024-06-06T02:35:42.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.095+0000 7fb1c7e00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] conn(0x7fb1ac0bc500 0x7fb1ac0be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:42.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.095+0000 7fb1cd000640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1ac0b2880 0x7fb1ac0b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1c819ca50 tx=0x7fb1b8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:42.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.095+0000 7fb1c7e00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] conn(0x7fb1ac0bc500 0x7fb1ac0be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:42.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.096+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== osd.7 v2:172.21.15.103:6816/293167460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1c001be50 con 0x7fb1ac0bc500 2024-06-06T02:35:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.112+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 --> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1c80632e0 con 0x7fb1ac0bc500 2024-06-06T02:35:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.113+0000 7fb1c5600640 1 -- 172.21.15.82:0/1277073437 <== osd.7 v2:172.21.15.103:6816/293167460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb1c80632e0 con 0x7fb1ac0bc500 2024-06-06T02:35:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] conn(0x7fb1ac0bc500 msgr2=0x7fb1ac0be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] conn(0x7fb1ac0bc500 0x7fb1ac0be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1ac0b2880 msgr2=0x7fb1ac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1ac0b2880 0x7fb1ac0b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb1c819ca50 tx=0x7fb1b8005fd0 comp rx=0 tx=0).stop 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c810f5b0 msgr2=0x7fb1c819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 --2- 172.21.15.82:0/1277073437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1c810f5b0 0x7fb1c819b910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000d6b0 tx=0x7fb1c000db70 comp rx=0 tx=0).stop 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cda00640 1 -- 172.21.15.82:0/1277073437 reap_dead start 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 shutdown_connections 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 >> 172.21.15.82:0/1277073437 conn(0x7fb1c8078a80 msgr2=0x7fb1c8110b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.114+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 shutdown_connections 2024-06-06T02:35:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:42.115+0000 7fb1cfa00640 1 -- 172.21.15.82:0/1277073437 wait complete. 2024-06-06T02:35:42.290 INFO:teuthology.orchestra.run.smithi082.stdout:154618822723 2024-06-06T02:35:42.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-06T02:35:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:42 smithi103 ceph-mon[36349]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:42 smithi082 ceph-mon[31579]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:42.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:42 smithi184 ceph-mon[36922]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:43.748 INFO:teuthology.orchestra.run.smithi082.stdout:133143986248 2024-06-06T02:35:43.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 -- 172.21.15.82:0/2795216279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c074b00 msgr2=0x7f232c074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 --2- 172.21.15.82:0/2795216279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c074b00 0x7f232c074f10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f231c009900 tx=0x7f231c02a480 comp rx=0 tx=0).stop 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 -- 172.21.15.82:0/2795216279 shutdown_connections 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 --2- 172.21.15.82:0/2795216279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c113c60 0x7f232c116080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 --2- 172.21.15.82:0/2795216279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c075450 0x7f232c113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 --2- 172.21.15.82:0/2795216279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c074b00 0x7f232c074f10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 -- 172.21.15.82:0/2795216279 >> 172.21.15.82:0/2795216279 conn(0x7f232c079d40 msgr2=0x7f232c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 -- 172.21.15.82:0/2795216279 shutdown_connections 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.898+0000 7f2331a00640 1 -- 172.21.15.82:0/2795216279 wait complete. 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.899+0000 7f2331a00640 1 Processor -- start 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.899+0000 7f2331a00640 1 -- start start 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 0x7f232c19fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c075450 0x7f232c1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c113c60 0x7f232c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f232c1194c0 con 0x7f232c113c60 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f232c119340 con 0x7f232c074b00 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f2331a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f232c119640 con 0x7f232c075450 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f232aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 0x7f232c19fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f232aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 0x7f232c19fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42022/0 (socket says 172.21.15.82:42022) 2024-06-06T02:35:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f232aa00640 1 -- 172.21.15.82:0/2262920167 learned_addr learned my addr 172.21.15.82:0/2262920167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f232b400640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c113c60 0x7f232c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.900+0000 7f232a000640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c075450 0x7f232c1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 -- 172.21.15.82:0/2262920167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c075450 msgr2=0x7f232c1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c075450 0x7f232c1a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 -- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c113c60 msgr2=0x7f232c1a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232c113c60 0x7f232c1a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c1a4d30 con 0x7f232c074b00 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232a000640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f232c075450 0x7f232c1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f232aa00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 0x7f232c19fec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f231c02aa70 tx=0x7f231c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c03f070 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f231c031b50 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c1a4fc0 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c035030 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.901+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c1a54a0 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.902+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f232c113480 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.905+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f231c042070 con 0x7f232c074b00 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f2323400640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f23100b2880 0x7f23100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f231c1032e0 con 0x7f232c074b00 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f232a000640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f23100b2880 0x7f23100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f2323400640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] conn(0x7f23100bc500 0x7f23100be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23100bf0c0 con 0x7f23100bc500 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.907+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f231c103690 con 0x7f232c074b00 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.908+0000 7f232b400640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] conn(0x7f23100bc500 0x7f23100be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.908+0000 7f232a000640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f23100b2880 0x7f23100b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f232c110320 tx=0x7f2314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.908+0000 7f232b400640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] conn(0x7f23100bc500 0x7f23100be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.909+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== osd.1 v2:172.21.15.103:6800/496472221 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f23100bf0c0 con 0x7f23100bc500 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.925+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 --> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f232c076240 con 0x7f23100bc500 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.926+0000 7f2323400640 1 -- 172.21.15.82:0/2262920167 <== osd.1 v2:172.21.15.103:6800/496472221 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f232c076240 con 0x7f23100bc500 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] conn(0x7f23100bc500 msgr2=0x7f23100be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] conn(0x7f23100bc500 0x7f23100be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f23100b2880 msgr2=0x7f23100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f23100b2880 0x7f23100b4d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f232c110320 tx=0x7f2314005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 msgr2=0x7f232c19fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 --2- 172.21.15.82:0/2262920167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f232c074b00 0x7f232c19fec0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f231c02aa70 tx=0x7f231c003c10 comp rx=0 tx=0).stop 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f232b400640 1 -- 172.21.15.82:0/2262920167 reap_dead start 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 shutdown_connections 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 >> 172.21.15.82:0/2262920167 conn(0x7f232c079d40 msgr2=0x7f232c112a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 shutdown_connections 2024-06-06T02:35:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:40.927+0000 7f2331a00640 1 -- 172.21.15.82:0/2262920167 wait complete. 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 -- 172.21.15.82:0/3661734750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 msgr2=0x7fd8a00750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 --2- 172.21.15.82:0/3661734750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a00750e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd894009900 tx=0x7fd89402a490 comp rx=0 tx=0).stop 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 -- 172.21.15.82:0/3661734750 shutdown_connections 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 --2- 172.21.15.82:0/3661734750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a010f2e0 0x7fd8a0111740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 --2- 172.21.15.82:0/3661734750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0075620 0x7fd8a010eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 --2- 172.21.15.82:0/3661734750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a00750e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 -- 172.21.15.82:0/3661734750 >> 172.21.15.82:0/3661734750 conn(0x7fd8a00fe790 msgr2=0x7fd8a0100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 -- 172.21.15.82:0/3661734750 shutdown_connections 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.809+0000 7fd8a6000640 1 -- 172.21.15.82:0/3661734750 wait complete. 2024-06-06T02:35:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 Processor -- start 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 -- start start 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a01a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a0075620 0x7fd8a01a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a010f2e0 0x7fd8a019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a0114f00 con 0x7fd8a0074cd0 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a0114d80 con 0x7fd8a010f2e0 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.811+0000 7fd8a6000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a0115080 con 0x7fd8a0075620 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd89fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a0075620 0x7fd8a01a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a010f2e0 0x7fd8a019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a5600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a010f2e0 0x7fd8a019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56664/0 (socket says 172.21.15.82:56664) 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd89fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a0075620 0x7fd8a01a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50358/0 (socket says 172.21.15.82:50358) 2024-06-06T02:35:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a5600640 1 -- 172.21.15.82:0/1023950897 learned_addr learned my addr 172.21.15.82:0/1023950897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a4c00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a01a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a4c00640 1 -- 172.21.15.82:0/1023950897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a0075620 msgr2=0x7fd8a01a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a4c00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8a0075620 0x7fd8a01a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a4c00640 1 -- 172.21.15.82:0/1023950897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a010f2e0 msgr2=0x7fd8a019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.812+0000 7fd8a4c00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a010f2e0 0x7fd8a019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd8a4c00640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a019bef0 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd8a4c00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a01a15d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd89402aa80 tx=0x7fd894003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89403f070 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd894031b50 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894035030 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a019c180 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.813+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a019c580 con 0x7fd8a0074cd0 2024-06-06T02:35:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.815+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8a0062e70 con 0x7fd8a0074cd0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.818+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd894042070 con 0x7fd8a0074cd0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.819+0000 7fd89d600640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd8880b2880 0x7fd8880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.819+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd894103330 con 0x7fd8a0074cd0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.819+0000 7fd89fe00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd8880b2880 0x7fd8880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.820+0000 7fd89d600640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] conn(0x7fd8880bc500 0x7fd8880be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.820+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8880bf0c0 con 0x7fd8880bc500 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.820+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fd8941036e0 con 0x7fd8a0074cd0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.820+0000 7fd8a5600640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] conn(0x7fd8880bc500 0x7fd8880be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.820+0000 7fd89fe00640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd8880b2880 0x7fd8880b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0095f0 tx=0x7fd88c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.821+0000 7fd8a5600640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] conn(0x7fd8880bc500 0x7fd8880be9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.821+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== osd.0 v2:172.21.15.82:6802/1718007195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8880bf0c0 con 0x7fd8880bc500 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.851+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 --> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8a00632f0 con 0x7fd8880bc500 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.851+0000 7fd89d600640 1 -- 172.21.15.82:0/1023950897 <== osd.0 v2:172.21.15.82:6802/1718007195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8a00632f0 con 0x7fd8880bc500 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] conn(0x7fd8880bc500 msgr2=0x7fd8880be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] conn(0x7fd8880bc500 0x7fd8880be9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd8880b2880 msgr2=0x7fd8880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd8880b2880 0x7fd8880b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0095f0 tx=0x7fd88c005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 msgr2=0x7fd8a01a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 --2- 172.21.15.82:0/1023950897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8a0074cd0 0x7fd8a01a15d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd89402aa80 tx=0x7fd894003b90 comp rx=0 tx=0).stop 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a5600640 1 -- 172.21.15.82:0/1023950897 reap_dead start 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 shutdown_connections 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 >> 172.21.15.82:0/1023950897 conn(0x7fd8a00fe790 msgr2=0x7fd8a00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 shutdown_connections 2024-06-06T02:35:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:41.852+0000 7fd8a6000640 1 -- 172.21.15.82:0/1023950897 wait complete. 2024-06-06T02:35:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:44 smithi103 ceph-mon[36349]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:44 smithi082 ceph-mon[31579]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:44.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:44 smithi184 ceph-mon[36922]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.425+0000 7f00bc800640 1 -- 172.21.15.82:0/23746865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b4074cd0 msgr2=0x7f00b40750e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.425+0000 7f00bc800640 1 --2- 172.21.15.82:0/23746865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b4074cd0 0x7f00b40750e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009ca0 tx=0x7f00ac02a950 comp rx=0 tx=0).stop 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 -- 172.21.15.82:0/23746865 shutdown_connections 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 --2- 172.21.15.82:0/23746865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b410f470 0x7f00b41118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 --2- 172.21.15.82:0/23746865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b4075620 0x7f00b410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 --2- 172.21.15.82:0/23746865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b4074cd0 0x7f00b40750e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 -- 172.21.15.82:0/23746865 >> 172.21.15.82:0/23746865 conn(0x7f00b4079cb0 msgr2=0x7f00b407a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 -- 172.21.15.82:0/23746865 shutdown_connections 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.426+0000 7f00bc800640 1 -- 172.21.15.82:0/23746865 wait complete. 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.427+0000 7f00bc800640 1 Processor -- start 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.427+0000 7f00bc800640 1 -- start start 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 0x7f00b41a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b4075620 0x7f00b41a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b410f470 0x7f00b419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41150b0 con 0x7f00b410f470 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4114f30 con 0x7f00b4075620 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00bc800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4115230 con 0x7f00b4074cd0 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 0x7f00b41a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:45.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00ba800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b410f470 0x7f00b419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 0x7f00b41a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50388/0 (socket says 172.21.15.82:50388) 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 -- 172.21.15.82:0/3607291608 learned_addr learned my addr 172.21.15.82:0/3607291608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9400640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b4075620 0x7f00b41a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 -- 172.21.15.82:0/3607291608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b4075620 msgr2=0x7f00b41a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00b4075620 0x7f00b41a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 -- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b410f470 msgr2=0x7f00b419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00b410f470 0x7f00b419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.428+0000 7f00b9e00640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b419bfd0 con 0x7f00b4074cd0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00b9e00640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 0x7f00b41a1740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005e30 tx=0x7f00ac003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac034040 con 0x7f00b4074cd0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b419c260 con 0x7f00b4074cd0 2024-06-06T02:35:45.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00ac030850 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0046e0 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.429+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b419c740 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.430+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00b4062e70 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.433+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f00ac037020 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.434+0000 7f00aaa00640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a00b2880 0x7f00a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.434+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f00ac103250 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00b9400640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a00b2880 0x7f00a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00aaa00640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] conn(0x7f00a00bc500 0x7f00a00be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00a00bf0c0 con 0x7f00a00bc500 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f00ac103600 con 0x7f00b4074cd0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00ba800640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] conn(0x7f00a00bc500 0x7f00a00be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:45.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.435+0000 7f00b9400640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a00b2880 0x7f00a00b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00b4102480 tx=0x7f00a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.436+0000 7f00ba800640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] conn(0x7f00a00bc500 0x7f00a00be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.437+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== osd.3 v2:172.21.15.82:6810/2283254494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00a00bf0c0 con 0x7f00a00bc500 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.452+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 --> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00b40632f0 con 0x7f00a00bc500 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00aaa00640 1 -- 172.21.15.82:0/3607291608 <== osd.3 v2:172.21.15.82:6810/2283254494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f00b40632f0 con 0x7f00a00bc500 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] conn(0x7f00a00bc500 msgr2=0x7f00a00be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] conn(0x7f00a00bc500 0x7f00a00be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:45.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a00b2880 msgr2=0x7f00a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a00b2880 0x7f00a00b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00b4102480 tx=0x7f00a4005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 msgr2=0x7f00b41a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00bc800640 1 --2- 172.21.15.82:0/3607291608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b4074cd0 0x7f00b41a1740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00ac005e30 tx=0x7f00ac003d60 comp rx=0 tx=0).stop 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.453+0000 7f00ba800640 1 -- 172.21.15.82:0/3607291608 reap_dead start 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.454+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 shutdown_connections 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.454+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 >> 172.21.15.82:0/3607291608 conn(0x7f00b4079cb0 msgr2=0x7f00b4100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.454+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 shutdown_connections 2024-06-06T02:35:45.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:43.454+0000 7f00bc800640 1 -- 172.21.15.82:0/3607291608 wait complete. 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 -- 172.21.15.82:0/3771926533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 msgr2=0x7fbca4108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 --2- 172.21.15.82:0/3771926533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca4108ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc94009930 tx=0x7fbc9402a420 comp rx=0 tx=0).stop 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 -- 172.21.15.82:0/3771926533 shutdown_connections 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 --2- 172.21.15.82:0/3771926533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbca41033e0 0x7fbca410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 --2- 172.21.15.82:0/3771926533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 --2- 172.21.15.82:0/3771926533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca4108ed0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 -- 172.21.15.82:0/3771926533 >> 172.21.15.82:0/3771926533 conn(0x7fbca40fe7e0 msgr2=0x7fbca4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 -- 172.21.15.82:0/3771926533 shutdown_connections 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.872+0000 7fbca9000640 1 -- 172.21.15.82:0/3771926533 wait complete. 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.874+0000 7fbca9000640 1 Processor -- start 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.874+0000 7fbca9000640 1 -- start start 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbca41033e0 0x7fbca4074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca40754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112cd0 con 0x7fbca4102a90 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112b50 con 0x7fbca4108ac0 2024-06-06T02:35:46.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca9000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbca4112e50 con 0x7fbca41033e0 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbca41033e0 0x7fbca4074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53736/0 (socket says 172.21.15.82:53736) 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3400640 1 -- 172.21.15.82:0/2101743709 learned_addr learned my addr 172.21.15.82:0/2101743709 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3e00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca40754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3400640 1 -- 172.21.15.82:0/2101743709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbca41033e0 msgr2=0x7fbca4074fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.875+0000 7fbca3400640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbca41033e0 0x7fbca4074fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca3400640 1 -- 172.21.15.82:0/2101743709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 msgr2=0x7fbca40754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca3400640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca40754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca3400640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca41a7b40 con 0x7fbca4102a90 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca3e00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbca4108ac0 0x7fbca40754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:35:46.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca3400640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4074a60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc94031440 tx=0x7fbc94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9403f030 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc94003aa0 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca41a7dd0 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94035070 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.876+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca41a81f0 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.877+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbca4062e70 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.880+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbc94042030 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.881+0000 7fbc9be00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbc880b2880 0x7fbc880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbc94102aa0 con 0x7fbca4102a90 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbca2a00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbc880b2880 0x7fbc880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbc9be00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] conn(0x7fbc880bc500 0x7fbc880be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:46.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc880bf0c0 con 0x7fbc880bc500 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fbc94102e50 con 0x7fbca4102a90 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbca3e00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] conn(0x7fbc880bc500 0x7fbc880be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.882+0000 7fbca2a00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbc880b2880 0x7fbc880b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbca4100660 tx=0x7fbc9000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.883+0000 7fbca3e00640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] conn(0x7fbc880bc500 0x7fbc880be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.884+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== osd.6 v2:172.21.15.82:6818/1499298999 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc880bf0c0 con 0x7fbc880bc500 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.899+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 --> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbca4063270 con 0x7fbc880bc500 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.900+0000 7fbc9be00640 1 -- 172.21.15.82:0/2101743709 <== osd.6 v2:172.21.15.82:6818/1499298999 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbca4063270 con 0x7fbc880bc500 2024-06-06T02:35:46.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.900+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] conn(0x7fbc880bc500 msgr2=0x7fbc880be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.900+0000 7fbca9000640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] conn(0x7fbc880bc500 0x7fbc880be9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbc880b2880 msgr2=0x7fbc880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbc880b2880 0x7fbc880b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbca4100660 tx=0x7fbc9000b410 comp rx=0 tx=0).stop 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 msgr2=0x7fbca4074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 --2- 172.21.15.82:0/2101743709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca4102a90 0x7fbca4074a60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbc94031440 tx=0x7fbc94004270 comp rx=0 tx=0).stop 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca3e00640 1 -- 172.21.15.82:0/2101743709 reap_dead start 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 shutdown_connections 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 >> 172.21.15.82:0/2101743709 conn(0x7fbca40fe7e0 msgr2=0x7fbca4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 shutdown_connections 2024-06-06T02:35:46.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:44.901+0000 7fbca9000640 1 -- 172.21.15.82:0/2101743709 wait complete. 2024-06-06T02:35:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:46 smithi103 ceph-mon[36349]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:46 smithi082 ceph-mon[31579]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:46 smithi184 ceph-mon[36922]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:47.311 INFO:teuthology.orchestra.run.smithi082.stdout:107374182479 2024-06-06T02:35:47.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-06T02:35:47.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 -- 172.21.15.82:0/3017723315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024107b80 msgr2=0x7fc024107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 --2- 172.21.15.82:0/3017723315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024107b80 0x7fc024107f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc018009900 tx=0x7fc01802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 -- 172.21.15.82:0/3017723315 shutdown_connections 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 --2- 172.21.15.82:0/3017723315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc024102490 0x7fc02410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 --2- 172.21.15.82:0/3017723315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 --2- 172.21.15.82:0/3017723315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024107b80 0x7fc024107f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 -- 172.21.15.82:0/3017723315 >> 172.21.15.82:0/3017723315 conn(0x7fc024078a80 msgr2=0x7fc024078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 -- 172.21.15.82:0/3017723315 shutdown_connections 2024-06-06T02:35:47.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.570+0000 7fc02b800640 1 -- 172.21.15.82:0/3017723315 wait complete. 2024-06-06T02:35:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 Processor -- start 2024-06-06T02:35:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 -- start start 2024-06-06T02:35:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024102490 0x7fc024103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:47.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc024107b80 0x7fc024104190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc024111db0 con 0x7fc024107b80 2024-06-06T02:35:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc024111c30 con 0x7fc024102490 2024-06-06T02:35:47.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.572+0000 7fc02b800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc024111f30 con 0x7fc024101b40 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024103710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50420/0 (socket says 172.21.15.82:50420) 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 -- 172.21.15.82:0/2464375441 learned_addr learned my addr 172.21.15.82:0/2464375441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc023e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024102490 0x7fc024103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 -- 172.21.15.82:0/2464375441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024102490 msgr2=0x7fc024103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc024102490 0x7fc024103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 -- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc024107b80 msgr2=0x7fc024104190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc024107b80 0x7fc024104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.573+0000 7fc028e00640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0241a7b50 con 0x7fc024101b40 2024-06-06T02:35:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.574+0000 7fc028e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024103710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc018031440 tx=0x7fc018003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.574+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01803f070 con 0x7fc024101b40 2024-06-06T02:35:47.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.574+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc018031b50 con 0x7fc024101b40 2024-06-06T02:35:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.574+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018035030 con 0x7fc024101b40 2024-06-06T02:35:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.575+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0241a7de0 con 0x7fc024101b40 2024-06-06T02:35:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.575+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0241a81b0 con 0x7fc024101b40 2024-06-06T02:35:47.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.576+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc02406a9a0 con 0x7fc024101b40 2024-06-06T02:35:47.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.579+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc018042070 con 0x7fc024101b40 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.580+0000 7fc021600640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc00c0b2900 0x7fc00c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.581+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc018102ce0 con 0x7fc024101b40 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.581+0000 7fc023e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc00c0b2900 0x7fc00c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.581+0000 7fc021600640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] conn(0x7fc00c0bc580 0x7fc00c0bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.581+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc00c0bf140 con 0x7fc00c0bc580 2024-06-06T02:35:47.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.581+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc018103090 con 0x7fc024101b40 2024-06-06T02:35:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.582+0000 7fc029800640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] conn(0x7fc00c0bc580 0x7fc00c0bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.582+0000 7fc023e00640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc00c0b2900 0x7fc00c0b4e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0241068c0 tx=0x7fc010005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:47.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.583+0000 7fc029800640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] conn(0x7fc00c0bc580 0x7fc00c0bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.584+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== osd.9 v2:172.21.15.82:6826/1326866066 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc00c0bf140 con 0x7fc00c0bc580 2024-06-06T02:35:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.615+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 --> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0241031f0 con 0x7fc00c0bc580 2024-06-06T02:35:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.616+0000 7fc021600640 1 -- 172.21.15.82:0/2464375441 <== osd.9 v2:172.21.15.82:6826/1326866066 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0241031f0 con 0x7fc00c0bc580 2024-06-06T02:35:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] conn(0x7fc00c0bc580 msgr2=0x7fc00c0bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] conn(0x7fc00c0bc580 0x7fc00c0bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc00c0b2900 msgr2=0x7fc00c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc00c0b2900 0x7fc00c0b4e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0241068c0 tx=0x7fc010005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 msgr2=0x7fc024103710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 --2- 172.21.15.82:0/2464375441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc024101b40 0x7fc024103710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc018031440 tx=0x7fc018003b90 comp rx=0 tx=0).stop 2024-06-06T02:35:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc029800640 1 -- 172.21.15.82:0/2464375441 reap_dead start 2024-06-06T02:35:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 shutdown_connections 2024-06-06T02:35:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 >> 172.21.15.82:0/2464375441 conn(0x7fc024078a80 msgr2=0x7fc024100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 shutdown_connections 2024-06-06T02:35:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:47.617+0000 7fc02b800640 1 -- 172.21.15.82:0/2464375441 wait complete. 2024-06-06T02:35:47.634 INFO:teuthology.orchestra.run.smithi082.stdout:55834574938 2024-06-06T02:35:47.635 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-06T02:35:48.446 INFO:teuthology.orchestra.run.smithi082.stdout:34359738463 2024-06-06T02:35:48.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-06T02:35:48.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:48 smithi082 ceph-mon[31579]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:48 smithi103 ceph-mon[36349]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:48.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:48 smithi184 ceph-mon[36922]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:49.073 INFO:teuthology.orchestra.run.smithi082.stdout:253403070511 2024-06-06T02:35:49.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-06T02:35:49.556 INFO:teuthology.orchestra.run.smithi082.stdout:201863462971 2024-06-06T02:35:49.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 -- 172.21.15.82:0/4182110410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a341077f0 msgr2=0x7f1a34107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 --2- 172.21.15.82:0/4182110410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a341077f0 0x7f1a34107c00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009960 tx=0x7f1a2002a460 comp rx=0 tx=0).stop 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 -- 172.21.15.82:0/4182110410 shutdown_connections 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 --2- 172.21.15.82:0/4182110410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a34108140 0x7f1a3410faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 --2- 172.21.15.82:0/4182110410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a341077f0 0x7f1a34107c00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 --2- 172.21.15.82:0/4182110410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a34102ec0 0x7f1a341032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 -- 172.21.15.82:0/4182110410 >> 172.21.15.82:0/4182110410 conn(0x7f1a34079cb0 msgr2=0x7f1a3407a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:50.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.369+0000 7f1a38c00640 1 -- 172.21.15.82:0/4182110410 shutdown_connections 2024-06-06T02:35:50.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.370+0000 7f1a38c00640 1 -- 172.21.15.82:0/4182110410 wait complete. 2024-06-06T02:35:50.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.371+0000 7f1a38c00640 1 Processor -- start 2024-06-06T02:35:50.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.371+0000 7f1a38c00640 1 -- start start 2024-06-06T02:35:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a34102ec0 0x7f1a341a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a34108140 0x7f1a341a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 0x7f1a3419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34112ea0 con 0x7f1a34108140 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34112d20 con 0x7f1a3419b9b0 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a38c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34113020 con 0x7f1a34102ec0 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a32800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 0x7f1a3419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a31400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a34108140 0x7f1a341a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a32800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 0x7f1a3419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56782/0 (socket says 172.21.15.82:56782) 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a32800640 1 -- 172.21.15.82:0/915335835 learned_addr learned my addr 172.21.15.82:0/915335835 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.372+0000 7f1a31e00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a34102ec0 0x7f1a341a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.373+0000 7f1a32800640 1 -- 172.21.15.82:0/915335835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a34102ec0 msgr2=0x7f1a341a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.373+0000 7f1a32800640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a34102ec0 0x7f1a341a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.373+0000 7f1a32800640 1 -- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a34108140 msgr2=0x7f1a341a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.373+0000 7f1a32800640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a34108140 0x7f1a341a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.373+0000 7f1a32800640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3419c4f0 con 0x7f1a3419b9b0 2024-06-06T02:35:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a32800640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 0x7f1a3419bdc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00eb10 tx=0x7f1a2c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c004b20 con 0x7f1a3419b9b0 2024-06-06T02:35:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3419c7e0 con 0x7f1a3419b9b0 2024-06-06T02:35:50.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a341a8960 con 0x7f1a3419b9b0 2024-06-06T02:35:50.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a2c004cc0 con 0x7f1a3419b9b0 2024-06-06T02:35:50.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.374+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c010720 con 0x7f1a3419b9b0 2024-06-06T02:35:50.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.375+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a14001030 con 0x7f1a3419b9b0 2024-06-06T02:35:50.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.379+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1a2c005000 con 0x7f1a3419b9b0 2024-06-06T02:35:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.380+0000 7f1a2aa00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1a180b2900 0x7f1a180b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.380+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1a2c0e2d20 con 0x7f1a3419b9b0 2024-06-06T02:35:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.381+0000 7f1a31e00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1a180b2900 0x7f1a180b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.381+0000 7f1a2aa00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] conn(0x7f1a180bc580 0x7f1a180bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.381+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a2c018e50 con 0x7f1a180bc580 2024-06-06T02:35:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.381+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f1a2c0e30d0 con 0x7f1a3419b9b0 2024-06-06T02:35:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.381+0000 7f1a31400640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] conn(0x7f1a180bc580 0x7f1a180bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.382+0000 7f1a31e00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1a180b2900 0x7f1a180b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a3419caf0 tx=0x7f1a24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.382+0000 7f1a31400640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] conn(0x7f1a180bc580 0x7f1a180bea70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.383+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== osd.10 v2:172.21.15.103:6824/667256862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a2c018e50 con 0x7f1a180bc580 2024-06-06T02:35:50.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.399+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 --> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1a14002dd0 con 0x7f1a180bc580 2024-06-06T02:35:50.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.399+0000 7f1a2aa00640 1 -- 172.21.15.82:0/915335835 <== osd.10 v2:172.21.15.103:6824/667256862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1a14002dd0 con 0x7f1a180bc580 2024-06-06T02:35:50.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.399+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] conn(0x7f1a180bc580 msgr2=0x7f1a180bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] conn(0x7f1a180bc580 0x7f1a180bea70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1a180b2900 msgr2=0x7f1a180b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1a180b2900 0x7f1a180b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1a3419caf0 tx=0x7f1a24005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 msgr2=0x7f1a3419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 --2- 172.21.15.82:0/915335835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a3419b9b0 0x7f1a3419bdc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00eb10 tx=0x7f1a2c00c2d0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a32800640 1 -- 172.21.15.82:0/915335835 reap_dead start 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 shutdown_connections 2024-06-06T02:35:50.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 >> 172.21.15.82:0/915335835 conn(0x7f1a34079cb0 msgr2=0x7f1a3410e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:50.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 shutdown_connections 2024-06-06T02:35:50.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.400+0000 7f1a38c00640 1 -- 172.21.15.82:0/915335835 wait complete. 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 -- 172.21.15.82:0/1088055557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848102ee0 msgr2=0x7f28481032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 --2- 172.21.15.82:0/1088055557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848102ee0 0x7f28481032f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2838009960 tx=0x7f283802a460 comp rx=0 tx=0).stop 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 -- 172.21.15.82:0/1088055557 shutdown_connections 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 --2- 172.21.15.82:0/1088055557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848108160 0x7f284810fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 --2- 172.21.15.82:0/1088055557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848107810 0x7f2848107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 --2- 172.21.15.82:0/1088055557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848102ee0 0x7f28481032f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 -- 172.21.15.82:0/1088055557 >> 172.21.15.82:0/1088055557 conn(0x7f2848079d40 msgr2=0x7f284807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 -- 172.21.15.82:0/1088055557 shutdown_connections 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.015+0000 7f284da00640 1 -- 172.21.15.82:0/1088055557 wait complete. 2024-06-06T02:35:50.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 Processor -- start 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 -- start start 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848102ee0 0x7f28481a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848107810 0x7f28481a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848108160 0x7f284819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112ec0 con 0x7f2848108160 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2848112d40 con 0x7f2848102ee0 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f284da00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2848113040 con 0x7f2848107810 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f2846a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848102ee0 0x7f28481a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f2846000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848107810 0x7f28481a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f2846a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848102ee0 0x7f28481a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56752/0 (socket says 172.21.15.82:56752) 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f2847400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848108160 0x7f284819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2846a00640 1 -- 172.21.15.82:0/1959865392 learned_addr learned my addr 172.21.15.82:0/1959865392 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.017+0000 7f2846000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848107810 0x7f28481a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50442/0 (socket says 172.21.15.82:50442) 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 -- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848107810 msgr2=0x7f28481a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2848107810 0x7f28481a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 -- 172.21.15.82:0/1959865392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848102ee0 msgr2=0x7f28481a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2848102ee0 0x7f28481a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284819bfa0 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.018+0000 7f2847400640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848108160 0x7f284819b930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2840009fd0 tx=0x7f284000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.019+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284000ce20 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.019+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2840005020 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.019+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284819c290 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.019+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28481a85a0 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.019+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840010690 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.020+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2828001030 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.023+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2840004a40 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.024+0000 7f283f400640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f282c0b2900 0x7f282c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f28400e2a40 con 0x7f2848108160 2024-06-06T02:35:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f2846a00640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f282c0b2900 0x7f282c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f283f400640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] conn(0x7f282c0bc580 0x7f282c0bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f284001ee50 con 0x7f282c0bc580 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f28400e2df0 con 0x7f2848108160 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.025+0000 7f2846000640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] conn(0x7f282c0bc580 0x7f282c0bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.026+0000 7f2846a00640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f282c0b2900 0x7f282c0b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28380096c0 tx=0x7f2838005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.026+0000 7f2846000640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] conn(0x7f282c0bc580 0x7f282c0bea70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.027+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== osd.11 v2:172.21.15.184:6824/3826867745 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f284001ee50 con 0x7f282c0bc580 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.043+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 --> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2828002dd0 con 0x7f282c0bc580 2024-06-06T02:35:50.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f283f400640 1 -- 172.21.15.82:0/1959865392 <== osd.11 v2:172.21.15.184:6824/3826867745 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2828002dd0 con 0x7f282c0bc580 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] conn(0x7f282c0bc580 msgr2=0x7f282c0bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] conn(0x7f282c0bc580 0x7f282c0bea70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f282c0b2900 msgr2=0x7f282c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f282c0b2900 0x7f282c0b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28380096c0 tx=0x7f2838005d50 comp rx=0 tx=0).stop 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848108160 msgr2=0x7f284819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f284da00640 1 --2- 172.21.15.82:0/1959865392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2848108160 0x7f284819b930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2840009fd0 tx=0x7f284000ef10 comp rx=0 tx=0).stop 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.044+0000 7f2847400640 1 -- 172.21.15.82:0/1959865392 reap_dead start 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.045+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 shutdown_connections 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.045+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 >> 172.21.15.82:0/1959865392 conn(0x7f2848079d40 msgr2=0x7f2848105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.045+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 shutdown_connections 2024-06-06T02:35:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:50.045+0000 7f284da00640 1 -- 172.21.15.82:0/1959865392 wait complete. 2024-06-06T02:35:50.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:50 smithi082 ceph-mon[31579]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:50 smithi103 ceph-mon[36349]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:50 smithi184 ceph-mon[36922]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:35:51.230 INFO:teuthology.orchestra.run.smithi082.stdout:300647710757 2024-06-06T02:35:51.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.577+0000 7f0c3a600640 1 -- 172.21.15.82:0/3732232417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 msgr2=0x7f0c34107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.577+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3732232417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c34107c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009890 tx=0x7f0c2002a360 comp rx=0 tx=0).stop 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.577+0000 7f0c3a600640 1 -- 172.21.15.82:0/3732232417 shutdown_connections 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.577+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3732232417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c34108140 0x7f0c3410faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.578+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3732232417 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c34107c00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.578+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3732232417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 0x7f0c341032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.578+0000 7f0c3a600640 1 -- 172.21.15.82:0/3732232417 >> 172.21.15.82:0/3732232417 conn(0x7f0c34079cb0 msgr2=0x7f0c3407a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.578+0000 7f0c3a600640 1 -- 172.21.15.82:0/3732232417 shutdown_connections 2024-06-06T02:35:51.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.578+0000 7f0c3a600640 1 -- 172.21.15.82:0/3732232417 wait complete. 2024-06-06T02:35:51.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.579+0000 7f0c3a600640 1 Processor -- start 2024-06-06T02:35:51.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.579+0000 7f0c3a600640 1 -- start start 2024-06-06T02:35:51.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.579+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 0x7f0c341a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.579+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c341a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.579+0000 7f0c3a600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c34108140 0x7f0c3419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c3a600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34112e50 con 0x7f0c34108140 2024-06-06T02:35:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c3a600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34112cd0 con 0x7f0c34102ec0 2024-06-06T02:35:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c3a600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0c34112fd0 con 0x7f0c341077f0 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c341a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c341a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50468/0 (socket says 172.21.15.82:50468) 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 -- 172.21.15.82:0/3623270148 learned_addr learned my addr 172.21.15.82:0/3623270148 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c33400640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 0x7f0c341a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c33e00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c34108140 0x7f0c3419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 -- 172.21.15.82:0/3623270148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 msgr2=0x7f0c341a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 0x7f0c341a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 -- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c34108140 msgr2=0x7f0c3419b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c34108140 0x7f0c3419b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c32a00640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3419bfd0 con 0x7f0c341077f0 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.580+0000 7f0c33400640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0c34102ec0 0x7f0c341a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c32a00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c341a1c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c20035040 tx=0x7f0c20005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20040020 con 0x7f0c341077f0 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c20038040 con 0x7f0c341077f0 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3419c260 con 0x7f0c341077f0 2024-06-06T02:35:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20037070 con 0x7f0c341077f0 2024-06-06T02:35:51.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.581+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3419c790 con 0x7f0c341077f0 2024-06-06T02:35:51.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.582+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c34075cf0 con 0x7f0c341077f0 2024-06-06T02:35:51.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.585+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0c20043020 con 0x7f0c341077f0 2024-06-06T02:35:51.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c2be00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0c180b2900 0x7f0c180b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:51.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0c201025c0 con 0x7f0c341077f0 2024-06-06T02:35:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c33400640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0c180b2900 0x7f0c180b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c2be00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] conn(0x7f0c180bc580 0x7f0c180bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:35:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c200328f0 con 0x7f0c180bc580 2024-06-06T02:35:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.587+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0c20102970 con 0x7f0c341077f0 2024-06-06T02:35:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.588+0000 7f0c33e00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] conn(0x7f0c180bc580 0x7f0c180bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:35:51.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.588+0000 7f0c33400640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0c180b2900 0x7f0c180b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0c3419caa0 tx=0x7f0c24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:51.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.589+0000 7f0c33e00640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] conn(0x7f0c180bc580 0x7f0c180bea70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:35:51.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.590+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== osd.2 v2:172.21.15.184:6800/3542247207 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c200328f0 con 0x7f0c180bc580 2024-06-06T02:35:51.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.606+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 --> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c34104370 con 0x7f0c180bc580 2024-06-06T02:35:51.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.607+0000 7f0c2be00640 1 -- 172.21.15.82:0/3623270148 <== osd.2 v2:172.21.15.184:6800/3542247207 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0c34104370 con 0x7f0c180bc580 2024-06-06T02:35:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] conn(0x7f0c180bc580 msgr2=0x7f0c180bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] conn(0x7f0c180bc580 0x7f0c180bea70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0c180b2900 msgr2=0x7f0c180b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0c180b2900 0x7f0c180b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0c3419caa0 tx=0x7f0c24005f90 comp rx=0 tx=0).stop 2024-06-06T02:35:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 msgr2=0x7f0c341a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 --2- 172.21.15.82:0/3623270148 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c341077f0 0x7f0c341a1c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c20035040 tx=0x7f0c20005dc0 comp rx=0 tx=0).stop 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c33e00640 1 -- 172.21.15.82:0/3623270148 reap_dead start 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 shutdown_connections 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 >> 172.21.15.82:0/3623270148 conn(0x7f0c34079cb0 msgr2=0x7f0c3410e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 shutdown_connections 2024-06-06T02:35:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:35:51.608+0000 7f0c3a600640 1 -- 172.21.15.82:0/3623270148 wait complete. 2024-06-06T02:35:51.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:51 smithi103 ceph-mon[36349]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-06T02:35:51.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:51 smithi082 ceph-mon[31579]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-06T02:35:51.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:51 smithi184 ceph-mon[36922]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-06-06T02:35:52.067 INFO:teuthology.orchestra.run.smithi082.stdout:180388626496 2024-06-06T02:35:52.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-06T02:35:52.355 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:52.975 INFO:teuthology.orchestra.run.smithi082.stdout:274877906986 2024-06-06T02:35:52.975 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-06T02:35:53.487 INFO:teuthology.orchestra.run.smithi082.stdout:77309411416 2024-06-06T02:35:53.488 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-06T02:35:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:53.775 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:53.915 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:54.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:53 smithi082 ceph-mon[31579]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-06T02:35:54.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:53 smithi103 ceph-mon[36349]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-06T02:35:54.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:53 smithi184 ceph-mon[36922]: pgmap v389: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-06-06T02:35:56.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:55 smithi082 ceph-mon[31579]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:56.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:55 smithi184 ceph-mon[36922]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:55 smithi103 ceph-mon[36349]: pgmap v390: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:35:56.489 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:35:58.077 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:57 smithi082 ceph-mon[31579]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:58.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:57 smithi184 ceph-mon[36922]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:35:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:57 smithi103 ceph-mon[36349]: pgmap v391: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:00.124 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:35:59 smithi082 ceph-mon[31579]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:00.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:35:59 smithi184 ceph-mon[36922]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 -- 172.21.15.82:0/582331902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 msgr2=0x7fe51c10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 --2- 172.21.15.82:0/582331902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c10e050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe504009960 tx=0x7fe50402a460 comp rx=0 tx=0).stop 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 -- 172.21.15.82:0/582331902 shutdown_connections 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 --2- 172.21.15.82:0/582331902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c10e590 0x7fe51c115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 --2- 172.21.15.82:0/582331902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c10e050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 --2- 172.21.15.82:0/582331902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c109310 0x7fe51c109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 -- 172.21.15.82:0/582331902 >> 172.21.15.82:0/582331902 conn(0x7fe51c078a80 msgr2=0x7fe51c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 -- 172.21.15.82:0/582331902 shutdown_connections 2024-06-06T02:36:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.234+0000 7fe521c00640 1 -- 172.21.15.82:0/582331902 wait complete. 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.236+0000 7fe521c00640 1 Processor -- start 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.236+0000 7fe521c00640 1 -- start start 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.236+0000 7fe521c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c1a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 0x7fe51c1a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c1192c0 con 0x7fe51c10dc40 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c119140 con 0x7fe51c10e590 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c119440 con 0x7fe51c109310 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:46010/0 (socket says 172.21.15.82:46010) 2024-06-06T02:36:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 -- 172.21.15.82:0/3510510029 learned_addr learned my addr 172.21.15.82:0/3510510029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe521200640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 0x7fe51c1a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51b400640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c1a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 -- 172.21.15.82:0/3510510029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 msgr2=0x7fe51c1a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 0x7fe51c1a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 -- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 msgr2=0x7fe51c1a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.237+0000 7fe51be00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c1a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe51be00640 1 -- 172.21.15.82:0/3510510029 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c1a4bb0 con 0x7fe51c109310 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe521200640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 0x7fe51c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe51b400640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe51be00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00ea20 tx=0x7fe50c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00ccc0 con 0x7fe51c109310 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51c1a4ea0 con 0x7fe51c109310 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe50c00ce60 con 0x7fe51c109310 2024-06-06T02:36:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c018750 con 0x7fe51c109310 2024-06-06T02:36:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.238+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51c1a53b0 con 0x7fe51c109310 2024-06-06T02:36:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.239+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51c10a7c0 con 0x7fe51c109310 2024-06-06T02:36:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.242+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe50c0109e0 con 0x7fe51c109310 2024-06-06T02:36:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.243+0000 7fe518c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 0x7fe5000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.244+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe50c0e2c90 con 0x7fe51c109310 2024-06-06T02:36:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.244+0000 7fe51b400640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 0x7fe5000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.244+0000 7fe51b400640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 0x7fe5000b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe50402aa50 tx=0x7fe504005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.245+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe50c0aa810 con 0x7fe51c109310 2024-06-06T02:36:00.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:35:59 smithi103 ceph-mon[36349]: pgmap v392: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:00.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.455+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe51c1115b0 con 0x7fe51c109310 2024-06-06T02:36:00.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.456+0000 7fe518c00640 1 -- 172.21.15.82:0/3510510029 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe50c0aa110 con 0x7fe51c109310 2024-06-06T02:36:00.455 INFO:teuthology.orchestra.run.smithi082.stdout:34359738466 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.458+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 msgr2=0x7fe5000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.458+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 0x7fe5000b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe50402aa50 tx=0x7fe504005040 comp rx=0 tx=0).stop 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.458+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 msgr2=0x7fe51c19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.458+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00ea20 tx=0x7fe50c00ee20 comp rx=0 tx=0).stop 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 shutdown_connections 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe51c10e590 0x7fe51c1a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe51c10dc40 0x7fe51c1a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe5000b2880 0x7fe5000b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 --2- 172.21.15.82:0/3510510029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe51c109310 0x7fe51c19fd40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:00.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 >> 172.21.15.82:0/3510510029 conn(0x7fe51c078a80 msgr2=0x7fe51c079170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:00.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 shutdown_connections 2024-06-06T02:36:00.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:00.459+0000 7fe521c00640 1 -- 172.21.15.82:0/3510510029 wait complete. 2024-06-06T02:36:01.090 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3510510029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T02:36:01.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:36:01.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:00 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3510510029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:00 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3510510029' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-06T02:36:01.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:36:01.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:00 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:02.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:01 smithi184 ceph-mon[36922]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:02.167 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:01 smithi082 ceph-mon[31579]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:02.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:01 smithi103 ceph-mon[36349]: pgmap v393: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:03.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:03.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:04 smithi082 ceph-mon[31579]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T02:36:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:04 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:04 smithi184 ceph-mon[36922]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T02:36:04.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:04 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:04 smithi103 ceph-mon[36349]: pgmap v394: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-06-06T02:36:04.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:04.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:04 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 -- 172.21.15.82:0/245189133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc1046d0 msgr2=0x7f7dfc10cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 --2- 172.21.15.82:0/245189133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc10cc20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009900 tx=0x7f7de402a410 comp rx=0 tx=0).stop 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 -- 172.21.15.82:0/245189133 shutdown_connections 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 --2- 172.21.15.82:0/245189133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc10f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 --2- 172.21.15.82:0/245189133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc10cc20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 --2- 172.21.15.82:0/245189133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc103d80 0x7f7dfc104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 -- 172.21.15.82:0/245189133 >> 172.21.15.82:0/245189133 conn(0x7f7dfc078ac0 msgr2=0x7f7dfc078f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 -- 172.21.15.82:0/245189133 shutdown_connections 2024-06-06T02:36:05.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.216+0000 7f7e01600640 1 -- 172.21.15.82:0/245189133 wait complete. 2024-06-06T02:36:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.217+0000 7f7e01600640 1 Processor -- start 2024-06-06T02:36:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 -- start start 2024-06-06T02:36:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 0x7f7dfc1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc112e40 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc112cc0 con 0x7f7dfc1046d0 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7e01600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc112fc0 con 0x7f7dfc103d80 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7df3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7dfaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 0x7f7dfc1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7dfb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7dfaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 0x7f7dfc1a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37356/0 (socket says 172.21.15.82:37356) 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7dfaa00640 1 -- 172.21.15.82:0/1230838013 learned_addr learned my addr 172.21.15.82:0/1230838013 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:05.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.218+0000 7f7df3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc1a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53034/0 (socket says 172.21.15.82:53034) 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 -- 172.21.15.82:0/1230838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 msgr2=0x7f7dfc1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 0x7f7dfc1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 -- 172.21.15.82:0/1230838013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 msgr2=0x7f7dfc1a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc1a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 -- 172.21.15.82:0/1230838013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc19bf60 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.219+0000 7f7dfb400640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc19b8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7df400da10 tx=0x7f7df400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.220+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df400bd70 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.220+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7df4003e20 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.220+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc19c250 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.220+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40106c0 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.220+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc19c710 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.221+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc104190 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.225+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7df4004270 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.227+0000 7f7df3400640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 0x7f7ddc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.227+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7df40e2a90 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.228+0000 7f7dfaa00640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 0x7f7ddc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.228+0000 7f7dfaa00640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 0x7f7ddc0b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc19ca30 tx=0x7f7dec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:05.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.229+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7df40aa610 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.454+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7dfc19ce20 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.455+0000 7f7df3400640 1 -- 172.21.15.82:0/1230838013 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7dfc19ce20 con 0x7f7dfc10d1e0 2024-06-06T02:36:05.454 INFO:teuthology.orchestra.run.smithi082.stdout:201863462975 2024-06-06T02:36:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 msgr2=0x7f7ddc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 0x7f7ddc0b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc19ca30 tx=0x7f7dec005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 msgr2=0x7f7dfc19b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc19b8f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7df400da10 tx=0x7f7df400ded0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 shutdown_connections 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dfc10d1e0 0x7f7dfc19b8f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7dfc1046d0 0x7f7dfc1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ddc0b2880 0x7f7ddc0b4d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 --2- 172.21.15.82:0/1230838013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7dfc103d80 0x7f7dfc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 >> 172.21.15.82:0/1230838013 conn(0x7f7dfc078ac0 msgr2=0x7f7dfc1091b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 shutdown_connections 2024-06-06T02:36:05.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.458+0000 7f7e01600640 1 -- 172.21.15.82:0/1230838013 wait complete. 2024-06-06T02:36:05.928 INFO:teuthology.orchestra.run.smithi082.stdout:107374182484 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 -- 172.21.15.82:0/1403255902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63401077f0 msgr2=0x7f6340107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 --2- 172.21.15.82:0/1403255902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63401077f0 0x7f6340107c00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6330009960 tx=0x7f633002a460 comp rx=0 tx=0).stop 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 -- 172.21.15.82:0/1403255902 shutdown_connections 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 --2- 172.21.15.82:0/1403255902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f634010faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 --2- 172.21.15.82:0/1403255902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63401077f0 0x7f6340107c00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 --2- 172.21.15.82:0/1403255902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6340102ec0 0x7f63401032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 -- 172.21.15.82:0/1403255902 >> 172.21.15.82:0/1403255902 conn(0x7f6340079cb0 msgr2=0x7f634007a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 -- 172.21.15.82:0/1403255902 shutdown_connections 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.672+0000 7f6348200640 1 -- 172.21.15.82:0/1403255902 wait complete. 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.674+0000 7f6348200640 1 Processor -- start 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.674+0000 7f6348200640 1 -- start start 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401077f0 0x7f634019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f63401997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112e50 con 0x7f6340102ec0 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112cd0 con 0x7f6340108140 2024-06-06T02:36:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6348200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6340112fd0 con 0x7f63401077f0 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6345800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6345800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51048/0 (socket says 172.21.15.82:51048) 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6345800640 1 -- 172.21.15.82:0/2474640052 learned_addr learned my addr 172.21.15.82:0/2474640052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6346200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f63401997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.675+0000 7f6344e00640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401077f0 0x7f634019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 -- 172.21.15.82:0/2474640052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401077f0 msgr2=0x7f634019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401077f0 0x7f634019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 -- 172.21.15.82:0/2474640052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 msgr2=0x7f63401997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f63401997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 -- 172.21.15.82:0/2474640052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6340199ed0 con 0x7f6340102ec0 2024-06-06T02:36:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6346200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f63401997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6345800640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f633400e9f0 tx=0x7f633400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633400cd80 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63340054d0 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334010690 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634019a160 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.676+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401a63c0 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.678+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6340104370 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.680+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6334004e30 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.682+0000 7f633e000640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 0x7f63280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.682+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f63340e2b50 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.682+0000 7f6344e00640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 0x7f63280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.683+0000 7f6344e00640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 0x7f63280b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6330006010 tx=0x7f6330005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.683+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6334054df0 con 0x7f6340102ec0 2024-06-06T02:36:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.896+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f634010b160 con 0x7f6340102ec0 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.897+0000 7f633e000640 1 -- 172.21.15.82:0/2474640052 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f63340aa6d0 con 0x7f6340102ec0 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 msgr2=0x7f63280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 0x7f63280b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6330006010 tx=0x7f6330005d50 comp rx=0 tx=0).stop 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 msgr2=0x7f634019f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f633400e9f0 tx=0x7f633400edf0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 shutdown_connections 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6340108140 0x7f63401997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63280b2880 0x7f63280b4d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63401077f0 0x7f634019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 --2- 172.21.15.82:0/2474640052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6340102ec0 0x7f634019f560 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 >> 172.21.15.82:0/2474640052 conn(0x7f6340079cb0 msgr2=0x7f6340105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 shutdown_connections 2024-06-06T02:36:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:05.900+0000 7f6348200640 1 -- 172.21.15.82:0/2474640052 wait complete. 2024-06-06T02:36:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:06 smithi082 ceph-mon[31579]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-06T02:36:06.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:06 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1230838013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T02:36:06.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:06 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2474640052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T02:36:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:06 smithi184 ceph-mon[36922]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-06T02:36:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1230838013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T02:36:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:06 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2474640052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T02:36:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:06 smithi103 ceph-mon[36349]: pgmap v395: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-06-06T02:36:06.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:06 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1230838013' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-06T02:36:06.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:06 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2474640052' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 -- 172.21.15.82:0/3877670987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 msgr2=0x7f1218104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 --2- 172.21.15.82:0/3877670987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f1218104010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1208009900 tx=0x7f120802a480 comp rx=0 tx=0).stop 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 -- 172.21.15.82:0/3877670987 shutdown_connections 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 --2- 172.21.15.82:0/3877670987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f121810f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 --2- 172.21.15.82:0/3877670987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f121810caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 --2- 172.21.15.82:0/3877670987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f1218104010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 -- 172.21.15.82:0/3877670987 >> 172.21.15.82:0/3877670987 conn(0x7f12180fd6a0 msgr2=0x7f12180ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 -- 172.21.15.82:0/3877670987 shutdown_connections 2024-06-06T02:36:06.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.903+0000 7f1217200640 1 -- 172.21.15.82:0/3877670987 wait complete. 2024-06-06T02:36:06.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.904+0000 7f1217200640 1 Processor -- start 2024-06-06T02:36:06.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 -- start start 2024-06-06T02:36:06.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:06.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f1218101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f1218102370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1218112cd0 con 0x7f1218103c00 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1218112b50 con 0x7f121810d030 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1217200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1218112e50 con 0x7f1218104550 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1215e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1215400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f1218101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1215e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51070/0 (socket says 172.21.15.82:51070) 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1215e00640 1 -- 172.21.15.82:0/3169785112 learned_addr learned my addr 172.21.15.82:0/3169785112 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:06.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.905+0000 7f1216800640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f1218102370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 -- 172.21.15.82:0/3169785112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 msgr2=0x7f1218102370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f1218102370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 -- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 msgr2=0x7f12181018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 -- 172.21.15.82:0/3169785112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12181a7a20 con 0x7f1218104550 2024-06-06T02:36:06.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215e00640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1216800640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f1218102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.906+0000 7f1215400640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f1218101e30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f121806a2e0 tx=0x7f120400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.907+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204009c30 con 0x7f1218104550 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.907+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12181a7d10 con 0x7f1218104550 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.907+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1204009dd0 con 0x7f1218104550 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.907+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204003e50 con 0x7f1218104550 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.907+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12181a81e0 con 0x7f1218104550 2024-06-06T02:36:06.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.908+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1218104010 con 0x7f1218104550 2024-06-06T02:36:06.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.911+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1204004000 con 0x7f1218104550 2024-06-06T02:36:06.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.912+0000 7f120ea00640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 0x7f11fc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:06.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.912+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f12040e23a0 con 0x7f1218104550 2024-06-06T02:36:06.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.912+0000 7f1215e00640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 0x7f11fc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:06.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.913+0000 7f1215e00640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 0x7f11fc0b4f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f12080096c0 tx=0x7f1208005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:06.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:06.914+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1204017020 con 0x7f1218104550 2024-06-06T02:36:07.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.137+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1218108160 con 0x7f1218104550 2024-06-06T02:36:07.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.138+0000 7f120ea00640 1 -- 172.21.15.82:0/3169785112 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f12040a98d0 con 0x7f1218104550 2024-06-06T02:36:07.138 INFO:teuthology.orchestra.run.smithi082.stdout:253403070514 2024-06-06T02:36:07.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 msgr2=0x7f11fc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 0x7f11fc0b4f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f12080096c0 tx=0x7f1208005a20 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 msgr2=0x7f1218101e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f1218101e30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f121806a2e0 tx=0x7f120400dde0 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 shutdown_connections 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f121810d030 0x7f1218102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f11fc0b2a20 0x7f11fc0b4f30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1218104550 0x7f1218101e30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 --2- 172.21.15.82:0/3169785112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1218103c00 0x7f12181018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 >> 172.21.15.82:0/3169785112 conn(0x7f12180fd6a0 msgr2=0x7f12180ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.141+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 shutdown_connections 2024-06-06T02:36:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:07.142+0000 7f1217200640 1 -- 172.21.15.82:0/3169785112 wait complete. 2024-06-06T02:36:07.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:07 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3169785112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T02:36:07.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:07 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3169785112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T02:36:07.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:07 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3169785112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-06T02:36:08.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:08 smithi082 ceph-mon[31579]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:08 smithi184 ceph-mon[36922]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:08.805 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462971 got 201863462975 for osd.7 2024-06-06T02:36:08.805 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:08 smithi103 ceph-mon[36349]: pgmap v396: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:09.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:09 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/197235302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T02:36:09.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:09 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/197235302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T02:36:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 -- 172.21.15.82:0/1332702890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10dc40 msgr2=0x7f850c10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 --2- 172.21.15.82:0/1332702890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10dc40 0x7f850c10e050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009930 tx=0x7f84f802a420 comp rx=0 tx=0).stop 2024-06-06T02:36:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 -- 172.21.15.82:0/1332702890 shutdown_connections 2024-06-06T02:36:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 --2- 172.21.15.82:0/1332702890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c10e590 0x7f850c115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 --2- 172.21.15.82:0/1332702890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10dc40 0x7f850c10e050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 --2- 172.21.15.82:0/1332702890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c109310 0x7f850c109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 -- 172.21.15.82:0/1332702890 >> 172.21.15.82:0/1332702890 conn(0x7f850c078a80 msgr2=0x7f850c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 -- 172.21.15.82:0/1332702890 shutdown_connections 2024-06-06T02:36:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.443+0000 7f850be00640 1 -- 172.21.15.82:0/1332702890 wait complete. 2024-06-06T02:36:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 Processor -- start 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 -- start start 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c109310 0x7f850c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10e590 0x7f850c1a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f850c119290 con 0x7f850c10dc40 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f850c119110 con 0x7f850c10e590 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.445+0000 7f850be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f850c119410 con 0x7f850c109310 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:09.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10e590 0x7f850c1a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c109310 0x7f850c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51114/0 (socket says 172.21.15.82:51114) 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 -- 172.21.15.82:0/2694280437 learned_addr learned my addr 172.21.15.82:0/2694280437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 -- 172.21.15.82:0/2694280437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c109310 msgr2=0x7f850c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c109310 0x7f850c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 -- 172.21.15.82:0/2694280437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10e590 msgr2=0x7f850c1a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10e590 0x7f850c1a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 -- 172.21.15.82:0/2694280437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c1a4b80 con 0x7f850c10dc40 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.446+0000 7f850a000640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005940 tx=0x7f84f80319e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:09.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.447+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f803f030 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.447+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c1a4e10 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.447+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84f80043d0 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.447+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8035070 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.447+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c1a5340 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.448+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c10a7c0 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.451+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f84f8042030 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.453+0000 7f8510a00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 0x7f84f00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.453+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f84f8102620 con 0x7f850c10dc40 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.453+0000 7f850aa00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 0x7f84f00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:09.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.454+0000 7f850aa00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 0x7f84f00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009bd0 tx=0x7f84fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:09.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.454+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f84f80c9b50 con 0x7f850c10dc40 2024-06-06T02:36:09.778 INFO:teuthology.orchestra.run.smithi082.stdout:154618822730 2024-06-06T02:36:09.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.668+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f850c111550 con 0x7f850c10dc40 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.668+0000 7f8510a00640 1 -- 172.21.15.82:0/2694280437 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f84f80cde50 con 0x7f850c10dc40 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 msgr2=0x7f84f00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 0x7f84f00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84fc009bd0 tx=0x7f84fc005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 msgr2=0x7f850c1a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005940 tx=0x7f84f80319e0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 shutdown_connections 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f850c10e590 0x7f850c1a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850c10dc40 0x7f850c1a0270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f84f00b2880 0x7f84f00b4d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 --2- 172.21.15.82:0/2694280437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f850c109310 0x7f850c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:09.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.671+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 >> 172.21.15.82:0/2694280437 conn(0x7f850c078a80 msgr2=0x7f850c079170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:09.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.672+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 shutdown_connections 2024-06-06T02:36:09.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:09.672+0000 7f850be00640 1 -- 172.21.15.82:0/2694280437 wait complete. 2024-06-06T02:36:09.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:09 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/197235302' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 -- 172.21.15.82:0/2112085303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 msgr2=0x7f2db0108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 --2- 172.21.15.82:0/2112085303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db0108ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009cd0 tx=0x7f2da002a8f0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 -- 172.21.15.82:0/2112085303 shutdown_connections 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 --2- 172.21.15.82:0/2112085303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db01033f0 0x7f2db010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 --2- 172.21.15.82:0/2112085303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db0102aa0 0x7f2db0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 --2- 172.21.15.82:0/2112085303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db0108ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 -- 172.21.15.82:0/2112085303 >> 172.21.15.82:0/2112085303 conn(0x7f2db00fe790 msgr2=0x7f2db0100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 -- 172.21.15.82:0/2112085303 shutdown_connections 2024-06-06T02:36:10.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.282+0000 7f2db6000640 1 -- 172.21.15.82:0/2112085303 wait complete. 2024-06-06T02:36:10.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.283+0000 7f2db6000640 1 Processor -- start 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 -- start start 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 0x7f2db0074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db00754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0112ce0 con 0x7f2db01033f0 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0112b60 con 0x7f2db0108ad0 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db6000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0112e60 con 0x7f2db0102aa0 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db4c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db4c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37410/0 (socket says 172.21.15.82:37410) 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2db4c00640 1 -- 172.21.15.82:0/2884236854 learned_addr learned my addr 172.21.15.82:0/2884236854 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.284+0000 7f2da7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 0x7f2db0074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db5600640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db00754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 -- 172.21.15.82:0/2884236854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 msgr2=0x7f2db00754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db00754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 -- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 msgr2=0x7f2db0074fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 0x7f2db0074fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 -- 172.21.15.82:0/2884236854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db01a7b50 con 0x7f2db0102aa0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2da7e00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 0x7f2db0074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.285+0000 7f2db4c00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2da0030dd0 tx=0x7f2da00093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.286+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0004040 con 0x7f2db0102aa0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.286+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db01a7de0 con 0x7f2db0102aa0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.286+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da0040070 con 0x7f2db0102aa0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.286+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0045ac0 con 0x7f2db0102aa0 2024-06-06T02:36:10.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.286+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db01a8290 con 0x7f2db0102aa0 2024-06-06T02:36:10.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.287+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db0102eb0 con 0x7f2db0102aa0 2024-06-06T02:36:10.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.290+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2da0045c60 con 0x7f2db0102aa0 2024-06-06T02:36:10.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.291+0000 7f2dae000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 0x7f2d940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.291+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2da01034c0 con 0x7f2db0102aa0 2024-06-06T02:36:10.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.291+0000 7f2da7e00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 0x7f2d940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.292+0000 7f2da7e00640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 0x7f2d940b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2db0101e30 tx=0x7f2d98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:10.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.293+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2da00cb150 con 0x7f2db0102aa0 2024-06-06T02:36:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.504+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2db010b010 con 0x7f2db0102aa0 2024-06-06T02:36:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.505+0000 7f2dae000640 1 -- 172.21.15.82:0/2884236854 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2da00caa50 con 0x7f2db0102aa0 2024-06-06T02:36:10.505 INFO:teuthology.orchestra.run.smithi082.stdout:300647710760 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.509+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 msgr2=0x7f2d940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.509+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 0x7f2d940b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2db0101e30 tx=0x7f2d98005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 msgr2=0x7f2db0074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2da0030dd0 tx=0x7f2da00093d0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 shutdown_connections 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2db0108ad0 0x7f2db00754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2db01033f0 0x7f2db0074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d940b2880 0x7f2d940b4d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 --2- 172.21.15.82:0/2884236854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2db0102aa0 0x7f2db0074a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 >> 172.21.15.82:0/2884236854 conn(0x7f2db00fe790 msgr2=0x7f2db0100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 shutdown_connections 2024-06-06T02:36:10.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:10.510+0000 7f2db6000640 1 -- 172.21.15.82:0/2884236854 wait complete. 2024-06-06T02:36:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:10 smithi082 ceph-mon[31579]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:10 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2694280437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T02:36:10.672 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822723 got 154618822730 for osd.5 2024-06-06T02:36:10.673 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 -- 172.21.15.82:0/157181670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d8103b90 msgr2=0x7fa1d8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 --2- 172.21.15.82:0/157181670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d8103b90 0x7fa1d8103fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc009900 tx=0x7fa1cc02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 -- 172.21.15.82:0/157181670 shutdown_connections 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 --2- 172.21.15.82:0/157181670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d810cff0 0x7fa1d810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 --2- 172.21.15.82:0/157181670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d81044e0 0x7fa1d810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 --2- 172.21.15.82:0/157181670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d8103b90 0x7fa1d8103fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 -- 172.21.15.82:0/157181670 >> 172.21.15.82:0/157181670 conn(0x7fa1d80fd6f0 msgr2=0x7fa1d80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.394+0000 7fa1de200640 1 -- 172.21.15.82:0/157181670 shutdown_connections 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.395+0000 7fa1de200640 1 -- 172.21.15.82:0/157181670 wait complete. 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 Processor -- start 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 -- start start 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 0x7fa1d8101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d810cff0 0x7fa1d8102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8112ca0 con 0x7fa1d8103b90 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8112b20 con 0x7fa1d810cff0 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.396+0000 7fa1de200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8112e20 con 0x7fa1d81044e0 2024-06-06T02:36:10.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51096/0 (socket says 172.21.15.82:51096) 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 -- 172.21.15.82:0/197235302 learned_addr learned my addr 172.21.15.82:0/197235302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1d7e00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 0x7fa1d8101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dd800640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d810cff0 0x7fa1d8102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 -- 172.21.15.82:0/197235302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 msgr2=0x7fa1d8101dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 0x7fa1d8101dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 -- 172.21.15.82:0/197235302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d810cff0 msgr2=0x7fa1d8102300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d810cff0 0x7fa1d8102300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1dce00640 1 -- 172.21.15.82:0/197235302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d81a7ad0 con 0x7fa1d8103b90 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.397+0000 7fa1d7e00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 0x7fa1d8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1dce00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc005ab0 tx=0x7fa1cc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc03f070 con 0x7fa1d8103b90 2024-06-06T02:36:10.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d81a7d60 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1cc031b60 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc035030 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.398+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d81a8190 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.400+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d8103fa0 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.402+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa1cc042070 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.403+0000 7fa1d5600640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 0x7fa1c00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.404+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa1cc102a00 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.404+0000 7fa1d7e00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 0x7fa1c00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.405+0000 7fa1d7e00640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 0x7fa1c00b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1d81004f0 tx=0x7fa1c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.408+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa1cc0ca580 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.620+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa1d802dd00 con 0x7fa1d8103b90 2024-06-06T02:36:10.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.620+0000 7fa1d5600640 1 -- 172.21.15.82:0/197235302 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1cc0c9e80 con 0x7fa1d8103b90 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stdout:227633266745 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 msgr2=0x7fa1c00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 0x7fa1c00b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa1d81004f0 tx=0x7fa1c4005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 msgr2=0x7fa1d8101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc005ab0 tx=0x7fa1cc003c10 comp rx=0 tx=0).stop 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 shutdown_connections 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d810cff0 0x7fa1d8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1c00b2880 0x7fa1c00b4d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d81044e0 0x7fa1d8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 --2- 172.21.15.82:0/197235302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d8103b90 0x7fa1d8101880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.623+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 >> 172.21.15.82:0/197235302 conn(0x7fa1d80fd6f0 msgr2=0x7fa1d80ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.624+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 shutdown_connections 2024-06-06T02:36:10.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:08.624+0000 7fa1de200640 1 -- 172.21.15.82:0/197235302 wait complete. 2024-06-06T02:36:10.790 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182479 got 107374182484 for osd.3 2024-06-06T02:36:10.791 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:10 smithi103 ceph-mon[36349]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:10 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2694280437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T02:36:10.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:10 smithi184 ceph-mon[36922]: pgmap v397: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:10.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:10 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2694280437' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-06T02:36:11.546 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070511 got 253403070514 for osd.9 2024-06-06T02:36:11.546 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:11.589 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:11 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2884236854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T02:36:11.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 -- 172.21.15.82:0/2184549661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 msgr2=0x7f8d7c111b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:11.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2184549661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c111b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009d00 tx=0x7f8d7402a910 comp rx=0 tx=0).stop 2024-06-06T02:36:11.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 -- 172.21.15.82:0/2184549661 shutdown_connections 2024-06-06T02:36:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2184549661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c111b10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2184549661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c109860 0x7f8d7c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2184549661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c104f30 0x7f8d7c105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 -- 172.21.15.82:0/2184549661 >> 172.21.15.82:0/2184549661 conn(0x7f8d7c100990 msgr2=0x7f8d7c102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:11.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 -- 172.21.15.82:0/2184549661 shutdown_connections 2024-06-06T02:36:11.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.791+0000 7f8d7be00640 1 -- 172.21.15.82:0/2184549661 wait complete. 2024-06-06T02:36:11.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.792+0000 7f8d7be00640 1 Processor -- start 2024-06-06T02:36:11.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 -- start start 2024-06-06T02:36:11.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 0x7f8d7c1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:11.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c109860 0x7f8d7c1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:11.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:11.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c114f30 con 0x7f8d7c10a1b0 2024-06-06T02:36:11.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c114db0 con 0x7f8d7c109860 2024-06-06T02:36:11.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c1150b0 con 0x7f8d7c104f30 2024-06-06T02:36:11.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c19b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51128/0 (socket says 172.21.15.82:51128) 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7b400640 1 -- 172.21.15.82:0/2018086958 learned_addr learned my addr 172.21.15.82:0/2018086958 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.793+0000 7f8d7aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 0x7f8d7c1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d72000640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c109860 0x7f8d7c1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 -- 172.21.15.82:0/2018086958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c109860 msgr2=0x7f8d7c1a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:11.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c109860 0x7f8d7c1a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 -- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 msgr2=0x7f8d7c19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 -- 172.21.15.82:0/2018086958 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c19bef0 con 0x7f8d7c104f30 2024-06-06T02:36:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.794+0000 7f8d7aa00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 0x7f8d7c1a1580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e9f0 tx=0x7f8d6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:11.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.795+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00ccc0 con 0x7f8d7c104f30 2024-06-06T02:36:11.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.795+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d6c0108e0 con 0x7f8d7c104f30 2024-06-06T02:36:11.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.795+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c018880 con 0x7f8d7c104f30 2024-06-06T02:36:11.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.795+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c19c180 con 0x7f8d7c104f30 2024-06-06T02:36:11.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.795+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1a83e0 con 0x7f8d7c104f30 2024-06-06T02:36:11.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.796+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c1063e0 con 0x7f8d7c104f30 2024-06-06T02:36:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.798+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8d6c010430 con 0x7f8d7c104f30 2024-06-06T02:36:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.800+0000 7f8d73e00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 0x7f8d600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.800+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8d6c0e2b70 con 0x7f8d7c104f30 2024-06-06T02:36:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.800+0000 7f8d72000640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 0x7f8d600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.801+0000 7f8d72000640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 0x7f8d600b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c103d10 tx=0x7f8d64005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:11.802+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d6c0aa0a0 con 0x7f8d7c104f30 2024-06-06T02:36:11.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:11 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2884236854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T02:36:11.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:11 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2884236854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-06T02:36:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.013+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8d7c10d1d0 con 0x7f8d7c104f30 2024-06-06T02:36:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.014+0000 7f8d73e00640 1 -- 172.21.15.82:0/2018086958 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d6c0ae3a0 con 0x7f8d7c104f30 2024-06-06T02:36:12.013 INFO:teuthology.orchestra.run.smithi082.stdout:55834574944 2024-06-06T02:36:12.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.016+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 msgr2=0x7f8d600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 0x7f8d600b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c103d10 tx=0x7f8d64005f30 comp rx=0 tx=0).stop 2024-06-06T02:36:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 msgr2=0x7f8d7c1a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:12.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 0x7f8d7c1a1580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e9f0 tx=0x7f8d6c00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 shutdown_connections 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d7c10a1b0 0x7f8d7c19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d7c109860 0x7f8d7c1a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8d600b2880 0x7f8d600b4d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 --2- 172.21.15.82:0/2018086958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d7c104f30 0x7f8d7c1a1580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 >> 172.21.15.82:0/2018086958 conn(0x7f8d7c100990 msgr2=0x7f8d7c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 shutdown_connections 2024-06-06T02:36:12.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:12.017+0000 7f8d7be00640 1 -- 172.21.15.82:0/2018086958 wait complete. 2024-06-06T02:36:12.100 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266739 got 227633266745 for osd.8 2024-06-06T02:36:12.100 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:12.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:12 smithi082 ceph-mon[31579]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:12.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:12 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2018086958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T02:36:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:12 smithi103 ceph-mon[36349]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:12 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2018086958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T02:36:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:12 smithi184 ceph-mon[36922]: pgmap v398: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:12 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2018086958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-06T02:36:13.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710757 got 300647710760 for osd.11 2024-06-06T02:36:13.585 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:14.130 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738463 got 34359738466 for osd.0 2024-06-06T02:36:14.130 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:14.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:14 smithi082 ceph-mon[31579]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:14.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:14 smithi103 ceph-mon[36349]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:14.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:14 smithi184 ceph-mon[36922]: pgmap v399: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:15.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 -- 172.21.15.82:0/566021029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4109850 msgr2=0x7f25b4109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:15.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 --2- 172.21.15.82:0/566021029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4109850 0x7f25b4109c60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009960 tx=0x7f25a002a460 comp rx=0 tx=0).stop 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 -- 172.21.15.82:0/566021029 shutdown_connections 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 --2- 172.21.15.82:0/566021029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 0x7f25b4111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 --2- 172.21.15.82:0/566021029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4109850 0x7f25b4109c60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 --2- 172.21.15.82:0/566021029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4104f20 0x7f25b4105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 -- 172.21.15.82:0/566021029 >> 172.21.15.82:0/566021029 conn(0x7f25b4100a00 msgr2=0x7f25b4102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 -- 172.21.15.82:0/566021029 shutdown_connections 2024-06-06T02:36:15.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.410+0000 7f25baa00640 1 -- 172.21.15.82:0/566021029 wait complete. 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.411+0000 7f25baa00640 1 Processor -- start 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.411+0000 7f25baa00640 1 -- start start 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4109850 0x7f25b41a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 0x7f25b419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4114eb0 con 0x7f25b4104f20 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4114d30 con 0x7f25b410a1a0 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25baa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f25b4115030 con 0x7f25b4109850 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25b9600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25b9600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56220/0 (socket says 172.21.15.82:56220) 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25b9600640 1 -- 172.21.15.82:0/3168609125 learned_addr learned my addr 172.21.15.82:0/3168609125 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25ba000640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 0x7f25b419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.412+0000 7f25b8c00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4109850 0x7f25b41a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 -- 172.21.15.82:0/3168609125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4109850 msgr2=0x7f25b41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4109850 0x7f25b41a1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 -- 172.21.15.82:0/3168609125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 msgr2=0x7f25b419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 0x7f25b419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 -- 172.21.15.82:0/3168609125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b419bef0 con 0x7f25b4104f20 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b9600640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e9f0 tx=0x7f25a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a800cd80 con 0x7f25b4104f20 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b419c180 con 0x7f25b4104f20 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25a80054d0 con 0x7f25b4104f20 2024-06-06T02:36:15.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b41a83e0 con 0x7f25b4104f20 2024-06-06T02:36:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.413+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a8018630 con 0x7f25b4104f20 2024-06-06T02:36:15.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.415+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b41063d0 con 0x7f25b4104f20 2024-06-06T02:36:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.417+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f25a8004e70 con 0x7f25b4104f20 2024-06-06T02:36:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.419+0000 7f25b2000640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 0x7f259c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.419+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f25a80e2ec0 con 0x7f25b4104f20 2024-06-06T02:36:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.419+0000 7f25b8c00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 0x7f259c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:15.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.420+0000 7f25b8c00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 0x7f259c0b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009230 tx=0x7f25a0005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:15.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.421+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f25a80aaa40 con 0x7f25b4104f20 2024-06-06T02:36:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.447+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f25a80a65d0 con 0x7f25b4104f20 2024-06-06T02:36:15.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.639+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f25b4105330 con 0x7f25b4104f20 2024-06-06T02:36:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.640+0000 7f25b2000640 1 -- 172.21.15.82:0/3168609125 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f25a805cfa0 con 0x7f25b4104f20 2024-06-06T02:36:15.640 INFO:teuthology.orchestra.run.smithi082.stdout:133143986256 2024-06-06T02:36:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.642+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 msgr2=0x7f259c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.642+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 0x7f259c0b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009230 tx=0x7f25a0005d50 comp rx=0 tx=0).stop 2024-06-06T02:36:15.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.642+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 msgr2=0x7f25b41a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:15.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.642+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e9f0 tx=0x7f25a800edf0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 shutdown_connections 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25b410a1a0 0x7f25b419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f259c0b2880 0x7f259c0b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25b4109850 0x7f25b41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 --2- 172.21.15.82:0/3168609125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25b4104f20 0x7f25b41a1580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 >> 172.21.15.82:0/3168609125 conn(0x7f25b4100a00 msgr2=0x7f25b4102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 shutdown_connections 2024-06-06T02:36:15.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:15.643+0000 7f25baa00640 1 -- 172.21.15.82:0/3168609125 wait complete. 2024-06-06T02:36:16.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:16 smithi082 ceph-mon[31579]: pgmap v400: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:16.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:16 smithi082 ceph-mon[31579]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-06T02:36:16.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:16 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3168609125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T02:36:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:16 smithi103 ceph-mon[36349]: pgmap v400: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:16 smithi103 ceph-mon[36349]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-06T02:36:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:16 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3168609125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T02:36:16.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:16 smithi184 ceph-mon[36922]: pgmap v400: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:16 smithi184 ceph-mon[36922]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-06-06T02:36:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:16 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3168609125' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-06T02:36:17.667 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574938 got 55834574944 for osd.1 2024-06-06T02:36:17.667 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 -- 172.21.15.82:0/1749186861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 msgr2=0x7f9bd0111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/1749186861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd0111cc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009960 tx=0x7f9bc802a460 comp rx=0 tx=0).stop 2024-06-06T02:36:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 -- 172.21.15.82:0/1749186861 shutdown_connections 2024-06-06T02:36:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/1749186861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd0111cc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/1749186861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd0109a10 0x7f9bd0109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/1749186861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd01050e0 0x7f9bd01054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 -- 172.21.15.82:0/1749186861 >> 172.21.15.82:0/1749186861 conn(0x7f9bd0100b60 msgr2=0x7f9bd0102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 -- 172.21.15.82:0/1749186861 shutdown_connections 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.311+0000 7f9bd5c00640 1 -- 172.21.15.82:0/1749186861 wait complete. 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.312+0000 7f9bd5c00640 1 Processor -- start 2024-06-06T02:36:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 -- start start 2024-06-06T02:36:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd0109a10 0x7f9bd01a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd01150a0 con 0x7f9bd010a360 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd0114f20 con 0x7f9bd0109a10 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bd5c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd0115220 con 0x7f9bd01050e0 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bcea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bcf400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bc6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd0109a10 0x7f9bd01a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.313+0000 7f9bcea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47100/0 (socket says 172.21.15.82:47100) 2024-06-06T02:36:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 -- 172.21.15.82:0/754075943 learned_addr learned my addr 172.21.15.82:0/754075943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 -- 172.21.15.82:0/754075943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd0109a10 msgr2=0x7f9bd01a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd0109a10 0x7f9bd01a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 -- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 msgr2=0x7f9bd019b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd019b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 -- 172.21.15.82:0/754075943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd019bf60 con 0x7f9bd01050e0 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.314+0000 7f9bcea00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000ebc0 tx=0x7f9bc000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.315+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0010630 con 0x7f9bd01050e0 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.315+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bc0010c80 con 0x7f9bd01050e0 2024-06-06T02:36:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.315+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd019c250 con 0x7f9bd01050e0 2024-06-06T02:36:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.315+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0018b60 con 0x7f9bd01050e0 2024-06-06T02:36:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.315+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd01a8560 con 0x7f9bd01050e0 2024-06-06T02:36:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.316+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd01054f0 con 0x7f9bd01050e0 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.318+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9bc0018d00 con 0x7f9bd01050e0 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.320+0000 7f9bc7e00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 0x7f9bb40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.320+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9bc00e2c60 con 0x7f9bd01050e0 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.320+0000 7f9bc6000640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 0x7f9bb40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.321+0000 7f9bc6000640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 0x7f9bb40b4d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0109950 tx=0x7f9bb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.322+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9bc00aa2f0 con 0x7f9bd01050e0 2024-06-06T02:36:18.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:18 smithi082 ceph-mon[31579]: pgmap v401: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:18.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.537+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9bd010d320 con 0x7f9bd01050e0 2024-06-06T02:36:18.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.538+0000 7f9bc7e00640 1 -- 172.21.15.82:0/754075943 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9bc00ae5f0 con 0x7f9bd01050e0 2024-06-06T02:36:18.539 INFO:teuthology.orchestra.run.smithi082.stdout:77309411421 2024-06-06T02:36:18.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 msgr2=0x7f9bb40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 0x7f9bb40b4d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0109950 tx=0x7f9bb800b390 comp rx=0 tx=0).stop 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 msgr2=0x7f9bd01a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bc000ebc0 tx=0x7f9bc000c6a0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 shutdown_connections 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bd010a360 0x7f9bd019b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bd0109a10 0x7f9bd01a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bb40b2870 0x7f9bb40b4d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 --2- 172.21.15.82:0/754075943 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bd01050e0 0x7f9bd01a16d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.541+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 >> 172.21.15.82:0/754075943 conn(0x7f9bd0100b60 msgr2=0x7f9bd0102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:18.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.542+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 shutdown_connections 2024-06-06T02:36:18.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.542+0000 7f9bd5c00640 1 -- 172.21.15.82:0/754075943 wait complete. 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 -- 172.21.15.82:0/187984609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 msgr2=0x7fd4b8111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 --2- 172.21.15.82:0/187984609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b8111ce0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0009c10 tx=0x7fd4b002a6f0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 -- 172.21.15.82:0/187984609 shutdown_connections 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 --2- 172.21.15.82:0/187984609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b8111ce0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 --2- 172.21.15.82:0/187984609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8109a30 0x7fd4b8109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 --2- 172.21.15.82:0/187984609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8105100 0x7fd4b8105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.835+0000 7fd4bf800640 1 -- 172.21.15.82:0/187984609 >> 172.21.15.82:0/187984609 conn(0x7fd4b8100b60 msgr2=0x7fd4b8102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:18.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.836+0000 7fd4bf800640 1 -- 172.21.15.82:0/187984609 shutdown_connections 2024-06-06T02:36:18.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.836+0000 7fd4bf800640 1 -- 172.21.15.82:0/187984609 wait complete. 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.837+0000 7fd4bf800640 1 Processor -- start 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.837+0000 7fd4bf800640 1 -- start start 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8105100 0x7fd4b81a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b81150a0 con 0x7fd4b8109a30 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8114f20 con 0x7fd4b810a380 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bf800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8115220 con 0x7fd4b8105100 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56258/0 (socket says 172.21.15.82:56258) 2024-06-06T02:36:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 -- 172.21.15.82:0/2782166044 learned_addr learned my addr 172.21.15.82:0/2782166044 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bce00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8105100 0x7fd4b81a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4bd800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 -- 172.21.15.82:0/2782166044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8105100 msgr2=0x7fd4b81a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8105100 0x7fd4b81a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 -- 172.21.15.82:0/2782166044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 msgr2=0x7fd4b819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.838+0000 7fd4b7e00640 1 -- 172.21.15.82:0/2782166044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b819bf20 con 0x7fd4b8109a30 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4b7e00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400d950 tx=0x7fd4a400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4017070 con 0x7fd4b8109a30 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b819c210 con 0x7fd4b8109a30 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a4009c30 con 0x7fd4b8109a30 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40047a0 con 0x7fd4b8109a30 2024-06-06T02:36:18.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.839+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b81a8520 con 0x7fd4b8109a30 2024-06-06T02:36:18.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.840+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8105510 con 0x7fd4b8109a30 2024-06-06T02:36:18.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.844+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd4a4004020 con 0x7fd4b8109a30 2024-06-06T02:36:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.845+0000 7fd4b5600640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 0x7fd4a00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.845+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd4a40e2210 con 0x7fd4b8109a30 2024-06-06T02:36:18.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.845+0000 7fd4bce00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 0x7fd4a00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:18.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.846+0000 7fd4bce00640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 0x7fd4a00b4d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd4b819c9f0 tx=0x7fd4ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:18.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:18.849+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd4a4020020 con 0x7fd4b8109a30 2024-06-06T02:36:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:18 smithi103 ceph-mon[36349]: pgmap v401: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:18.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:18 smithi184 ceph-mon[36922]: pgmap v401: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:19.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.048+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd4b810d340 con 0x7fd4b8109a30 2024-06-06T02:36:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.049+0000 7fd4b5600640 1 -- 172.21.15.82:0/2782166044 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd4a40a9ef0 con 0x7fd4b8109a30 2024-06-06T02:36:19.049 INFO:teuthology.orchestra.run.smithi082.stdout:274877906991 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 msgr2=0x7fd4a00b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 0x7fd4a00b4d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd4b819c9f0 tx=0x7fd4ac009260 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 msgr2=0x7fd4b81a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400d950 tx=0x7fd4a400dd50 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 shutdown_connections 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4b810a380 0x7fd4b819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4b8109a30 0x7fd4b81a1bd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd4a00b2870 0x7fd4a00b4d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 --2- 172.21.15.82:0/2782166044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4b8105100 0x7fd4b81a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.051+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 >> 172.21.15.82:0/2782166044 conn(0x7fd4b8100b60 msgr2=0x7fd4b81011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.052+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 shutdown_connections 2024-06-06T02:36:19.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.052+0000 7fd4bf800640 1 -- 172.21.15.82:0/2782166044 wait complete. 2024-06-06T02:36:19.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:19 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/754075943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T02:36:19.576 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:19 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2782166044' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T02:36:19.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 -- 172.21.15.82:0/3939782767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d410dc40 msgr2=0x7f91d410e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 --2- 172.21.15.82:0/3939782767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d410dc40 0x7f91d410e050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009930 tx=0x7f91c002a420 comp rx=0 tx=0).stop 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 -- 172.21.15.82:0/3939782767 shutdown_connections 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 --2- 172.21.15.82:0/3939782767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410e590 0x7f91d4115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 --2- 172.21.15.82:0/3939782767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d410dc40 0x7f91d410e050 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 --2- 172.21.15.82:0/3939782767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d4109310 0x7f91d4109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 -- 172.21.15.82:0/3939782767 >> 172.21.15.82:0/3939782767 conn(0x7f91d4078a80 msgr2=0x7f91d4107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 -- 172.21.15.82:0/3939782767 shutdown_connections 2024-06-06T02:36:19.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.779+0000 7f91d9e00640 1 -- 172.21.15.82:0/3939782767 wait complete. 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.780+0000 7f91d9e00640 1 Processor -- start 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 -- start start 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410dc40 0x7f91d41a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d410e590 0x7f91d41a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91d41192d0 con 0x7f91d410dc40 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4119150 con 0x7f91d4109310 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f91d4119450 con 0x7f91d410e590 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41146/0 (socket says 172.21.15.82:41146) 2024-06-06T02:36:19.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d8a00640 1 -- 172.21.15.82:0/2083511531 learned_addr learned my addr 172.21.15.82:0/2083511531 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d3e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410dc40 0x7f91d41a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.781+0000 7f91d9400640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d410e590 0x7f91d41a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 -- 172.21.15.82:0/2083511531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d410e590 msgr2=0x7f91d41a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d410e590 0x7f91d41a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 -- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410dc40 msgr2=0x7f91d41a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410dc40 0x7f91d41a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 -- 172.21.15.82:0/2083511531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d41a4bc0 con 0x7f91d4109310 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d8a00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91c800ea20 tx=0x7f91c800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.782+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c800ccc0 con 0x7f91d4109310 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.783+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91c800ce60 con 0x7f91d4109310 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.783+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8010430 con 0x7f91d4109310 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.783+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d41a4eb0 con 0x7f91d4109310 2024-06-06T02:36:19.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.783+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d41a5370 con 0x7f91d4109310 2024-06-06T02:36:19.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.784+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d410a7c0 con 0x7f91d4109310 2024-06-06T02:36:19.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.786+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f91c8004fa0 con 0x7f91d4109310 2024-06-06T02:36:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.788+0000 7f91d1600640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 0x7f91bc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.788+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f91c80e2590 con 0x7f91d4109310 2024-06-06T02:36:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.788+0000 7f91d3e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 0x7f91bc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:19.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.789+0000 7f91d3e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 0x7f91bc0b4d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91c002a940 tx=0x7f91c0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:19.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:19.792+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f91c80aa270 con 0x7f91d4109310 2024-06-06T02:36:19.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:19 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/754075943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T02:36:19.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:19 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2782166044' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T02:36:19.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:19 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/754075943' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-06T02:36:19.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:19 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2782166044' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-06T02:36:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.006+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f91d4109720 con 0x7f91d4109310 2024-06-06T02:36:20.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.007+0000 7f91d1600640 1 -- 172.21.15.82:0/2083511531 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f91d4109720 con 0x7f91d4109310 2024-06-06T02:36:20.007 INFO:teuthology.orchestra.run.smithi082.stdout:180388626503 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.010+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 msgr2=0x7f91bc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.010+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 0x7f91bc0b4d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f91c002a940 tx=0x7f91c0005a40 comp rx=0 tx=0).stop 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 msgr2=0x7f91d419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f91c800ea20 tx=0x7f91c800ee20 comp rx=0 tx=0).stop 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 shutdown_connections 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f91bc0b2870 0x7f91bc0b4d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91d410e590 0x7f91d41a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d410dc40 0x7f91d41a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 --2- 172.21.15.82:0/2083511531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91d4109310 0x7f91d419fd50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 >> 172.21.15.82:0/2083511531 conn(0x7f91d4078a80 msgr2=0x7f91d4079170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 shutdown_connections 2024-06-06T02:36:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:20.011+0000 7f91d9e00640 1 -- 172.21.15.82:0/2083511531 wait complete. 2024-06-06T02:36:20.673 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411416 got 77309411421 for osd.2 2024-06-06T02:36:20.673 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:20.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:20 smithi082 ceph-mon[31579]: pgmap v402: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:20.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:20 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2083511531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T02:36:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:20 smithi103 ceph-mon[36349]: pgmap v402: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:20 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2083511531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T02:36:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:20 smithi184 ceph-mon[36922]: pgmap v402: 97 pgs: 97 active+clean; 643 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:20 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2083511531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-06T02:36:21.257 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986248 got 133143986256 for osd.4 2024-06-06T02:36:21.258 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:21.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626496 got 180388626503 for osd.6 2024-06-06T02:36:21.732 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:22.398 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906986 got 274877906991 for osd.10 2024-06-06T02:36:22.399 DEBUG:teuthology.parallel:result is None 2024-06-06T02:36:22.399 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-06T02:36:22.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T02:36:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:22 smithi082 ceph-mon[31579]: pgmap v403: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:22 smithi103 ceph-mon[36349]: pgmap v403: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:22.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:22 smithi184 ceph-mon[36922]: pgmap v403: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:24 smithi082 ceph-mon[31579]: pgmap v404: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:36:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:24 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:24 smithi103 ceph-mon[36349]: pgmap v404: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:36:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:24 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:24 smithi184 ceph-mon[36922]: pgmap v404: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:36:24.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:24 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.897+0000 7f2daf600640 1 -- 172.21.15.82:0/2067599525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8075620 msgr2=0x7f2da810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.897+0000 7f2daf600640 1 --2- 172.21.15.82:0/2067599525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8075620 0x7f2da810ef50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009900 tx=0x7f2d9402a480 comp rx=0 tx=0).stop 2024-06-06T02:36:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 -- 172.21.15.82:0/2067599525 shutdown_connections 2024-06-06T02:36:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 --2- 172.21.15.82:0/2067599525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 0x7f2da81118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:24.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 --2- 172.21.15.82:0/2067599525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8075620 0x7f2da810ef50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 --2- 172.21.15.82:0/2067599525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8074cd0 0x7f2da80750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 -- 172.21.15.82:0/2067599525 >> 172.21.15.82:0/2067599525 conn(0x7f2da8079d40 msgr2=0x7f2da807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 -- 172.21.15.82:0/2067599525 shutdown_connections 2024-06-06T02:36:24.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.898+0000 7f2daf600640 1 -- 172.21.15.82:0/2067599525 wait complete. 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.899+0000 7f2daf600640 1 Processor -- start 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.899+0000 7f2daf600640 1 -- start start 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8075620 0x7f2da81030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 0x7f2da8103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8115060 con 0x7f2da8074cd0 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8114ee0 con 0x7f2da810f490 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2daf600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2da81151e0 con 0x7f2da8075620 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2dacc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2dacc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57692/0 (socket says 172.21.15.82:57692) 2024-06-06T02:36:24.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2dacc00640 1 -- 172.21.15.82:0/881889075 learned_addr learned my addr 172.21.15.82:0/881889075 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2da7e00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8075620 0x7f2da81030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.900+0000 7f2dad600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 0x7f2da8103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 -- 172.21.15.82:0/881889075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8075620 msgr2=0x7f2da81030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8075620 0x7f2da81030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 -- 172.21.15.82:0/881889075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 msgr2=0x7f2da8103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 0x7f2da8103630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 -- 172.21.15.82:0/881889075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da81ac0a0 con 0x7f2da8074cd0 2024-06-06T02:36:24.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2dacc00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e9f0 tx=0x7f2d9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00ccc0 con 0x7f2da8074cd0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d9c00ce60 con 0x7f2da8074cd0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c010430 con 0x7f2da8074cd0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.901+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da81ac330 con 0x7f2da8074cd0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.902+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da81ac7f0 con 0x7f2da8074cd0 2024-06-06T02:36:24.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.903+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da8076240 con 0x7f2da8074cd0 2024-06-06T02:36:24.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.905+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2d9c0046c0 con 0x7f2da8074cd0 2024-06-06T02:36:24.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.906+0000 7f2da5600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 0x7f2d900b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.907+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2d9c0e2630 con 0x7f2da8074cd0 2024-06-06T02:36:24.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.907+0000 7f2da7e00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 0x7f2d900b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:24.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.908+0000 7f2da7e00640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 0x7f2d900b4d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d94031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:24.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:24.911+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2d9c0aa310 con 0x7f2da8074cd0 2024-06-06T02:36:25.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.130+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2da8062ba0 con 0x7f2d900b27f0 2024-06-06T02:36:25.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.145+0000 7f2da5600640 1 -- 172.21.15.82:0/881889075 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259118 (secure 0 0 0) 0x7f2da8062ba0 con 0x7f2d900b27f0 2024-06-06T02:36:25.152 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:36:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 msgr2=0x7f2d900b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 0x7f2d900b4d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d94031400 comp rx=0 tx=0).stop 2024-06-06T02:36:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 msgr2=0x7f2da8102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e9f0 tx=0x7f2d9c00edf0 comp rx=0 tx=0).stop 2024-06-06T02:36:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 shutdown_connections 2024-06-06T02:36:25.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da810f490 0x7f2da8103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2d900b27f0 0x7f2d900b4d00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2da8075620 0x7f2da81030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.151+0000 7f2daf600640 1 --2- 172.21.15.82:0/881889075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2da8074cd0 0x7f2da8102bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:25.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.152+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 >> 172.21.15.82:0/881889075 conn(0x7f2da8079d40 msgr2=0x7f2da80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.152+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 shutdown_connections 2024-06-06T02:36:25.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:25.152+0000 7f2daf600640 1 -- 172.21.15.82:0/881889075 wait complete. 2024-06-06T02:36:25.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:36:25.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:36:25.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:25 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:25.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:36:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:36:25.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:25 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:25.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:36:25.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:36:25.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:25 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:36:25.966 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":405,"stamp":"2024-06-06T02:36:24.822083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658671,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":821,"num_read_kb":508,"num_write":296,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359808,"kb_used_data":10656,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582016,"statfs":{"total":1151940427776,"available":1151571984384,"internally_reserved":0,"allocated":10911744,"data_stored":7071537,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":41,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004863"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763442+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:36:14.763442+0000","last_peered":"2024-06-06T02:36:14.763442+0000","last_clean":"2024-06-06T02:36:14.763442+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:36:14.763442+0000","last_undegraded":"2024-06-06T02:36:14.763442+0000","last_fullsized":"2024-06-06T02:36:14.763442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759693+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:36:14.759693+0000","last_peered":"2024-06-06T02:36:14.759693+0000","last_clean":"2024-06-06T02:36:14.759693+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:36:14.759693+0000","last_undegraded":"2024-06-06T02:36:14.759693+0000","last_fullsized":"2024-06-06T02:36:14.759693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761379+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:36:14.761379+0000","last_peered":"2024-06-06T02:36:14.761379+0000","last_clean":"2024-06-06T02:36:14.761379+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:36:14.761379+0000","last_undegraded":"2024-06-06T02:36:14.761379+0000","last_fullsized":"2024-06-06T02:36:14.761379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.726838+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:36:14.726838+0000","last_peered":"2024-06-06T02:36:14.726838+0000","last_clean":"2024-06-06T02:36:14.726838+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:36:14.726838+0000","last_undegraded":"2024-06-06T02:36:14.726838+0000","last_fullsized":"2024-06-06T02:36:14.726838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.743278+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:36:14.743278+0000","last_peered":"2024-06-06T02:36:14.743278+0000","last_clean":"2024-06-06T02:36:14.743278+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:36:14.743278+0000","last_undegraded":"2024-06-06T02:36:14.743278+0000","last_fullsized":"2024-06-06T02:36:14.743278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759424+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:36:14.759424+0000","last_peered":"2024-06-06T02:36:14.759424+0000","last_clean":"2024-06-06T02:36:14.759424+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:36:14.759424+0000","last_undegraded":"2024-06-06T02:36:14.759424+0000","last_fullsized":"2024-06-06T02:36:14.759424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.723672+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:36:14.723672+0000","last_peered":"2024-06-06T02:36:14.723672+0000","last_clean":"2024-06-06T02:36:14.723672+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:36:14.723672+0000","last_undegraded":"2024-06-06T02:36:14.723672+0000","last_fullsized":"2024-06-06T02:36:14.723672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758819+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:36:14.758819+0000","last_peered":"2024-06-06T02:36:14.758819+0000","last_clean":"2024-06-06T02:36:14.758819+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:36:14.758819+0000","last_undegraded":"2024-06-06T02:36:14.758819+0000","last_fullsized":"2024-06-06T02:36:14.758819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729880+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:36:14.729880+0000","last_peered":"2024-06-06T02:36:14.729880+0000","last_clean":"2024-06-06T02:36:14.729880+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:36:14.729880+0000","last_undegraded":"2024-06-06T02:36:14.729880+0000","last_fullsized":"2024-06-06T02:36:14.729880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733731+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:36:14.733731+0000","last_peered":"2024-06-06T02:36:14.733731+0000","last_clean":"2024-06-06T02:36:14.733731+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:36:14.733731+0000","last_undegraded":"2024-06-06T02:36:14.733731+0000","last_fullsized":"2024-06-06T02:36:14.733731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730896+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:36:14.730896+0000","last_peered":"2024-06-06T02:36:14.730896+0000","last_clean":"2024-06-06T02:36:14.730896+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:36:14.730896+0000","last_undegraded":"2024-06-06T02:36:14.730896+0000","last_fullsized":"2024-06-06T02:36:14.730896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729221+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:36:14.729221+0000","last_peered":"2024-06-06T02:36:14.729221+0000","last_clean":"2024-06-06T02:36:14.729221+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:36:14.729221+0000","last_undegraded":"2024-06-06T02:36:14.729221+0000","last_fullsized":"2024-06-06T02:36:14.729221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770677+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:36:14.770677+0000","last_peered":"2024-06-06T02:36:14.770677+0000","last_clean":"2024-06-06T02:36:14.770677+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:36:14.770677+0000","last_undegraded":"2024-06-06T02:36:14.770677+0000","last_fullsized":"2024-06-06T02:36:14.770677+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764529+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:36:14.764529+0000","last_peered":"2024-06-06T02:36:14.764529+0000","last_clean":"2024-06-06T02:36:14.764529+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:36:14.764529+0000","last_undegraded":"2024-06-06T02:36:14.764529+0000","last_fullsized":"2024-06-06T02:36:14.764529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760237+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:36:14.760237+0000","last_peered":"2024-06-06T02:36:14.760237+0000","last_clean":"2024-06-06T02:36:14.760237+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:36:14.760237+0000","last_undegraded":"2024-06-06T02:36:14.760237+0000","last_fullsized":"2024-06-06T02:36:14.760237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760967+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:36:14.760967+0000","last_peered":"2024-06-06T02:36:14.760967+0000","last_clean":"2024-06-06T02:36:14.760967+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:36:14.760967+0000","last_undegraded":"2024-06-06T02:36:14.760967+0000","last_fullsized":"2024-06-06T02:36:14.760967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763688+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:36:14.763688+0000","last_peered":"2024-06-06T02:36:14.763688+0000","last_clean":"2024-06-06T02:36:14.763688+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:36:14.763688+0000","last_undegraded":"2024-06-06T02:36:14.763688+0000","last_fullsized":"2024-06-06T02:36:14.763688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758949+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:36:14.758949+0000","last_peered":"2024-06-06T02:36:14.758949+0000","last_clean":"2024-06-06T02:36:14.758949+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:36:14.758949+0000","last_undegraded":"2024-06-06T02:36:14.758949+0000","last_fullsized":"2024-06-06T02:36:14.758949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768309+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:36:14.768309+0000","last_peered":"2024-06-06T02:36:14.768309+0000","last_clean":"2024-06-06T02:36:14.768309+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:36:14.768309+0000","last_undegraded":"2024-06-06T02:36:14.768309+0000","last_fullsized":"2024-06-06T02:36:14.768309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.757382+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:36:14.757382+0000","last_peered":"2024-06-06T02:36:14.757382+0000","last_clean":"2024-06-06T02:36:14.757382+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:36:14.757382+0000","last_undegraded":"2024-06-06T02:36:14.757382+0000","last_fullsized":"2024-06-06T02:36:14.757382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770574+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:36:14.770574+0000","last_peered":"2024-06-06T02:36:14.770574+0000","last_clean":"2024-06-06T02:36:14.770574+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:36:14.770574+0000","last_undegraded":"2024-06-06T02:36:14.770574+0000","last_fullsized":"2024-06-06T02:36:14.770574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.749670+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:36:14.749670+0000","last_peered":"2024-06-06T02:36:14.749670+0000","last_clean":"2024-06-06T02:36:14.749670+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:36:14.749670+0000","last_undegraded":"2024-06-06T02:36:14.749670+0000","last_fullsized":"2024-06-06T02:36:14.749670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.750612+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:36:14.750612+0000","last_peered":"2024-06-06T02:36:14.750612+0000","last_clean":"2024-06-06T02:36:14.750612+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:36:14.750612+0000","last_undegraded":"2024-06-06T02:36:14.750612+0000","last_fullsized":"2024-06-06T02:36:14.750612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.741918+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:36:14.741918+0000","last_peered":"2024-06-06T02:36:14.741918+0000","last_clean":"2024-06-06T02:36:14.741918+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:36:14.741918+0000","last_undegraded":"2024-06-06T02:36:14.741918+0000","last_fullsized":"2024-06-06T02:36:14.741918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748548+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:36:14.748548+0000","last_peered":"2024-06-06T02:36:14.748548+0000","last_clean":"2024-06-06T02:36:14.748548+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:36:14.748548+0000","last_undegraded":"2024-06-06T02:36:14.748548+0000","last_fullsized":"2024-06-06T02:36:14.748548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733052+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:36:14.733052+0000","last_peered":"2024-06-06T02:36:14.733052+0000","last_clean":"2024-06-06T02:36:14.733052+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:36:14.733052+0000","last_undegraded":"2024-06-06T02:36:14.733052+0000","last_fullsized":"2024-06-06T02:36:14.733052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.756951+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:36:14.756951+0000","last_peered":"2024-06-06T02:36:14.756951+0000","last_clean":"2024-06-06T02:36:14.756951+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:36:14.756951+0000","last_undegraded":"2024-06-06T02:36:14.756951+0000","last_fullsized":"2024-06-06T02:36:14.756951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768068+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:36:14.768068+0000","last_peered":"2024-06-06T02:36:14.768068+0000","last_clean":"2024-06-06T02:36:14.768068+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:36:14.768068+0000","last_undegraded":"2024-06-06T02:36:14.768068+0000","last_fullsized":"2024-06-06T02:36:14.768068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765237+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:36:14.765237+0000","last_peered":"2024-06-06T02:36:14.765237+0000","last_clean":"2024-06-06T02:36:14.765237+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:36:14.765237+0000","last_undegraded":"2024-06-06T02:36:14.765237+0000","last_fullsized":"2024-06-06T02:36:14.765237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748846+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:36:14.748846+0000","last_peered":"2024-06-06T02:36:14.748846+0000","last_clean":"2024-06-06T02:36:14.748846+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:36:14.748846+0000","last_undegraded":"2024-06-06T02:36:14.748846+0000","last_fullsized":"2024-06-06T02:36:14.748846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768337+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:36:14.768337+0000","last_peered":"2024-06-06T02:36:14.768337+0000","last_clean":"2024-06-06T02:36:14.768337+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:36:14.768337+0000","last_undegraded":"2024-06-06T02:36:14.768337+0000","last_fullsized":"2024-06-06T02:36:14.768337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729331+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:36:14.729331+0000","last_peered":"2024-06-06T02:36:14.729331+0000","last_clean":"2024-06-06T02:36:14.729331+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:36:14.729331+0000","last_undegraded":"2024-06-06T02:36:14.729331+0000","last_fullsized":"2024-06-06T02:36:14.729331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.754135+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:36:14.754135+0000","last_peered":"2024-06-06T02:36:14.754135+0000","last_clean":"2024-06-06T02:36:14.754135+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:36:14.754135+0000","last_undegraded":"2024-06-06T02:36:14.754135+0000","last_fullsized":"2024-06-06T02:36:14.754135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:21.143833+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:36:21.143833+0000","last_peered":"2024-06-06T02:36:21.143833+0000","last_clean":"2024-06-06T02:36:21.143833+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:36:21.143833+0000","last_undegraded":"2024-06-06T02:36:21.143833+0000","last_fullsized":"2024-06-06T02:36:21.143833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746277+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:36:14.746277+0000","last_peered":"2024-06-06T02:36:14.746277+0000","last_clean":"2024-06-06T02:36:14.746277+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:36:14.746277+0000","last_undegraded":"2024-06-06T02:36:14.746277+0000","last_fullsized":"2024-06-06T02:36:14.746277+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925035+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925035+0000","last_peered":"2024-06-06T02:34:21.925035+0000","last_clean":"2024-06-06T02:34:21.925035+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925035+0000","last_undegraded":"2024-06-06T02:34:21.925035+0000","last_fullsized":"2024-06-06T02:34:21.925035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.926067+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.926067+0000","last_peered":"2024-06-06T02:34:21.926067+0000","last_clean":"2024-06-06T02:34:21.926067+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.926067+0000","last_undegraded":"2024-06-06T02:34:21.926067+0000","last_fullsized":"2024-06-06T02:34:21.926067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768884+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:36:14.768884+0000","last_peered":"2024-06-06T02:36:14.768884+0000","last_clean":"2024-06-06T02:36:14.768884+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:36:14.768884+0000","last_undegraded":"2024-06-06T02:36:14.768884+0000","last_fullsized":"2024-06-06T02:36:14.768884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906263+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:20.906263+0000","last_peered":"2024-06-06T02:34:20.906263+0000","last_clean":"2024-06-06T02:34:20.906263+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:20.906263+0000","last_undegraded":"2024-06-06T02:34:20.906263+0000","last_fullsized":"2024-06-06T02:34:20.906263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759582+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:36:14.759582+0000","last_peered":"2024-06-06T02:36:14.759582+0000","last_clean":"2024-06-06T02:36:14.759582+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:36:14.759582+0000","last_undegraded":"2024-06-06T02:36:14.759582+0000","last_fullsized":"2024-06-06T02:36:14.759582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:24.148075+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:36:24.148075+0000","last_peered":"2024-06-06T02:36:24.148075+0000","last_clean":"2024-06-06T02:36:24.148075+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:36:24.148075+0000","last_undegraded":"2024-06-06T02:36:24.148075+0000","last_fullsized":"2024-06-06T02:36:24.148075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753187+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:36:14.753187+0000","last_peered":"2024-06-06T02:36:14.753187+0000","last_clean":"2024-06-06T02:36:14.753187+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:36:14.753187+0000","last_undegraded":"2024-06-06T02:36:14.753187+0000","last_fullsized":"2024-06-06T02:36:14.753187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905669+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905669+0000","last_peered":"2024-06-06T02:34:20.905669+0000","last_clean":"2024-06-06T02:34:20.905669+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905669+0000","last_undegraded":"2024-06-06T02:34:20.905669+0000","last_fullsized":"2024-06-06T02:34:20.905669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765785+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:36:14.765785+0000","last_peered":"2024-06-06T02:36:14.765785+0000","last_clean":"2024-06-06T02:36:14.765785+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:36:14.765785+0000","last_undegraded":"2024-06-06T02:36:14.765785+0000","last_fullsized":"2024-06-06T02:36:14.765785+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.947496+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:24.947496+0000","last_peered":"2024-06-06T02:34:24.947496+0000","last_clean":"2024-06-06T02:34:24.947496+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:24.947496+0000","last_undegraded":"2024-06-06T02:34:24.947496+0000","last_fullsized":"2024-06-06T02:34:24.947496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.732777+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:36:14.732777+0000","last_peered":"2024-06-06T02:36:14.732777+0000","last_clean":"2024-06-06T02:36:14.732777+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:36:14.732777+0000","last_undegraded":"2024-06-06T02:36:14.732777+0000","last_fullsized":"2024-06-06T02:36:14.732777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:24.248162+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:36:24.248162+0000","last_peered":"2024-06-06T02:36:24.248162+0000","last_clean":"2024-06-06T02:36:24.248162+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:36:24.248162+0000","last_undegraded":"2024-06-06T02:36:24.248162+0000","last_fullsized":"2024-06-06T02:36:24.248162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":253,"num_read_kb":189,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.721075+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:36:14.721075+0000","last_peered":"2024-06-06T02:36:14.721075+0000","last_clean":"2024-06-06T02:36:14.721075+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:36:14.721075+0000","last_undegraded":"2024-06-06T02:36:14.721075+0000","last_fullsized":"2024-06-06T02:36:14.721075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944283+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:24.944283+0000","last_peered":"2024-06-06T02:34:24.944283+0000","last_clean":"2024-06-06T02:34:24.944283+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:24.944283+0000","last_undegraded":"2024-06-06T02:34:24.944283+0000","last_fullsized":"2024-06-06T02:34:24.944283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769779+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:36:14.769779+0000","last_peered":"2024-06-06T02:36:14.769779+0000","last_clean":"2024-06-06T02:36:14.769779+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:36:14.769779+0000","last_undegraded":"2024-06-06T02:36:14.769779+0000","last_fullsized":"2024-06-06T02:36:14.769779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911833+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911833+0000","last_peered":"2024-06-06T02:34:20.911833+0000","last_clean":"2024-06-06T02:34:20.911833+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911833+0000","last_undegraded":"2024-06-06T02:34:20.911833+0000","last_fullsized":"2024-06-06T02:34:20.911833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764292+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:36:14.764292+0000","last_peered":"2024-06-06T02:36:14.764292+0000","last_clean":"2024-06-06T02:36:14.764292+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:36:14.764292+0000","last_undegraded":"2024-06-06T02:36:14.764292+0000","last_fullsized":"2024-06-06T02:36:14.764292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:22.212757+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:36:22.212757+0000","last_peered":"2024-06-06T02:36:22.212757+0000","last_clean":"2024-06-06T02:36:22.212757+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:36:22.212757+0000","last_undegraded":"2024-06-06T02:36:22.212757+0000","last_fullsized":"2024-06-06T02:36:22.212757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.704921+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:36:14.704921+0000","last_peered":"2024-06-06T02:36:14.704921+0000","last_clean":"2024-06-06T02:36:14.704921+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:36:14.704921+0000","last_undegraded":"2024-06-06T02:36:14.704921+0000","last_fullsized":"2024-06-06T02:36:14.704921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945265+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:24.945265+0000","last_peered":"2024-06-06T02:34:24.945265+0000","last_clean":"2024-06-06T02:34:24.945265+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:24.945265+0000","last_undegraded":"2024-06-06T02:34:24.945265+0000","last_fullsized":"2024-06-06T02:34:24.945265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730992+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:36:14.730992+0000","last_peered":"2024-06-06T02:36:14.730992+0000","last_clean":"2024-06-06T02:36:14.730992+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:36:14.730992+0000","last_undegraded":"2024-06-06T02:36:14.730992+0000","last_fullsized":"2024-06-06T02:36:14.730992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944016+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:24.944016+0000","last_peered":"2024-06-06T02:34:24.944016+0000","last_clean":"2024-06-06T02:34:24.944016+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:24.944016+0000","last_undegraded":"2024-06-06T02:34:24.944016+0000","last_fullsized":"2024-06-06T02:34:24.944016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725464+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:36:14.725464+0000","last_peered":"2024-06-06T02:36:14.725464+0000","last_clean":"2024-06-06T02:36:14.725464+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:36:14.725464+0000","last_undegraded":"2024-06-06T02:36:14.725464+0000","last_fullsized":"2024-06-06T02:36:14.725464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841147+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.841147+0000","last_peered":"2024-06-06T02:34:15.841147+0000","last_clean":"2024-06-06T02:34:15.841147+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.841147+0000","last_undegraded":"2024-06-06T02:34:15.841147+0000","last_fullsized":"2024-06-06T02:34:15.841147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.724592+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:36:14.724592+0000","last_peered":"2024-06-06T02:36:14.724592+0000","last_clean":"2024-06-06T02:36:14.724592+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:36:14.724592+0000","last_undegraded":"2024-06-06T02:36:14.724592+0000","last_fullsized":"2024-06-06T02:36:14.724592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944251+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:24.944251+0000","last_peered":"2024-06-06T02:34:24.944251+0000","last_clean":"2024-06-06T02:34:24.944251+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944251+0000","last_undegraded":"2024-06-06T02:34:24.944251+0000","last_fullsized":"2024-06-06T02:34:24.944251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752315+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:36:14.752315+0000","last_peered":"2024-06-06T02:36:14.752315+0000","last_clean":"2024-06-06T02:36:14.752315+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:36:14.752315+0000","last_undegraded":"2024-06-06T02:36:14.752315+0000","last_fullsized":"2024-06-06T02:36:14.752315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948916+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:24.948916+0000","last_peered":"2024-06-06T02:34:24.948916+0000","last_clean":"2024-06-06T02:34:24.948916+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:24.948916+0000","last_undegraded":"2024-06-06T02:34:24.948916+0000","last_fullsized":"2024-06-06T02:34:24.948916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731854+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:36:14.731854+0000","last_peered":"2024-06-06T02:36:14.731854+0000","last_clean":"2024-06-06T02:36:14.731854+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:36:14.731854+0000","last_undegraded":"2024-06-06T02:36:14.731854+0000","last_fullsized":"2024-06-06T02:36:14.731854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846183+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:34:15.846183+0000","last_peered":"2024-06-06T02:34:15.846183+0000","last_clean":"2024-06-06T02:34:15.846183+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:34:15.846183+0000","last_undegraded":"2024-06-06T02:34:15.846183+0000","last_fullsized":"2024-06-06T02:34:15.846183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945512+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945512+0000","last_peered":"2024-06-06T02:34:24.945512+0000","last_clean":"2024-06-06T02:34:24.945512+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945512+0000","last_undegraded":"2024-06-06T02:34:24.945512+0000","last_fullsized":"2024-06-06T02:34:24.945512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746789+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:36:14.746789+0000","last_peered":"2024-06-06T02:36:14.746789+0000","last_clean":"2024-06-06T02:36:14.746789+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:36:14.746789+0000","last_undegraded":"2024-06-06T02:36:14.746789+0000","last_fullsized":"2024-06-06T02:36:14.746789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916830+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:34:21.916830+0000","last_peered":"2024-06-06T02:34:21.916830+0000","last_clean":"2024-06-06T02:34:21.916830+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:34:21.916830+0000","last_undegraded":"2024-06-06T02:34:21.916830+0000","last_fullsized":"2024-06-06T02:34:21.916830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763060+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:36:14.763060+0000","last_peered":"2024-06-06T02:36:14.763060+0000","last_clean":"2024-06-06T02:36:14.763060+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:36:14.763060+0000","last_undegraded":"2024-06-06T02:36:14.763060+0000","last_fullsized":"2024-06-06T02:36:14.763060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":148,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:20.207081+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:36:20.207081+0000","last_peered":"2024-06-06T02:36:20.207081+0000","last_clean":"2024-06-06T02:36:20.207081+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:36:20.207081+0000","last_undegraded":"2024-06-06T02:36:20.207081+0000","last_fullsized":"2024-06-06T02:36:20.207081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.712511+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:36:14.712511+0000","last_peered":"2024-06-06T02:36:14.712511+0000","last_clean":"2024-06-06T02:36:14.712511+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:36:14.712511+0000","last_undegraded":"2024-06-06T02:36:14.712511+0000","last_fullsized":"2024-06-06T02:36:14.712511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924916+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:21.924916+0000","last_peered":"2024-06-06T02:34:21.924916+0000","last_clean":"2024-06-06T02:34:21.924916+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:21.924916+0000","last_undegraded":"2024-06-06T02:34:21.924916+0000","last_fullsized":"2024-06-06T02:34:21.924916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761273+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:36:14.761273+0000","last_peered":"2024-06-06T02:36:14.761273+0000","last_clean":"2024-06-06T02:36:14.761273+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:36:14.761273+0000","last_undegraded":"2024-06-06T02:36:14.761273+0000","last_fullsized":"2024-06-06T02:36:14.761273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855684+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855684+0000","last_peered":"2024-06-06T02:34:15.855684+0000","last_clean":"2024-06-06T02:34:15.855684+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855684+0000","last_undegraded":"2024-06-06T02:34:15.855684+0000","last_fullsized":"2024-06-06T02:34:15.855684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763995+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:36:14.763995+0000","last_peered":"2024-06-06T02:36:14.763995+0000","last_clean":"2024-06-06T02:36:14.763995+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:36:14.763995+0000","last_undegraded":"2024-06-06T02:36:14.763995+0000","last_fullsized":"2024-06-06T02:36:14.763995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945270+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:24.945270+0000","last_peered":"2024-06-06T02:34:24.945270+0000","last_clean":"2024-06-06T02:34:24.945270+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:24.945270+0000","last_undegraded":"2024-06-06T02:34:24.945270+0000","last_fullsized":"2024-06-06T02:34:24.945270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767660+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:36:14.767660+0000","last_peered":"2024-06-06T02:36:14.767660+0000","last_clean":"2024-06-06T02:36:14.767660+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:36:14.767660+0000","last_undegraded":"2024-06-06T02:36:14.767660+0000","last_fullsized":"2024-06-06T02:36:14.767660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:09.942136+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:36:09.942136+0000","last_peered":"2024-06-06T02:36:09.942136+0000","last_clean":"2024-06-06T02:36:09.942136+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:36:09.942136+0000","last_undegraded":"2024-06-06T02:36:09.942136+0000","last_fullsized":"2024-06-06T02:36:09.942136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752248+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:36:14.752248+0000","last_peered":"2024-06-06T02:36:14.752248+0000","last_clean":"2024-06-06T02:36:14.752248+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:36:14.752248+0000","last_undegraded":"2024-06-06T02:36:14.752248+0000","last_fullsized":"2024-06-06T02:36:14.752248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.909733+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.909733+0000","last_peered":"2024-06-06T02:34:20.909733+0000","last_clean":"2024-06-06T02:34:20.909733+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.909733+0000","last_undegraded":"2024-06-06T02:34:20.909733+0000","last_fullsized":"2024-06-06T02:34:20.909733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760152+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:36:14.760152+0000","last_peered":"2024-06-06T02:36:14.760152+0000","last_clean":"2024-06-06T02:36:14.760152+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:36:14.760152+0000","last_undegraded":"2024-06-06T02:36:14.760152+0000","last_fullsized":"2024-06-06T02:36:14.760152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.912238+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.912238+0000","last_peered":"2024-06-06T02:34:20.912238+0000","last_clean":"2024-06-06T02:34:20.912238+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.912238+0000","last_undegraded":"2024-06-06T02:34:20.912238+0000","last_fullsized":"2024-06-06T02:34:20.912238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.685646+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:36:14.685646+0000","last_peered":"2024-06-06T02:36:14.685646+0000","last_clean":"2024-06-06T02:36:14.685646+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:36:14.685646+0000","last_undegraded":"2024-06-06T02:36:14.685646+0000","last_fullsized":"2024-06-06T02:36:14.685646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.914245+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.914245+0000","last_peered":"2024-06-06T02:34:20.914245+0000","last_clean":"2024-06-06T02:34:20.914245+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.914245+0000","last_undegraded":"2024-06-06T02:34:20.914245+0000","last_fullsized":"2024-06-06T02:34:20.914245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760442+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:36:14.760442+0000","last_peered":"2024-06-06T02:36:14.760442+0000","last_clean":"2024-06-06T02:36:14.760442+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:36:14.760442+0000","last_undegraded":"2024-06-06T02:36:14.760442+0000","last_fullsized":"2024-06-06T02:36:14.760442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:18.874719+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:18.874719+0000","last_peered":"2024-06-06T02:34:18.874719+0000","last_clean":"2024-06-06T02:34:18.874719+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:18.874719+0000","last_undegraded":"2024-06-06T02:34:18.874719+0000","last_fullsized":"2024-06-06T02:34:18.874719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763061+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:36:14.763061+0000","last_peered":"2024-06-06T02:36:14.763061+0000","last_clean":"2024-06-06T02:36:14.763061+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:36:14.763061+0000","last_undegraded":"2024-06-06T02:36:14.763061+0000","last_fullsized":"2024-06-06T02:36:14.763061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944083+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:24.944083+0000","last_peered":"2024-06-06T02:34:24.944083+0000","last_clean":"2024-06-06T02:34:24.944083+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944083+0000","last_undegraded":"2024-06-06T02:34:24.944083+0000","last_fullsized":"2024-06-06T02:34:24.944083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763467+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:36:14.763467+0000","last_peered":"2024-06-06T02:36:14.763467+0000","last_clean":"2024-06-06T02:36:14.763467+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:36:14.763467+0000","last_undegraded":"2024-06-06T02:36:14.763467+0000","last_fullsized":"2024-06-06T02:36:14.763467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731814+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:36:14.731814+0000","last_peered":"2024-06-06T02:36:14.731814+0000","last_clean":"2024-06-06T02:36:14.731814+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:36:14.731814+0000","last_undegraded":"2024-06-06T02:36:14.731814+0000","last_fullsized":"2024-06-06T02:36:14.731814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846967+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.846967+0000","last_peered":"2024-06-06T02:34:15.846967+0000","last_clean":"2024-06-06T02:34:15.846967+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.846967+0000","last_undegraded":"2024-06-06T02:34:15.846967+0000","last_fullsized":"2024-06-06T02:34:15.846967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.762248+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:36:14.762248+0000","last_peered":"2024-06-06T02:36:14.762248+0000","last_clean":"2024-06-06T02:36:14.762248+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:36:14.762248+0000","last_undegraded":"2024-06-06T02:36:14.762248+0000","last_fullsized":"2024-06-06T02:36:14.762248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916923+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.916923+0000","last_peered":"2024-06-06T02:34:21.916923+0000","last_clean":"2024-06-06T02:34:21.916923+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.916923+0000","last_undegraded":"2024-06-06T02:34:21.916923+0000","last_fullsized":"2024-06-06T02:34:21.916923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767683+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:36:14.767683+0000","last_peered":"2024-06-06T02:36:14.767683+0000","last_clean":"2024-06-06T02:36:14.767683+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:36:14.767683+0000","last_undegraded":"2024-06-06T02:36:14.767683+0000","last_fullsized":"2024-06-06T02:36:14.767683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925707+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:34:21.925707+0000","last_peered":"2024-06-06T02:34:21.925707+0000","last_clean":"2024-06-06T02:34:21.925707+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:34:21.925707+0000","last_undegraded":"2024-06-06T02:34:21.925707+0000","last_fullsized":"2024-06-06T02:34:21.925707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.745961+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:36:14.745961+0000","last_peered":"2024-06-06T02:36:14.745961+0000","last_clean":"2024-06-06T02:36:14.745961+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:36:14.745961+0000","last_undegraded":"2024-06-06T02:36:14.745961+0000","last_fullsized":"2024-06-06T02:36:14.745961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948074+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:24.948074+0000","last_peered":"2024-06-06T02:34:24.948074+0000","last_clean":"2024-06-06T02:34:24.948074+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:24.948074+0000","last_undegraded":"2024-06-06T02:34:24.948074+0000","last_fullsized":"2024-06-06T02:34:24.948074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68069,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":745,"num_read_kb":444,"num_write":171,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":204207,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710764,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1081149,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070518,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266749,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462979,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1016904,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626504,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822733,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986258,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":489730,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411422,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":489086,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64459,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65103,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66037,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:36:25.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-06T02:36:26.422 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:26.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:26 smithi082 ceph-mon[31579]: pgmap v405: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:26.728 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:26 smithi082 ceph-mon[31579]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:26 smithi103 ceph-mon[36349]: pgmap v405: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:26 smithi103 ceph-mon[36349]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:26.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:26 smithi184 ceph-mon[36922]: pgmap v405: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:26 smithi184 ceph-mon[36922]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 -- 172.21.15.82:0/752032438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 msgr2=0x7f40dc107c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 --2- 172.21.15.82:0/752032438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc107c30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f40c8009890 tx=0x7f40c802a380 comp rx=0 tx=0).stop 2024-06-06T02:36:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 -- 172.21.15.82:0/752032438 shutdown_connections 2024-06-06T02:36:28.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 --2- 172.21.15.82:0/752032438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 0x7f40dc10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 --2- 172.21.15.82:0/752032438 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc107c30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 --2- 172.21.15.82:0/752032438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.447+0000 7f40e4200640 1 -- 172.21.15.82:0/752032438 >> 172.21.15.82:0/752032438 conn(0x7f40dc0fe9b0 msgr2=0x7f40dc100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.448+0000 7f40e4200640 1 -- 172.21.15.82:0/752032438 shutdown_connections 2024-06-06T02:36:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.448+0000 7f40e4200640 1 -- 172.21.15.82:0/752032438 wait complete. 2024-06-06T02:36:28.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.449+0000 7f40e4200640 1 Processor -- start 2024-06-06T02:36:28.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.449+0000 7f40e4200640 1 -- start start 2024-06-06T02:36:28.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 0x7f40dc0754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc112e80 con 0x7f40dc108170 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc112d00 con 0x7f40dc102ef0 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e4200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc113000 con 0x7f40dc107820 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:37336/0 (socket says 172.21.15.82:37336) 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 -- 172.21.15.82:0/2372745468 learned_addr learned my addr 172.21.15.82:0/2372745468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e2200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 0x7f40dc0754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e0e00640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:28.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 -- 172.21.15.82:0/2372745468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 msgr2=0x7f40dc074fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:28.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc074fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 -- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 msgr2=0x7f40dc0754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:28.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 0x7f40dc0754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.450+0000 7f40e1800640 1 -- 172.21.15.82:0/2372745468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc1a7cb0 con 0x7f40dc102ef0 2024-06-06T02:36:28.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40e1800640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40d000ea20 tx=0x7f40d000eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000ccc0 con 0x7f40dc102ef0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc1a7fa0 con 0x7f40dc102ef0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d000ce60 con 0x7f40dc102ef0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0010430 con 0x7f40dc102ef0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.451+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc1a83f0 con 0x7f40dc102ef0 2024-06-06T02:36:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.453+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc1043a0 con 0x7f40dc102ef0 2024-06-06T02:36:28.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.457+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f40d00046c0 con 0x7f40dc102ef0 2024-06-06T02:36:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.459+0000 7f40da000640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 0x7f40c40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.459+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f40d00e2c80 con 0x7f40dc102ef0 2024-06-06T02:36:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.459+0000 7f40e0e00640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 0x7f40c40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.459+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40d00e3100 con 0x7f40dc102ef0 2024-06-06T02:36:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.460+0000 7f40e0e00640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 0x7f40c40b4d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40c802a970 tx=0x7f40c80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:28.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:28 smithi082 ceph-mon[31579]: pgmap v406: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.668+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40dc062ba0 con 0x7f40c40b2870 2024-06-06T02:36:28.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.676+0000 7f40da000640 1 -- 172.21.15.82:0/2372745468 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259118 (secure 0 0 0) 0x7f40dc062ba0 con 0x7f40c40b2870 2024-06-06T02:36:28.679 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 msgr2=0x7f40c40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 0x7f40c40b4d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40c802a970 tx=0x7f40c80058d0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 msgr2=0x7f40dc074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f40d000ea20 tx=0x7f40d000eee0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 shutdown_connections 2024-06-06T02:36:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40dc108170 0x7f40dc0754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f40c40b2870 0x7f40c40b4d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f40dc107820 0x7f40dc074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 --2- 172.21.15.82:0/2372745468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40dc102ef0 0x7f40dc074a60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 >> 172.21.15.82:0/2372745468 conn(0x7f40dc0fe9b0 msgr2=0x7f40dc100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 shutdown_connections 2024-06-06T02:36:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:28.681+0000 7f40e4200640 1 -- 172.21.15.82:0/2372745468 wait complete. 2024-06-06T02:36:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:28 smithi103 ceph-mon[36349]: pgmap v406: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:28.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:28 smithi184 ceph-mon[36922]: pgmap v406: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:29.567 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-06-06T02:36:26.822785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658671,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":826,"num_read_kb":513,"num_write":296,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359808,"kb_used_data":10656,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582016,"statfs":{"total":1151940427776,"available":1151571984384,"internally_reserved":0,"allocated":10911744,"data_stored":7071537,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":36,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004824"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763442+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:36:14.763442+0000","last_peered":"2024-06-06T02:36:14.763442+0000","last_clean":"2024-06-06T02:36:14.763442+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:36:14.763442+0000","last_undegraded":"2024-06-06T02:36:14.763442+0000","last_fullsized":"2024-06-06T02:36:14.763442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759693+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:36:14.759693+0000","last_peered":"2024-06-06T02:36:14.759693+0000","last_clean":"2024-06-06T02:36:14.759693+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:36:14.759693+0000","last_undegraded":"2024-06-06T02:36:14.759693+0000","last_fullsized":"2024-06-06T02:36:14.759693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761379+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:36:14.761379+0000","last_peered":"2024-06-06T02:36:14.761379+0000","last_clean":"2024-06-06T02:36:14.761379+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:36:14.761379+0000","last_undegraded":"2024-06-06T02:36:14.761379+0000","last_fullsized":"2024-06-06T02:36:14.761379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.726838+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:36:14.726838+0000","last_peered":"2024-06-06T02:36:14.726838+0000","last_clean":"2024-06-06T02:36:14.726838+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:36:14.726838+0000","last_undegraded":"2024-06-06T02:36:14.726838+0000","last_fullsized":"2024-06-06T02:36:14.726838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.743278+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:36:14.743278+0000","last_peered":"2024-06-06T02:36:14.743278+0000","last_clean":"2024-06-06T02:36:14.743278+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:36:14.743278+0000","last_undegraded":"2024-06-06T02:36:14.743278+0000","last_fullsized":"2024-06-06T02:36:14.743278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759424+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:36:14.759424+0000","last_peered":"2024-06-06T02:36:14.759424+0000","last_clean":"2024-06-06T02:36:14.759424+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:36:14.759424+0000","last_undegraded":"2024-06-06T02:36:14.759424+0000","last_fullsized":"2024-06-06T02:36:14.759424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.723672+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:36:14.723672+0000","last_peered":"2024-06-06T02:36:14.723672+0000","last_clean":"2024-06-06T02:36:14.723672+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:36:14.723672+0000","last_undegraded":"2024-06-06T02:36:14.723672+0000","last_fullsized":"2024-06-06T02:36:14.723672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758819+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:36:14.758819+0000","last_peered":"2024-06-06T02:36:14.758819+0000","last_clean":"2024-06-06T02:36:14.758819+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:36:14.758819+0000","last_undegraded":"2024-06-06T02:36:14.758819+0000","last_fullsized":"2024-06-06T02:36:14.758819+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729880+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:36:14.729880+0000","last_peered":"2024-06-06T02:36:14.729880+0000","last_clean":"2024-06-06T02:36:14.729880+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:36:14.729880+0000","last_undegraded":"2024-06-06T02:36:14.729880+0000","last_fullsized":"2024-06-06T02:36:14.729880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733731+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:36:14.733731+0000","last_peered":"2024-06-06T02:36:14.733731+0000","last_clean":"2024-06-06T02:36:14.733731+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:36:14.733731+0000","last_undegraded":"2024-06-06T02:36:14.733731+0000","last_fullsized":"2024-06-06T02:36:14.733731+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731157+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:36:14.731157+0000","last_peered":"2024-06-06T02:36:14.731157+0000","last_clean":"2024-06-06T02:36:14.731157+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:36:14.731157+0000","last_undegraded":"2024-06-06T02:36:14.731157+0000","last_fullsized":"2024-06-06T02:36:14.731157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729221+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:36:14.729221+0000","last_peered":"2024-06-06T02:36:14.729221+0000","last_clean":"2024-06-06T02:36:14.729221+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:36:14.729221+0000","last_undegraded":"2024-06-06T02:36:14.729221+0000","last_fullsized":"2024-06-06T02:36:14.729221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770754+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:36:14.770754+0000","last_peered":"2024-06-06T02:36:14.770754+0000","last_clean":"2024-06-06T02:36:14.770754+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:36:14.770754+0000","last_undegraded":"2024-06-06T02:36:14.770754+0000","last_fullsized":"2024-06-06T02:36:14.770754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764529+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:36:14.764529+0000","last_peered":"2024-06-06T02:36:14.764529+0000","last_clean":"2024-06-06T02:36:14.764529+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:36:14.764529+0000","last_undegraded":"2024-06-06T02:36:14.764529+0000","last_fullsized":"2024-06-06T02:36:14.764529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760237+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:36:14.760237+0000","last_peered":"2024-06-06T02:36:14.760237+0000","last_clean":"2024-06-06T02:36:14.760237+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:36:14.760237+0000","last_undegraded":"2024-06-06T02:36:14.760237+0000","last_fullsized":"2024-06-06T02:36:14.760237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760967+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:36:14.760967+0000","last_peered":"2024-06-06T02:36:14.760967+0000","last_clean":"2024-06-06T02:36:14.760967+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:36:14.760967+0000","last_undegraded":"2024-06-06T02:36:14.760967+0000","last_fullsized":"2024-06-06T02:36:14.760967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763688+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:36:14.763688+0000","last_peered":"2024-06-06T02:36:14.763688+0000","last_clean":"2024-06-06T02:36:14.763688+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:36:14.763688+0000","last_undegraded":"2024-06-06T02:36:14.763688+0000","last_fullsized":"2024-06-06T02:36:14.763688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758949+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:36:14.758949+0000","last_peered":"2024-06-06T02:36:14.758949+0000","last_clean":"2024-06-06T02:36:14.758949+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:36:14.758949+0000","last_undegraded":"2024-06-06T02:36:14.758949+0000","last_fullsized":"2024-06-06T02:36:14.758949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768309+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:36:14.768309+0000","last_peered":"2024-06-06T02:36:14.768309+0000","last_clean":"2024-06-06T02:36:14.768309+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:36:14.768309+0000","last_undegraded":"2024-06-06T02:36:14.768309+0000","last_fullsized":"2024-06-06T02:36:14.768309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.757382+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:36:14.757382+0000","last_peered":"2024-06-06T02:36:14.757382+0000","last_clean":"2024-06-06T02:36:14.757382+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:36:14.757382+0000","last_undegraded":"2024-06-06T02:36:14.757382+0000","last_fullsized":"2024-06-06T02:36:14.757382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770574+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:36:14.770574+0000","last_peered":"2024-06-06T02:36:14.770574+0000","last_clean":"2024-06-06T02:36:14.770574+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:36:14.770574+0000","last_undegraded":"2024-06-06T02:36:14.770574+0000","last_fullsized":"2024-06-06T02:36:14.770574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.749670+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:36:14.749670+0000","last_peered":"2024-06-06T02:36:14.749670+0000","last_clean":"2024-06-06T02:36:14.749670+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:36:14.749670+0000","last_undegraded":"2024-06-06T02:36:14.749670+0000","last_fullsized":"2024-06-06T02:36:14.749670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.750612+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:36:14.750612+0000","last_peered":"2024-06-06T02:36:14.750612+0000","last_clean":"2024-06-06T02:36:14.750612+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:36:14.750612+0000","last_undegraded":"2024-06-06T02:36:14.750612+0000","last_fullsized":"2024-06-06T02:36:14.750612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.741918+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:36:14.741918+0000","last_peered":"2024-06-06T02:36:14.741918+0000","last_clean":"2024-06-06T02:36:14.741918+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:36:14.741918+0000","last_undegraded":"2024-06-06T02:36:14.741918+0000","last_fullsized":"2024-06-06T02:36:14.741918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748548+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:36:14.748548+0000","last_peered":"2024-06-06T02:36:14.748548+0000","last_clean":"2024-06-06T02:36:14.748548+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:36:14.748548+0000","last_undegraded":"2024-06-06T02:36:14.748548+0000","last_fullsized":"2024-06-06T02:36:14.748548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733052+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:36:14.733052+0000","last_peered":"2024-06-06T02:36:14.733052+0000","last_clean":"2024-06-06T02:36:14.733052+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:36:14.733052+0000","last_undegraded":"2024-06-06T02:36:14.733052+0000","last_fullsized":"2024-06-06T02:36:14.733052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.756951+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:36:14.756951+0000","last_peered":"2024-06-06T02:36:14.756951+0000","last_clean":"2024-06-06T02:36:14.756951+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:36:14.756951+0000","last_undegraded":"2024-06-06T02:36:14.756951+0000","last_fullsized":"2024-06-06T02:36:14.756951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768068+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:36:14.768068+0000","last_peered":"2024-06-06T02:36:14.768068+0000","last_clean":"2024-06-06T02:36:14.768068+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:36:14.768068+0000","last_undegraded":"2024-06-06T02:36:14.768068+0000","last_fullsized":"2024-06-06T02:36:14.768068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765237+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:36:14.765237+0000","last_peered":"2024-06-06T02:36:14.765237+0000","last_clean":"2024-06-06T02:36:14.765237+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:36:14.765237+0000","last_undegraded":"2024-06-06T02:36:14.765237+0000","last_fullsized":"2024-06-06T02:36:14.765237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748846+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:36:14.748846+0000","last_peered":"2024-06-06T02:36:14.748846+0000","last_clean":"2024-06-06T02:36:14.748846+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:36:14.748846+0000","last_undegraded":"2024-06-06T02:36:14.748846+0000","last_fullsized":"2024-06-06T02:36:14.748846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768337+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:36:14.768337+0000","last_peered":"2024-06-06T02:36:14.768337+0000","last_clean":"2024-06-06T02:36:14.768337+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:36:14.768337+0000","last_undegraded":"2024-06-06T02:36:14.768337+0000","last_fullsized":"2024-06-06T02:36:14.768337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729331+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:36:14.729331+0000","last_peered":"2024-06-06T02:36:14.729331+0000","last_clean":"2024-06-06T02:36:14.729331+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:36:14.729331+0000","last_undegraded":"2024-06-06T02:36:14.729331+0000","last_fullsized":"2024-06-06T02:36:14.729331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.754135+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:36:14.754135+0000","last_peered":"2024-06-06T02:36:14.754135+0000","last_clean":"2024-06-06T02:36:14.754135+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:36:14.754135+0000","last_undegraded":"2024-06-06T02:36:14.754135+0000","last_fullsized":"2024-06-06T02:36:14.754135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:21.143833+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:36:21.143833+0000","last_peered":"2024-06-06T02:36:21.143833+0000","last_clean":"2024-06-06T02:36:21.143833+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:36:21.143833+0000","last_undegraded":"2024-06-06T02:36:21.143833+0000","last_fullsized":"2024-06-06T02:36:21.143833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746277+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:36:14.746277+0000","last_peered":"2024-06-06T02:36:14.746277+0000","last_clean":"2024-06-06T02:36:14.746277+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:36:14.746277+0000","last_undegraded":"2024-06-06T02:36:14.746277+0000","last_fullsized":"2024-06-06T02:36:14.746277+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925035+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925035+0000","last_peered":"2024-06-06T02:34:21.925035+0000","last_clean":"2024-06-06T02:34:21.925035+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925035+0000","last_undegraded":"2024-06-06T02:34:21.925035+0000","last_fullsized":"2024-06-06T02:34:21.925035+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.926067+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.926067+0000","last_peered":"2024-06-06T02:34:21.926067+0000","last_clean":"2024-06-06T02:34:21.926067+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.926067+0000","last_undegraded":"2024-06-06T02:34:21.926067+0000","last_fullsized":"2024-06-06T02:34:21.926067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768884+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:36:14.768884+0000","last_peered":"2024-06-06T02:36:14.768884+0000","last_clean":"2024-06-06T02:36:14.768884+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:36:14.768884+0000","last_undegraded":"2024-06-06T02:36:14.768884+0000","last_fullsized":"2024-06-06T02:36:14.768884+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906263+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:20.906263+0000","last_peered":"2024-06-06T02:34:20.906263+0000","last_clean":"2024-06-06T02:34:20.906263+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:20.906263+0000","last_undegraded":"2024-06-06T02:34:20.906263+0000","last_fullsized":"2024-06-06T02:34:20.906263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759728+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:36:14.759728+0000","last_peered":"2024-06-06T02:36:14.759728+0000","last_clean":"2024-06-06T02:36:14.759728+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:36:14.759728+0000","last_undegraded":"2024-06-06T02:36:14.759728+0000","last_fullsized":"2024-06-06T02:36:14.759728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":150,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:24.148075+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:36:24.148075+0000","last_peered":"2024-06-06T02:36:24.148075+0000","last_clean":"2024-06-06T02:36:24.148075+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:36:24.148075+0000","last_undegraded":"2024-06-06T02:36:24.148075+0000","last_fullsized":"2024-06-06T02:36:24.148075+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753187+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:36:14.753187+0000","last_peered":"2024-06-06T02:36:14.753187+0000","last_clean":"2024-06-06T02:36:14.753187+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:36:14.753187+0000","last_undegraded":"2024-06-06T02:36:14.753187+0000","last_fullsized":"2024-06-06T02:36:14.753187+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905669+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905669+0000","last_peered":"2024-06-06T02:34:20.905669+0000","last_clean":"2024-06-06T02:34:20.905669+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905669+0000","last_undegraded":"2024-06-06T02:34:20.905669+0000","last_fullsized":"2024-06-06T02:34:20.905669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.766604+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:36:14.766604+0000","last_peered":"2024-06-06T02:36:14.766604+0000","last_clean":"2024-06-06T02:36:14.766604+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:36:14.766604+0000","last_undegraded":"2024-06-06T02:36:14.766604+0000","last_fullsized":"2024-06-06T02:36:14.766604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.947496+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:24.947496+0000","last_peered":"2024-06-06T02:34:24.947496+0000","last_clean":"2024-06-06T02:34:24.947496+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:24.947496+0000","last_undegraded":"2024-06-06T02:34:24.947496+0000","last_fullsized":"2024-06-06T02:34:24.947496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.732777+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:36:14.732777+0000","last_peered":"2024-06-06T02:36:14.732777+0000","last_clean":"2024-06-06T02:36:14.732777+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:36:14.732777+0000","last_undegraded":"2024-06-06T02:36:14.732777+0000","last_fullsized":"2024-06-06T02:36:14.732777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'34","reported_seq":330,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:24.248162+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:36:24.248162+0000","last_peered":"2024-06-06T02:36:24.248162+0000","last_clean":"2024-06-06T02:36:24.248162+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:36:24.248162+0000","last_undegraded":"2024-06-06T02:36:24.248162+0000","last_fullsized":"2024-06-06T02:36:24.248162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":253,"num_read_kb":189,"num_write":35,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.721075+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:36:14.721075+0000","last_peered":"2024-06-06T02:36:14.721075+0000","last_clean":"2024-06-06T02:36:14.721075+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:36:14.721075+0000","last_undegraded":"2024-06-06T02:36:14.721075+0000","last_fullsized":"2024-06-06T02:36:14.721075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944283+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:24.944283+0000","last_peered":"2024-06-06T02:34:24.944283+0000","last_clean":"2024-06-06T02:34:24.944283+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:24.944283+0000","last_undegraded":"2024-06-06T02:34:24.944283+0000","last_fullsized":"2024-06-06T02:34:24.944283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769779+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:36:14.769779+0000","last_peered":"2024-06-06T02:36:14.769779+0000","last_clean":"2024-06-06T02:36:14.769779+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:36:14.769779+0000","last_undegraded":"2024-06-06T02:36:14.769779+0000","last_fullsized":"2024-06-06T02:36:14.769779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911833+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911833+0000","last_peered":"2024-06-06T02:34:20.911833+0000","last_clean":"2024-06-06T02:34:20.911833+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911833+0000","last_undegraded":"2024-06-06T02:34:20.911833+0000","last_fullsized":"2024-06-06T02:34:20.911833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764292+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:36:14.764292+0000","last_peered":"2024-06-06T02:36:14.764292+0000","last_clean":"2024-06-06T02:36:14.764292+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:36:14.764292+0000","last_undegraded":"2024-06-06T02:36:14.764292+0000","last_fullsized":"2024-06-06T02:36:14.764292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":151,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:22.212757+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:36:22.212757+0000","last_peered":"2024-06-06T02:36:22.212757+0000","last_clean":"2024-06-06T02:36:22.212757+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:36:22.212757+0000","last_undegraded":"2024-06-06T02:36:22.212757+0000","last_fullsized":"2024-06-06T02:36:22.212757+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.704921+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:36:14.704921+0000","last_peered":"2024-06-06T02:36:14.704921+0000","last_clean":"2024-06-06T02:36:14.704921+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:36:14.704921+0000","last_undegraded":"2024-06-06T02:36:14.704921+0000","last_fullsized":"2024-06-06T02:36:14.704921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945265+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:24.945265+0000","last_peered":"2024-06-06T02:34:24.945265+0000","last_clean":"2024-06-06T02:34:24.945265+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:24.945265+0000","last_undegraded":"2024-06-06T02:34:24.945265+0000","last_fullsized":"2024-06-06T02:34:24.945265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730992+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:36:14.730992+0000","last_peered":"2024-06-06T02:36:14.730992+0000","last_clean":"2024-06-06T02:36:14.730992+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:36:14.730992+0000","last_undegraded":"2024-06-06T02:36:14.730992+0000","last_fullsized":"2024-06-06T02:36:14.730992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944016+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:24.944016+0000","last_peered":"2024-06-06T02:34:24.944016+0000","last_clean":"2024-06-06T02:34:24.944016+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:24.944016+0000","last_undegraded":"2024-06-06T02:34:24.944016+0000","last_fullsized":"2024-06-06T02:34:24.944016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725464+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:36:14.725464+0000","last_peered":"2024-06-06T02:36:14.725464+0000","last_clean":"2024-06-06T02:36:14.725464+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:36:14.725464+0000","last_undegraded":"2024-06-06T02:36:14.725464+0000","last_fullsized":"2024-06-06T02:36:14.725464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841147+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.841147+0000","last_peered":"2024-06-06T02:34:15.841147+0000","last_clean":"2024-06-06T02:34:15.841147+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.841147+0000","last_undegraded":"2024-06-06T02:34:15.841147+0000","last_fullsized":"2024-06-06T02:34:15.841147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.724592+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:36:14.724592+0000","last_peered":"2024-06-06T02:36:14.724592+0000","last_clean":"2024-06-06T02:36:14.724592+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:36:14.724592+0000","last_undegraded":"2024-06-06T02:36:14.724592+0000","last_fullsized":"2024-06-06T02:36:14.724592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944251+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:24.944251+0000","last_peered":"2024-06-06T02:34:24.944251+0000","last_clean":"2024-06-06T02:34:24.944251+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944251+0000","last_undegraded":"2024-06-06T02:34:24.944251+0000","last_fullsized":"2024-06-06T02:34:24.944251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752315+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:36:14.752315+0000","last_peered":"2024-06-06T02:36:14.752315+0000","last_clean":"2024-06-06T02:36:14.752315+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:36:14.752315+0000","last_undegraded":"2024-06-06T02:36:14.752315+0000","last_fullsized":"2024-06-06T02:36:14.752315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948916+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:24.948916+0000","last_peered":"2024-06-06T02:34:24.948916+0000","last_clean":"2024-06-06T02:34:24.948916+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:24.948916+0000","last_undegraded":"2024-06-06T02:34:24.948916+0000","last_fullsized":"2024-06-06T02:34:24.948916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731854+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:36:14.731854+0000","last_peered":"2024-06-06T02:36:14.731854+0000","last_clean":"2024-06-06T02:36:14.731854+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:36:14.731854+0000","last_undegraded":"2024-06-06T02:36:14.731854+0000","last_fullsized":"2024-06-06T02:36:14.731854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846183+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:34:15.846183+0000","last_peered":"2024-06-06T02:34:15.846183+0000","last_clean":"2024-06-06T02:34:15.846183+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:34:15.846183+0000","last_undegraded":"2024-06-06T02:34:15.846183+0000","last_fullsized":"2024-06-06T02:34:15.846183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945512+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945512+0000","last_peered":"2024-06-06T02:34:24.945512+0000","last_clean":"2024-06-06T02:34:24.945512+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945512+0000","last_undegraded":"2024-06-06T02:34:24.945512+0000","last_fullsized":"2024-06-06T02:34:24.945512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746789+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:36:14.746789+0000","last_peered":"2024-06-06T02:36:14.746789+0000","last_clean":"2024-06-06T02:36:14.746789+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:36:14.746789+0000","last_undegraded":"2024-06-06T02:36:14.746789+0000","last_fullsized":"2024-06-06T02:36:14.746789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916830+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:34:21.916830+0000","last_peered":"2024-06-06T02:34:21.916830+0000","last_clean":"2024-06-06T02:34:21.916830+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:34:21.916830+0000","last_undegraded":"2024-06-06T02:34:21.916830+0000","last_fullsized":"2024-06-06T02:34:21.916830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763060+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:36:14.763060+0000","last_peered":"2024-06-06T02:36:14.763060+0000","last_clean":"2024-06-06T02:36:14.763060+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:36:14.763060+0000","last_undegraded":"2024-06-06T02:36:14.763060+0000","last_fullsized":"2024-06-06T02:36:14.763060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":153,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:25.217840+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:36:25.217840+0000","last_peered":"2024-06-06T02:36:25.217840+0000","last_clean":"2024-06-06T02:36:25.217840+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:36:25.217840+0000","last_undegraded":"2024-06-06T02:36:25.217840+0000","last_fullsized":"2024-06-06T02:36:25.217840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.712511+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:36:14.712511+0000","last_peered":"2024-06-06T02:36:14.712511+0000","last_clean":"2024-06-06T02:36:14.712511+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:36:14.712511+0000","last_undegraded":"2024-06-06T02:36:14.712511+0000","last_fullsized":"2024-06-06T02:36:14.712511+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924916+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:21.924916+0000","last_peered":"2024-06-06T02:34:21.924916+0000","last_clean":"2024-06-06T02:34:21.924916+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:21.924916+0000","last_undegraded":"2024-06-06T02:34:21.924916+0000","last_fullsized":"2024-06-06T02:34:21.924916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761273+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:36:14.761273+0000","last_peered":"2024-06-06T02:36:14.761273+0000","last_clean":"2024-06-06T02:36:14.761273+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:36:14.761273+0000","last_undegraded":"2024-06-06T02:36:14.761273+0000","last_fullsized":"2024-06-06T02:36:14.761273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855684+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855684+0000","last_peered":"2024-06-06T02:34:15.855684+0000","last_clean":"2024-06-06T02:34:15.855684+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855684+0000","last_undegraded":"2024-06-06T02:34:15.855684+0000","last_fullsized":"2024-06-06T02:34:15.855684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763995+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:36:14.763995+0000","last_peered":"2024-06-06T02:36:14.763995+0000","last_clean":"2024-06-06T02:36:14.763995+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:36:14.763995+0000","last_undegraded":"2024-06-06T02:36:14.763995+0000","last_fullsized":"2024-06-06T02:36:14.763995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945270+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:24.945270+0000","last_peered":"2024-06-06T02:34:24.945270+0000","last_clean":"2024-06-06T02:34:24.945270+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:24.945270+0000","last_undegraded":"2024-06-06T02:34:24.945270+0000","last_fullsized":"2024-06-06T02:34:24.945270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767660+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:36:14.767660+0000","last_peered":"2024-06-06T02:36:14.767660+0000","last_clean":"2024-06-06T02:36:14.767660+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:36:14.767660+0000","last_undegraded":"2024-06-06T02:36:14.767660+0000","last_fullsized":"2024-06-06T02:36:14.767660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'13","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:09.942136+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:36:09.942136+0000","last_peered":"2024-06-06T02:36:09.942136+0000","last_clean":"2024-06-06T02:36:09.942136+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:36:09.942136+0000","last_undegraded":"2024-06-06T02:36:09.942136+0000","last_fullsized":"2024-06-06T02:36:09.942136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752248+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:36:14.752248+0000","last_peered":"2024-06-06T02:36:14.752248+0000","last_clean":"2024-06-06T02:36:14.752248+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:36:14.752248+0000","last_undegraded":"2024-06-06T02:36:14.752248+0000","last_fullsized":"2024-06-06T02:36:14.752248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.909733+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.909733+0000","last_peered":"2024-06-06T02:34:20.909733+0000","last_clean":"2024-06-06T02:34:20.909733+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.909733+0000","last_undegraded":"2024-06-06T02:34:20.909733+0000","last_fullsized":"2024-06-06T02:34:20.909733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760152+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:36:14.760152+0000","last_peered":"2024-06-06T02:36:14.760152+0000","last_clean":"2024-06-06T02:36:14.760152+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:36:14.760152+0000","last_undegraded":"2024-06-06T02:36:14.760152+0000","last_fullsized":"2024-06-06T02:36:14.760152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.912238+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.912238+0000","last_peered":"2024-06-06T02:34:20.912238+0000","last_clean":"2024-06-06T02:34:20.912238+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.912238+0000","last_undegraded":"2024-06-06T02:34:20.912238+0000","last_fullsized":"2024-06-06T02:34:20.912238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.685646+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:36:14.685646+0000","last_peered":"2024-06-06T02:36:14.685646+0000","last_clean":"2024-06-06T02:36:14.685646+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:36:14.685646+0000","last_undegraded":"2024-06-06T02:36:14.685646+0000","last_fullsized":"2024-06-06T02:36:14.685646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.914245+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.914245+0000","last_peered":"2024-06-06T02:34:20.914245+0000","last_clean":"2024-06-06T02:34:20.914245+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.914245+0000","last_undegraded":"2024-06-06T02:34:20.914245+0000","last_fullsized":"2024-06-06T02:34:20.914245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760442+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:36:14.760442+0000","last_peered":"2024-06-06T02:36:14.760442+0000","last_clean":"2024-06-06T02:36:14.760442+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:36:14.760442+0000","last_undegraded":"2024-06-06T02:36:14.760442+0000","last_fullsized":"2024-06-06T02:36:14.760442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:18.874719+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:18.874719+0000","last_peered":"2024-06-06T02:34:18.874719+0000","last_clean":"2024-06-06T02:34:18.874719+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:18.874719+0000","last_undegraded":"2024-06-06T02:34:18.874719+0000","last_fullsized":"2024-06-06T02:34:18.874719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763061+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:36:14.763061+0000","last_peered":"2024-06-06T02:36:14.763061+0000","last_clean":"2024-06-06T02:36:14.763061+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:36:14.763061+0000","last_undegraded":"2024-06-06T02:36:14.763061+0000","last_fullsized":"2024-06-06T02:36:14.763061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944083+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:24.944083+0000","last_peered":"2024-06-06T02:34:24.944083+0000","last_clean":"2024-06-06T02:34:24.944083+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944083+0000","last_undegraded":"2024-06-06T02:34:24.944083+0000","last_fullsized":"2024-06-06T02:34:24.944083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763467+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:36:14.763467+0000","last_peered":"2024-06-06T02:36:14.763467+0000","last_clean":"2024-06-06T02:36:14.763467+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:36:14.763467+0000","last_undegraded":"2024-06-06T02:36:14.763467+0000","last_fullsized":"2024-06-06T02:36:14.763467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731814+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:36:14.731814+0000","last_peered":"2024-06-06T02:36:14.731814+0000","last_clean":"2024-06-06T02:36:14.731814+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:36:14.731814+0000","last_undegraded":"2024-06-06T02:36:14.731814+0000","last_fullsized":"2024-06-06T02:36:14.731814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.846967+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.846967+0000","last_peered":"2024-06-06T02:34:15.846967+0000","last_clean":"2024-06-06T02:34:15.846967+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.846967+0000","last_undegraded":"2024-06-06T02:34:15.846967+0000","last_fullsized":"2024-06-06T02:34:15.846967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.762248+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:36:14.762248+0000","last_peered":"2024-06-06T02:36:14.762248+0000","last_clean":"2024-06-06T02:36:14.762248+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:36:14.762248+0000","last_undegraded":"2024-06-06T02:36:14.762248+0000","last_fullsized":"2024-06-06T02:36:14.762248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.916923+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.916923+0000","last_peered":"2024-06-06T02:34:21.916923+0000","last_clean":"2024-06-06T02:34:21.916923+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.916923+0000","last_undegraded":"2024-06-06T02:34:21.916923+0000","last_fullsized":"2024-06-06T02:34:21.916923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767683+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:36:14.767683+0000","last_peered":"2024-06-06T02:36:14.767683+0000","last_clean":"2024-06-06T02:36:14.767683+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:36:14.767683+0000","last_undegraded":"2024-06-06T02:36:14.767683+0000","last_fullsized":"2024-06-06T02:36:14.767683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925707+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:34:21.925707+0000","last_peered":"2024-06-06T02:34:21.925707+0000","last_clean":"2024-06-06T02:34:21.925707+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:34:21.925707+0000","last_undegraded":"2024-06-06T02:34:21.925707+0000","last_fullsized":"2024-06-06T02:34:21.925707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.745961+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:36:14.745961+0000","last_peered":"2024-06-06T02:36:14.745961+0000","last_clean":"2024-06-06T02:36:14.745961+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:36:14.745961+0000","last_undegraded":"2024-06-06T02:36:14.745961+0000","last_fullsized":"2024-06-06T02:36:14.745961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948074+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:24.948074+0000","last_peered":"2024-06-06T02:34:24.948074+0000","last_clean":"2024-06-06T02:34:24.948074+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:24.948074+0000","last_undegraded":"2024-06-06T02:34:24.948074+0000","last_fullsized":"2024-06-06T02:34:24.948074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68069,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":750,"num_read_kb":449,"num_write":171,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":204207,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710764,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":1081149,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070519,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266749,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462980,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1016904,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626505,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822733,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986258,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":489730,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":489086,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64459,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65103,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66037,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:36:29.573 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-06T02:36:29.574 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-06T02:36:29.574 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-06T02:36:29.574 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-06T02:36:29.994 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:30 smithi103 ceph-mon[36349]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:30 smithi103 ceph-mon[36349]: pgmap v407: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:30 smithi082 ceph-mon[31579]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:30 smithi082 ceph-mon[31579]: pgmap v407: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:30 smithi184 ceph-mon[36922]: from='client.24971 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:36:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:30 smithi184 ceph-mon[36922]: pgmap v407: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-06-06T02:36:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 -- 172.21.15.82:0/2067998336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb8110940 msgr2=0x7fdeb81182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 --2- 172.21.15.82:0/2067998336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb8110940 0x7fdeb81182a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdeb0009d00 tx=0x7fdeb002a910 comp rx=0 tx=0).stop 2024-06-06T02:36:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 -- 172.21.15.82:0/2067998336 shutdown_connections 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 --2- 172.21.15.82:0/2067998336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb8110940 0x7fdeb81182a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 --2- 172.21.15.82:0/2067998336 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb810fff0 0x7fdeb8110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 --2- 172.21.15.82:0/2067998336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb810bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 -- 172.21.15.82:0/2067998336 >> 172.21.15.82:0/2067998336 conn(0x7fdeb806fee0 msgr2=0x7fdeb8109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 -- 172.21.15.82:0/2067998336 shutdown_connections 2024-06-06T02:36:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.313+0000 7fdebfa00640 1 -- 172.21.15.82:0/2067998336 wait complete. 2024-06-06T02:36:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.314+0000 7fdebfa00640 1 Processor -- start 2024-06-06T02:36:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.314+0000 7fdebfa00640 1 -- start start 2024-06-06T02:36:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb810fff0 0x7fdeb81a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb8110940 0x7fdeb81a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb811b660 con 0x7fdeb810fff0 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb811b4e0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebfa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb811b7e0 con 0x7fdeb8110940 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdeafe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb810fff0 0x7fdeb81a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebda00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb8110940 0x7fdeb81a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:54164/0 (socket says 172.21.15.82:54164) 2024-06-06T02:36:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.315+0000 7fdebd000640 1 -- 172.21.15.82:0/3565712003 learned_addr learned my addr 172.21.15.82:0/3565712003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 -- 172.21.15.82:0/3565712003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb8110940 msgr2=0x7fdeb81a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb8110940 0x7fdeb81a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 -- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb810fff0 msgr2=0x7fdeb81a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb810fff0 0x7fdeb81a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 -- 172.21.15.82:0/3565712003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb81a6fb0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdebd000640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdea800ea20 tx=0x7fdea800eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.316+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea800cd80 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.317+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb81a72a0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.317+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea80108e0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.317+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea8018860 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.317+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb81aec20 con 0x7fdeb810b6c0 2024-06-06T02:36:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.318+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb810bad0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.320+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdea8010430 con 0x7fdeb810b6c0 2024-06-06T02:36:32.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.322+0000 7fdeb6000640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 0x7fde9c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:32.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.322+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fdea80e2a10 con 0x7fdeb810b6c0 2024-06-06T02:36:32.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.322+0000 7fdeafe00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 0x7fde9c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.323+0000 7fdeafe00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 0x7fde9c0b4d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdeb810a8c0 tx=0x7fdea0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.323+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdea80aa0a0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.574+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdeb8113900 con 0x7fdeb810b6c0 2024-06-06T02:36:32.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.575+0000 7fdeb6000640 1 -- 172.21.15.82:0/3565712003 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdea80ae3a0 con 0x7fdeb810b6c0 2024-06-06T02:36:32.575 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:32.575 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.577+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 msgr2=0x7fde9c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.577+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 0x7fde9c0b4d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdeb810a8c0 tx=0x7fdea0005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.577+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 msgr2=0x7fdeb81a2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.577+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdea800ea20 tx=0x7fdea800eee0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.577+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 shutdown_connections 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fde9c0b2870 0x7fde9c0b4d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdeb8110940 0x7fdeb81a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdeb810fff0 0x7fdeb81a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 --2- 172.21.15.82:0/3565712003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeb810b6c0 0x7fdeb81a2140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:32.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 >> 172.21.15.82:0/3565712003 conn(0x7fdeb806fee0 msgr2=0x7fdeb8070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:32.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 shutdown_connections 2024-06-06T02:36:32.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:32.578+0000 7fdebfa00640 1 -- 172.21.15.82:0/3565712003 wait complete. 2024-06-06T02:36:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:32 smithi103 ceph-mon[36349]: pgmap v408: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:32 smithi082 ceph-mon[31579]: pgmap v408: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:32 smithi184 ceph-mon[36922]: pgmap v408: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-06-06T02:36:33.432 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-06T02:36:33.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:36:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:33 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3565712003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T02:36:33.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:33 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3565712003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T02:36:33.876 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:33.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:33 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3565712003' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-06T02:36:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:34 smithi082 ceph-mon[31579]: pgmap v409: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:34.768 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:34 smithi103 ceph-mon[36349]: pgmap v409: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:34.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:34 smithi184 ceph-mon[36922]: pgmap v409: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 -- 172.21.15.82:0/3513297348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec109860 msgr2=0x7f5cec109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 --2- 172.21.15.82:0/3513297348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec109860 0x7f5cec109c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009970 tx=0x7f5cd402a440 comp rx=0 tx=0).stop 2024-06-06T02:36:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 -- 172.21.15.82:0/3513297348 shutdown_connections 2024-06-06T02:36:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 --2- 172.21.15.82:0/3513297348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 0x7f5cec111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 --2- 172.21.15.82:0/3513297348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec109860 0x7f5cec109c70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 --2- 172.21.15.82:0/3513297348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec104f30 0x7f5cec105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 -- 172.21.15.82:0/3513297348 >> 172.21.15.82:0/3513297348 conn(0x7f5cec100990 msgr2=0x7f5cec102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 -- 172.21.15.82:0/3513297348 shutdown_connections 2024-06-06T02:36:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.148+0000 7f5cf1600640 1 -- 172.21.15.82:0/3513297348 wait complete. 2024-06-06T02:36:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.149+0000 7f5cf1600640 1 Processor -- start 2024-06-06T02:36:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.149+0000 7f5cf1600640 1 -- start start 2024-06-06T02:36:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 0x7f5cec1a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:36.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 0x7f5cec19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec114ec0 con 0x7f5cec104f30 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec114d40 con 0x7f5cec109860 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf1600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec115040 con 0x7f5cec10a1b0 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35274/0 (socket says 172.21.15.82:35274) 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cebe00640 1 -- 172.21.15.82:0/2868350555 learned_addr learned my addr 172.21.15.82:0/2868350555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5ce3400640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 0x7f5cec1a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:36.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.150+0000 7f5cf0c00640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 0x7f5cec19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 -- 172.21.15.82:0/2868350555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 msgr2=0x7f5cec19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 0x7f5cec19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 -- 172.21.15.82:0/2868350555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 msgr2=0x7f5cec1a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 0x7f5cec1a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 -- 172.21.15.82:0/2868350555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec19bf80 con 0x7f5cec104f30 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5ce3400640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 0x7f5cec1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cebe00640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00ea60 tx=0x7f5cdc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:36.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00cde0 con 0x7f5cec104f30 2024-06-06T02:36:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cdc0035f0 con 0x7f5cec104f30 2024-06-06T02:36:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec19c210 con 0x7f5cec104f30 2024-06-06T02:36:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc010690 con 0x7f5cec104f30 2024-06-06T02:36:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.151+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec1a8470 con 0x7f5cec104f30 2024-06-06T02:36:36.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.152+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec1063e0 con 0x7f5cec104f30 2024-06-06T02:36:36.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.155+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5cdc0037a0 con 0x7f5cec104f30 2024-06-06T02:36:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.156+0000 7f5ce9600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 0x7f5cd00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:36.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.157+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5cdc0e26b0 con 0x7f5cec104f30 2024-06-06T02:36:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.157+0000 7f5ce3400640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 0x7f5cd00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:36.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.157+0000 7f5ce3400640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 0x7f5cd00b4d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4031000 tx=0x7f5cd4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:36.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.158+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5cdc054df0 con 0x7f5cec104f30 2024-06-06T02:36:36.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.404+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cec105340 con 0x7f5cec104f30 2024-06-06T02:36:36.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.406+0000 7f5ce9600640 1 -- 172.21.15.82:0/2868350555 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7f5cec105340 con 0x7f5cec104f30 2024-06-06T02:36:36.406 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:36.407 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:36:36.407 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 msgr2=0x7f5cd00b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 0x7f5cd00b4d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4031000 tx=0x7f5cd4000bc0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 msgr2=0x7f5cec1a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00ea60 tx=0x7f5cdc00ef20 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 shutdown_connections 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5cd00b2870 0x7f5cd00b4d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cec10a1b0 0x7f5cec19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5cec109860 0x7f5cec1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 --2- 172.21.15.82:0/2868350555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cec104f30 0x7f5cec1a1610 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:36.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 >> 172.21.15.82:0/2868350555 conn(0x7f5cec100990 msgr2=0x7f5cec101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:36.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 shutdown_connections 2024-06-06T02:36:36.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:36.409+0000 7f5cf1600640 1 -- 172.21.15.82:0/2868350555 wait complete. 2024-06-06T02:36:36.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:36 smithi082 ceph-mon[31579]: pgmap v410: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:36.771 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:36 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2868350555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:36 smithi103 ceph-mon[36349]: pgmap v410: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:36 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2868350555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:36 smithi184 ceph-mon[36922]: pgmap v410: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:36 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2868350555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:37.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:36:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:38.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:38 smithi082 ceph-mon[31579]: pgmap v411: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:38 smithi103 ceph-mon[36349]: pgmap v411: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:38.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:38 smithi184 ceph-mon[36922]: pgmap v411: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 -- 172.21.15.82:0/4181446240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe40109a20 msgr2=0x7efe40109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 --2- 172.21.15.82:0/4181446240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe40109a20 0x7efe40109e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe28009930 tx=0x7efe2802a420 comp rx=0 tx=0).stop 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 -- 172.21.15.82:0/4181446240 shutdown_connections 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 --2- 172.21.15.82:0/4181446240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe4010a370 0x7efe40111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 --2- 172.21.15.82:0/4181446240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe40109a20 0x7efe40109e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 --2- 172.21.15.82:0/4181446240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe401050f0 0x7efe40105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.847+0000 7efe45400640 1 -- 172.21.15.82:0/4181446240 >> 172.21.15.82:0/4181446240 conn(0x7efe40100b90 msgr2=0x7efe40102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.848+0000 7efe45400640 1 -- 172.21.15.82:0/4181446240 shutdown_connections 2024-06-06T02:36:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.848+0000 7efe45400640 1 -- 172.21.15.82:0/4181446240 wait complete. 2024-06-06T02:36:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.849+0000 7efe45400640 1 Processor -- start 2024-06-06T02:36:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.849+0000 7efe45400640 1 -- start start 2024-06-06T02:36:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 0x7efe401a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 0x7efe401a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 0x7efe4019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efe40115070 con 0x7efe40109a20 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efe40114ef0 con 0x7efe4010a370 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe45400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efe401151f0 con 0x7efe401050f0 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe3e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 0x7efe401a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe3e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 0x7efe401a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:32798/0 (socket says 172.21.15.82:32798) 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.850+0000 7efe3e800640 1 -- 172.21.15.82:0/176803192 learned_addr learned my addr 172.21.15.82:0/176803192 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 0x7efe4019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 -- 172.21.15.82:0/176803192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 msgr2=0x7efe401a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 0x7efe401a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 -- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 msgr2=0x7efe401a1cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3de00640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 0x7efe401a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 0x7efe401a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3f200640 1 -- 172.21.15.82:0/176803192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4019c010 con 0x7efe4010a370 2024-06-06T02:36:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.851+0000 7efe3de00640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 0x7efe401a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe3f200640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 0x7efe4019b9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e970 tx=0x7efe3800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3800ccc0 con 0x7efe4010a370 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe38005020 con 0x7efe4010a370 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4019c300 con 0x7efe4010a370 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe401a8610 con 0x7efe4010a370 2024-06-06T02:36:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.852+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38004a00 con 0x7efe4010a370 2024-06-06T02:36:39.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.854+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c005290 con 0x7efe4010a370 2024-06-06T02:36:39.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.856+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efe38004ba0 con 0x7efe4010a370 2024-06-06T02:36:39.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.858+0000 7efe37400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 0x7efe240b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.858+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efe380e2070 con 0x7efe4010a370 2024-06-06T02:36:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.858+0000 7efe3e800640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 0x7efe240b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:39.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.859+0000 7efe3e800640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 0x7efe240b4d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe4019cae0 tx=0x7efe30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:39.859+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe380a9d50 con 0x7efe4010a370 2024-06-06T02:36:40.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.107+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe1c005580 con 0x7efe4010a370 2024-06-06T02:36:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.109+0000 7efe37400640 1 -- 172.21.15.82:0/176803192 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7efe380a9650 con 0x7efe4010a370 2024-06-06T02:36:40.109 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:40.109 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:36:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 msgr2=0x7efe240b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 0x7efe240b4d00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efe4019cae0 tx=0x7efe30009500 comp rx=0 tx=0).stop 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 msgr2=0x7efe4019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 0x7efe4019b9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe3800e970 tx=0x7efe3800ee30 comp rx=0 tx=0).stop 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 shutdown_connections 2024-06-06T02:36:40.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe4010a370 0x7efe4019b9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe40109a20 0x7efe401a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efe240b27f0 0x7efe240b4d00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 --2- 172.21.15.82:0/176803192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe401050f0 0x7efe401a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 >> 172.21.15.82:0/176803192 conn(0x7efe40100b90 msgr2=0x7efe40102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 shutdown_connections 2024-06-06T02:36:40.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:40.112+0000 7efe45400640 1 -- 172.21.15.82:0/176803192 wait complete. 2024-06-06T02:36:40.833 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:40 smithi082 ceph-mon[31579]: pgmap v412: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:40.834 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:40 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/176803192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:40 smithi103 ceph-mon[36349]: pgmap v412: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:40 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/176803192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:40.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:40 smithi184 ceph-mon[36922]: pgmap v412: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:40 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/176803192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:40.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:36:41.351 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:42 smithi103 ceph-mon[36349]: pgmap v413: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:42 smithi082 ceph-mon[31579]: pgmap v413: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:42.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:42 smithi184 ceph-mon[36922]: pgmap v413: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:43.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 -- 172.21.15.82:0/3952299580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 msgr2=0x7fe99c111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:43.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 --2- 172.21.15.82:0/3952299580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c111ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe994009d00 tx=0x7fe99402a910 comp rx=0 tx=0).stop 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 -- 172.21.15.82:0/3952299580 shutdown_connections 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 --2- 172.21.15.82:0/3952299580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c111ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 --2- 172.21.15.82:0/3952299580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c109a30 0x7fe99c109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 --2- 172.21.15.82:0/3952299580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c105100 0x7fe99c105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 -- 172.21.15.82:0/3952299580 >> 172.21.15.82:0/3952299580 conn(0x7fe99c100b60 msgr2=0x7fe99c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 -- 172.21.15.82:0/3952299580 shutdown_connections 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.436+0000 7fe9a1600640 1 -- 172.21.15.82:0/3952299580 wait complete. 2024-06-06T02:36:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.437+0000 7fe9a1600640 1 Processor -- start 2024-06-06T02:36:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 -- start start 2024-06-06T02:36:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 0x7fe99c1a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c1150b0 con 0x7fe99c10a380 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c114f30 con 0x7fe99c105100 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.438+0000 7fe9a1600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c115230 con 0x7fe99c109a30 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 0x7fe99c1a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42976/0 (socket says 172.21.15.82:42976) 2024-06-06T02:36:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99aa00640 1 -- 172.21.15.82:0/623583170 learned_addr learned my addr 172.21.15.82:0/623583170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 -- 172.21.15.82:0/623583170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 msgr2=0x7fe99c1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 -- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 msgr2=0x7fe99c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99a000640 1 -- 172.21.15.82:0/623583170 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c19bfb0 con 0x7fe99c109a30 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.439+0000 7fe99aa00640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe99a000640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 0x7fe99c1a1c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe99c06beb0 tx=0x7fe98800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98800cc40 con 0x7fe99c109a30 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c19c2a0 con 0x7fe99c109a30 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98800cde0 con 0x7fe99c109a30 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988018760 con 0x7fe99c109a30 2024-06-06T02:36:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.440+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c1a85b0 con 0x7fe99c109a30 2024-06-06T02:36:43.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.441+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c105510 con 0x7fe99c109a30 2024-06-06T02:36:43.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.444+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe988010a90 con 0x7fe99c109a30 2024-06-06T02:36:43.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.446+0000 7fe993400640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 0x7fe9800b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:43.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.446+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe9880e24b0 con 0x7fe99c109a30 2024-06-06T02:36:43.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.446+0000 7fe99aa00640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 0x7fe9800b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:43.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.447+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe9880a9b40 con 0x7fe99c109a30 2024-06-06T02:36:43.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.447+0000 7fe99aa00640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 0x7fe9800b4d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe99c19ca80 tx=0x7fe98c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.656+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe99c10d3a0 con 0x7fe99c109a30 2024-06-06T02:36:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.658+0000 7fe993400640 1 -- 172.21.15.82:0/623583170 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fe9880ade40 con 0x7fe99c109a30 2024-06-06T02:36:43.659 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:43.659 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:36:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 msgr2=0x7fe9800b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 0x7fe9800b4d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe99c19ca80 tx=0x7fe98c005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 msgr2=0x7fe99c1a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 0x7fe99c1a1c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe99c06beb0 tx=0x7fe98800ee50 comp rx=0 tx=0).stop 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 shutdown_connections 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99c10a380 0x7fe99c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe9800b27f0 0x7fe9800b4d00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe99c109a30 0x7fe99c1a1c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 --2- 172.21.15.82:0/623583170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe99c105100 0x7fe99c1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 >> 172.21.15.82:0/623583170 conn(0x7fe99c100b60 msgr2=0x7fe99c1011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 shutdown_connections 2024-06-06T02:36:43.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:43.661+0000 7fe9a1600640 1 -- 172.21.15.82:0/623583170 wait complete. 2024-06-06T02:36:44.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:36:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:44 smithi103 ceph-mon[36349]: pgmap v414: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:44 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/623583170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:36:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:44 smithi082 ceph-mon[31579]: pgmap v414: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:44 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/623583170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:36:44.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:44 smithi184 ceph-mon[36922]: pgmap v414: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:44.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:44 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/623583170' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:36:45.036 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:46.810 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:46 smithi082 ceph-mon[31579]: pgmap v415: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:46 smithi103 ceph-mon[36349]: pgmap v415: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:46.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:46 smithi184 ceph-mon[36922]: pgmap v415: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:47.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 -- 172.21.15.82:0/3417668524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 msgr2=0x7fc4dc111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:47.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/3417668524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc111cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009d00 tx=0x7fc4d402a910 comp rx=0 tx=0).stop 2024-06-06T02:36:47.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 -- 172.21.15.82:0/3417668524 shutdown_connections 2024-06-06T02:36:47.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/3417668524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc111cd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/3417668524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 0x7fc4dc109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/3417668524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 0x7fc4dc105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.370+0000 7fc4e1a00640 1 -- 172.21.15.82:0/3417668524 >> 172.21.15.82:0/3417668524 conn(0x7fc4dc100b90 msgr2=0x7fc4dc102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.371+0000 7fc4e1a00640 1 -- 172.21.15.82:0/3417668524 shutdown_connections 2024-06-06T02:36:47.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.371+0000 7fc4e1a00640 1 -- 172.21.15.82:0/3417668524 wait complete. 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 Processor -- start 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 -- start start 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 0x7fc4dc1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 0x7fc4dc1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc115090 con 0x7fc4dc10a370 2024-06-06T02:36:47.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc114f10 con 0x7fc4dc1050f0 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.372+0000 7fc4e1a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc115210 con 0x7fc4dc109a20 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4d3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 0x7fc4dc1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 0x7fc4dc1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43936/0 (socket says 172.21.15.82:43936) 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 -- 172.21.15.82:0/4125713612 learned_addr learned my addr 172.21.15.82:0/4125713612 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 -- 172.21.15.82:0/4125713612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 msgr2=0x7fc4dc1a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 0x7fc4dc1a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 -- 172.21.15.82:0/4125713612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 msgr2=0x7fc4dc1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 0x7fc4dc1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.373+0000 7fc4db400640 1 -- 172.21.15.82:0/4125713612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc19bf30 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4db400640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc4d402f550 tx=0x7fc4d40317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4003b70 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc19c1c0 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d4003d10 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d402fa40 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.374+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc1a8530 con 0x7fc4dc10a370 2024-06-06T02:36:47.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.375+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc1065a0 con 0x7fc4dc10a370 2024-06-06T02:36:47.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.378+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc4d402fbe0 con 0x7fc4dc10a370 2024-06-06T02:36:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.380+0000 7fc4d3400640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 0x7fc4c00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.381+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d41035e0 con 0x7fc4dc10a370 2024-06-06T02:36:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.381+0000 7fc4daa00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 0x7fc4c00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:47.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.382+0000 7fc4daa00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 0x7fc4c00b4d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc19ca00 tx=0x7fc4cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:47.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.383+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4d40cb2c0 con 0x7fc4dc10a370 2024-06-06T02:36:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.630+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4dc105500 con 0x7fc4dc10a370 2024-06-06T02:36:47.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.631+0000 7fc4d3400640 1 -- 172.21.15.82:0/4125713612 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7fc4d40cabc0 con 0x7fc4dc10a370 2024-06-06T02:36:47.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:36:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:36:47.632 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:36:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 msgr2=0x7fc4c00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 0x7fc4c00b4d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc19ca00 tx=0x7fc4cc005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 msgr2=0x7fc4dc19b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc4d402f550 tx=0x7fc4d40317d0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 shutdown_connections 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4dc10a370 0x7fc4dc19b8c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc4c00b27f0 0x7fc4c00b4d00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc109a20 0x7fc4dc1a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 --2- 172.21.15.82:0/4125713612 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4dc1050f0 0x7fc4dc1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 >> 172.21.15.82:0/4125713612 conn(0x7fc4dc100b90 msgr2=0x7fc4dc102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 shutdown_connections 2024-06-06T02:36:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:47.634+0000 7fc4e1a00640 1 -- 172.21.15.82:0/4125713612 wait complete. 2024-06-06T02:36:48.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T02:34:03.585827+0000', 'modified': '2024-06-06T02:34:28.647869+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24676, 'mds_1': 24664, 'mds_2': 24659}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24643': {'gid': 24643, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/1227923673', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 1227923673}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 1227923673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6837/387834603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 387834603}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 387834603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/109083450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 109083450}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 109083450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'b', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6839/426995210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 426995210}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 426995210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.184:6839/1945283306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 1945283306}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 1945283306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'g', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.82:6839/3528791947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3528791947}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3528791947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24676, 'qdb_cluster': [24676, 24664, 24659]} 2024-06-06T02:36:48.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-06T02:36:48.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-06T02:36:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:48 smithi103 ceph-mon[36349]: pgmap v416: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:48 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4125713612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:48 smithi082 ceph-mon[31579]: pgmap v416: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:48 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4125713612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:48.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:48 smithi184 ceph-mon[36922]: pgmap v416: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:48.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:48 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4125713612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:36:49.000 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:50.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:50 smithi082 ceph-mon[31579]: pgmap v417: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:50 smithi103 ceph-mon[36349]: pgmap v417: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:50 smithi184 ceph-mon[36922]: pgmap v417: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.295+0000 7fd9e1a00640 1 -- 172.21.15.82:0/2269712599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc10b390 msgr2=0x7fd9dc10b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.295+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/2269712599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10b7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009d00 tx=0x7fd9cc02a910 comp rx=0 tx=0).stop 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 -- 172.21.15.82:0/2269712599 shutdown_connections 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/2269712599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 0x7fd9dc117240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/2269712599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc110150 0x7fd9dc110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/2269712599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10b7a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 -- 172.21.15.82:0/2269712599 >> 172.21.15.82:0/2269712599 conn(0x7fd9dc06e3f0 msgr2=0x7fd9dc06e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 -- 172.21.15.82:0/2269712599 shutdown_connections 2024-06-06T02:36:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.296+0000 7fd9e1a00640 1 -- 172.21.15.82:0/2269712599 wait complete. 2024-06-06T02:36:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.297+0000 7fd9e1a00640 1 Processor -- start 2024-06-06T02:36:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 -- start start 2024-06-06T02:36:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 0x7fd9dc10cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc11a670 con 0x7fd9dc110150 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc11a4f0 con 0x7fd9dc10b390 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9e1a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc11a7f0 con 0x7fd9dc110aa0 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.298+0000 7fd9da000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9db400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 0x7fd9dc10cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43958/0 (socket says 172.21.15.82:43958) 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 -- 172.21.15.82:0/217900935 learned_addr learned my addr 172.21.15.82:0/217900935 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9daa00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 -- 172.21.15.82:0/217900935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 msgr2=0x7fd9dc10cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 0x7fd9dc10cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 -- 172.21.15.82:0/217900935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc10b390 msgr2=0x7fd9dc10c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 -- 172.21.15.82:0/217900935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1b0550 con 0x7fd9dc110150 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.299+0000 7fd9da000640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e9f0 tx=0x7fd9c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.300+0000 7fd9d3400640 1 -- 172.21.15.82:0/217900935 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800ccc0 con 0x7fd9dc110150 2024-06-06T02:36:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.300+0000 7fd9d3400640 1 -- 172.21.15.82:0/217900935 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c80108e0 con 0x7fd9dc110150 2024-06-06T02:36:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.300+0000 7fd9d3400640 1 -- 172.21.15.82:0/217900935 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8018860 con 0x7fd9dc110150 2024-06-06T02:36:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.300+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc1b0840 con 0x7fd9dc110150 2024-06-06T02:36:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.300+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc1b0d80 con 0x7fd9dc110150 2024-06-06T02:36:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.303+0000 7fd9e807e740 1 Processor -- start 2024-06-06T02:36:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.303+0000 7fd9e807e740 1 -- start start 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9d3400640 1 -- 172.21.15.82:0/217900935 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd9c8010430 con 0x7fd9dc110150 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e86a12f60 0x563e86db8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86db9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e86d2dba0 con 0x563e86a12f60 2024-06-06T02:36:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e86d1d140 con 0x563e869ea0a0 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9e807e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563e86d21180 con 0x563e869f2280 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43008/0 (socket says 172.21.15.82:43008) 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9daa00640 1 -- 172.21.15.82:0/4148905670 learned_addr learned my addr 172.21.15.82:0/4148905670 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9db400640 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e86a12f60 0x563e86db8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.304+0000 7fd9da000640 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86db9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 -- 172.21.15.82:0/4148905670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 msgr2=0x563e86db9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86db9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 -- 172.21.15.82:0/4148905670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e86a12f60 msgr2=0x563e86db8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e86a12f60 0x563e86db8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 -- 172.21.15.82:0/4148905670 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e86a7e540 con 0x563e869ea0a0 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9daa00640 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc06a380 tx=0x7fd9cc009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aebe20e7cdd20f5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9c7e00640 1 -- 172.21.15.82:0/4148905670 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc02f3e0 con 0x563e869ea0a0 2024-06-06T02:36:51.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9c7e00640 1 -- 172.21.15.82:0/4148905670 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9cc036030 con 0x563e869ea0a0 2024-06-06T02:36:51.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.305+0000 7fd9c7e00640 1 -- 172.21.15.82:0/4148905670 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc02f880 con 0x563e869ea0a0 2024-06-06T02:36:51.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.306+0000 7fd9d3400640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 0x7fd9c00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.306+0000 7fd9d3400640 1 -- 172.21.15.82:0/217900935 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd9c80e2530 con 0x7fd9dc110150 2024-06-06T02:36:51.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.306+0000 7fd9db400640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 0x7fd9c00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 -- 172.21.15.82:0/4148905670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 msgr2=0x563e86db92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc06a380 tx=0x7fd9cc009490 comp rx=0 tx=0).stop 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9db400640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 0x7fd9c00b4d00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x563e86db5fd0 tx=0x7fd9d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 -- 172.21.15.82:0/4148905670 shutdown_connections 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86db9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86db92f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 --2- 172.21.15.82:0/4148905670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e86a12f60 0x563e86db8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 -- 172.21.15.82:0/4148905670 >> 172.21.15.82:0/4148905670 conn(0x563e86a07350 msgr2=0x563e86db5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 -- 172.21.15.82:0/4148905670 shutdown_connections 2024-06-06T02:36:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.307+0000 7fd9e807e740 1 -- 172.21.15.82:0/4148905670 wait complete. 2024-06-06T02:36:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.308+0000 7fd9e807e740 1 -- start start 2024-06-06T02:36:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.308+0000 7fd9e807e740 1 Processor -- start 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86dc3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e86b815f0 con 0x563e869f2280 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e86cba5e0 con 0x563e869ea0a0 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563e86dc5ec0 con 0x563e86a12f60 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9e807e740 10 client.0 _ll_register_callbacks cb 0x563e86cd3360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9da000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86dc3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43022/0 (socket says 172.21.15.82:43022) 2024-06-06T02:36:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 -- 172.21.15.82:0/484239653 learned_addr learned my addr 172.21.15.82:0/484239653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9db400640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 -- 172.21.15.82:0/484239653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 msgr2=0x563e86dc9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 -- 172.21.15.82:0/484239653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 msgr2=0x563e86dc3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86dc3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.309+0000 7fd9daa00640 1 -- 172.21.15.82:0/484239653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e86ce5d50 con 0x563e869ea0a0 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.310+0000 7fd9daa00640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc02ae30 tx=0x7fd9cc031690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ae79ddc2cd31a2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.310+0000 7fd9c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:36:51.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.310+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc04a040 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.310+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9cc036030 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.310+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd9cc031800 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.311+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9cc02f3e0 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.311+0000 7fd9e807e740 10 client.25013 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.311+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563e86dd1fa0 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.311+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9cc036030 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.311+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd9cc059030 con 0x563e869ea0a0 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 10 client.25013 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 10 client.25013 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 20 client.25013 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869d18e0 0x563e86dd55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 4 client.25013 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:36:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e86d2faf0 con 0x563e869d18e0 2024-06-06T02:36:51.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.312+0000 7fd9da000640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869d18e0 0x563e86dd55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.313+0000 7fd9da000640 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869d18e0 0x563e86dd55c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9cbf886f525a762 server_cookie=fed9f23331f434f0 in_seq=0 out_seq=0 2024-06-06T02:36:51.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.313+0000 7fd9c4c00640 10 client.25013 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.313+0000 7fd9c4c00640 1 -- 172.21.15.82:0/484239653 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563e86d2faf0 con 0x563e869d18e0 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.313+0000 7fd9c4c00640 10 client.25013 handle_command_reply: tid=0 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 client.25013 shutdown 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 msgr2=0x563e86dc3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc02ae30 tx=0x7fd9cc031690 comp rx=0 tx=0).stop 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 shutdown_connections 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869d18e0 0x563e86dd55c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86dc3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9c4c00640 0 client.25013 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 --2- 172.21.15.82:0/484239653 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dc3440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 >> 172.21.15.82:0/484239653 conn(0x563e86a07350 msgr2=0x563e86dbab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 shutdown_connections 2024-06-06T02:36:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 1 -- 172.21.15.82:0/484239653 wait complete. 2024-06-06T02:36:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.314+0000 7fd9e807e740 20 client.25013 trim_cache size 0 max 16384 2024-06-06T02:36:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.334+0000 7fd9e807e740 1 Processor -- start 2024-06-06T02:36:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 -- start start 2024-06-06T02:36:51.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86db5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd3900 con 0x563e869f2280 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd3fd0 con 0x563e869ea0a0 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9e807e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd46a0 con 0x563e86a12f60 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9db400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43038/0 (socket says 172.21.15.82:43038) 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9daa00640 1 -- 172.21.15.82:0/2677159377 learned_addr learned my addr 172.21.15.82:0/2677159377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.335+0000 7fd9da000640 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86db5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 -- 172.21.15.82:0/2677159377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 msgr2=0x563e86dd4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 -- 172.21.15.82:0/2677159377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 msgr2=0x563e86db5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86db5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 -- 172.21.15.82:0/2677159377 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e86dc5b10 con 0x563e86a12f60 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9daa00640 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9db400640 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc27a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4012cb0 tx=0x7fd9d401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45bbf3f956693a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.336+0000 7fd9c7400640 1 -- 172.21.15.82:0/2677159377 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4003cc0 con 0x563e86a12f60 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9c7400640 1 -- 172.21.15.82:0/2677159377 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9d40054d0 con 0x563e86a12f60 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9c7400640 1 -- 172.21.15.82:0/2677159377 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401e470 con 0x563e86a12f60 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9e807e740 1 -- 172.21.15.82:0/2677159377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 msgr2=0x563e86dc27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9e807e740 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc27a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4012cb0 tx=0x7fd9d401b000 comp rx=0 tx=0).stop 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9e807e740 1 -- 172.21.15.82:0/2677159377 shutdown_connections 2024-06-06T02:36:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.337+0000 7fd9e807e740 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e86a12f60 0x563e86dc27a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869f2280 0x563e86db5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 --2- 172.21.15.82:0/2677159377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e869ea0a0 0x563e86dd4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 -- 172.21.15.82:0/2677159377 >> 172.21.15.82:0/2677159377 conn(0x563e86a07350 msgr2=0x563e86db5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 -- 172.21.15.82:0/2677159377 shutdown_connections 2024-06-06T02:36:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 -- 172.21.15.82:0/2677159377 wait complete. 2024-06-06T02:36:51.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.338+0000 7fd9e807e740 1 -- start start 2024-06-06T02:36:51.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 Processor -- start 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e86a12f60 0x563e86dcf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd5440 con 0x563e869ea0a0 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd4d70 con 0x563e86a12f60 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563e86dd5b10 con 0x563e869f2280 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9e807e740 10 client.0 _ll_register_callbacks cb 0x7fd9d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9da000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9daa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43988/0 (socket says 172.21.15.82:43988) 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9da000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37868/0 (socket says 172.21.15.82:37868) 2024-06-06T02:36:51.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9daa00640 1 -- 172.21.15.82:0/674054073 learned_addr learned my addr 172.21.15.82:0/674054073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.339+0000 7fd9db400640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e86a12f60 0x563e86dcf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 -- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e86a12f60 msgr2=0x563e86dcf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e86a12f60 0x563e86dcf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 -- 172.21.15.82:0/674054073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 msgr2=0x563e86ddd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 -- 172.21.15.82:0/674054073 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e86dde4a0 con 0x563e869f2280 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9daa00640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9da000640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80dfff0 tx=0x7fd9c80dfec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44c34459cc972b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.340+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8010720 con 0x563e869f2280 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd9c8010a90 con 0x563e869f2280 2024-06-06T02:36:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9d40054d0 con 0x563e869f2280 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9c80b22b0 con 0x563e869f2280 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9e807e740 10 client.25054 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563e86dc87e0 con 0x563e869f2280 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.341+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9d40054d0 con 0x563e869f2280 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7fd9c80a5e50 con 0x563e869f2280 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 10 client.25054 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 10 client.25054 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 20 client.25054 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869a6c90 0x563e86e416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 4 client.25054 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:36:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "status"}) -- 0x563e86d2b590 con 0x563e869a6c90 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9daa00640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869a6c90 0x563e86e416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9daa00640 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869a6c90 0x563e86e416e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d293af17f14d4d6d server_cookie=ff838566a94c1d01 in_seq=0 out_seq=0 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.342+0000 7fd9c4c00640 10 client.25054 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9c4c00640 1 -- 172.21.15.82:0/674054073 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563e86d2b590 con 0x563e869a6c90 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9c4c00640 10 client.25054 handle_command_reply: tid=0 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 client.25054 shutdown 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 msgr2=0x563e86dddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80dfff0 tx=0x7fd9c80dfec0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 shutdown_connections 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x563e869a6c90 0x563e86e416e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563e86a12f60 0x563e86dcf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563e869f2280 0x563e86dddde0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 --2- 172.21.15.82:0/674054073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e869ea0a0 0x563e86ddd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9c4c00640 0 client.25054 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 >> 172.21.15.82:0/674054073 conn(0x563e86a07350 msgr2=0x563e86dba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 shutdown_connections 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 1 -- 172.21.15.82:0/674054073 wait complete. 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.343+0000 7fd9e807e740 20 client.25054 trim_cache size 0 max 16384 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-06-06T02:36:51.346 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24659, 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 149.434873955, 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 185.82810061399999 2024-06-06T02:36:51.347 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 msgr2=0x7fd9c00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 0x7fd9c00b4d00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x563e86db5fd0 tx=0x7fd9d4005f90 comp rx=0 tx=0).stop 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 msgr2=0x7fd9dc10c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e9f0 tx=0x7fd9c800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 shutdown_connections 2024-06-06T02:36:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd9c00b27f0 0x7fd9c00b4d00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc110aa0 0x7fd9dc10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9dc110150 0x7fd9dc10c720 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 --2- 172.21.15.82:0/217900935 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9dc10b390 0x7fd9dc10c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.344+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 >> 172.21.15.82:0/217900935 conn(0x7fd9dc06e3f0 msgr2=0x7fd9dc0736d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.345+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 shutdown_connections 2024-06-06T02:36:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:51.345+0000 7fd9e1a00640 1 -- 172.21.15.82:0/217900935 wait complete. 2024-06-06T02:36:52.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T02:36:52.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:52 smithi082 ceph-mon[31579]: pgmap v418: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:52.751 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:52 smithi103 ceph-mon[36349]: pgmap v418: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:52 smithi184 ceph-mon[36922]: pgmap v418: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:54.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:54 smithi082 ceph-mon[31579]: pgmap v419: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:54.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:54 smithi103 ceph-mon[36349]: pgmap v419: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:54.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:54 smithi184 ceph-mon[36922]: pgmap v419: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 -- 172.21.15.82:0/3233919473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 msgr2=0x7efd48111ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3233919473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd48111ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd40009c40 tx=0x7efd4002a720 comp rx=0 tx=0).stop 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 -- 172.21.15.82:0/3233919473 shutdown_connections 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3233919473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd48111ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3233919473 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd48109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3233919473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 0x7efd48105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 -- 172.21.15.82:0/3233919473 >> 172.21.15.82:0/3233919473 conn(0x7efd48100b60 msgr2=0x7efd48102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 -- 172.21.15.82:0/3233919473 shutdown_connections 2024-06-06T02:36:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.916+0000 7efd4ee00640 1 -- 172.21.15.82:0/3233919473 wait complete. 2024-06-06T02:36:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 Processor -- start 2024-06-06T02:36:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 -- start start 2024-06-06T02:36:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 0x7efd481a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd4819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd481150c0 con 0x7efd4810a380 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efd48114f40 con 0x7efd48105100 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.918+0000 7efd4ee00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7efd48115240 con 0x7efd48109a30 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd4ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd4819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd47e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 0x7efd481a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45466/0 (socket says 172.21.15.82:45466) 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 -- 172.21.15.82:0/3898381022 learned_addr learned my addr 172.21.15.82:0/3898381022 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 -- 172.21.15.82:0/3898381022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 msgr2=0x7efd481a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 0x7efd481a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 -- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 msgr2=0x7efd4819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd4819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd3fe00640 1 -- 172.21.15.82:0/3898381022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4819c040 con 0x7efd48109a30 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.919+0000 7efd4ce00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd4819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd3fe00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd3000e9c0 tx=0x7efd3000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd45600640 1 -- 172.21.15.82:0/3898381022 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3000ccc0 con 0x7efd48109a30 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd45600640 1 -- 172.21.15.82:0/3898381022 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd300054d0 con 0x7efd48109a30 2024-06-06T02:36:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4819c330 con 0x7efd48109a30 2024-06-06T02:36:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd45600640 1 -- 172.21.15.82:0/3898381022 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30010430 con 0x7efd48109a30 2024-06-06T02:36:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.920+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481a8640 con 0x7efd48109a30 2024-06-06T02:36:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.924+0000 7efd55399740 1 Processor -- start 2024-06-06T02:36:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.924+0000 7efd55399740 1 -- start start 2024-06-06T02:36:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.924+0000 7efd45600640 1 -- 172.21.15.82:0/3898381022 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efd30005020 con 0x7efd48109a30 2024-06-06T02:36:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 0x560657975db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x5606579762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657976830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5606578eaba0 con 0x5606575af280 2024-06-06T02:36:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5606578da140 con 0x5606575cff60 2024-06-06T02:36:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd55399740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5606578de180 con 0x5606575a70a0 2024-06-06T02:36:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657976830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd47e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x5606579762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657976830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33610/0 (socket says 172.21.15.82:33610) 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd3fe00640 1 -- 172.21.15.82:0/727575604 learned_addr learned my addr 172.21.15.82:0/727575604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd4ce00640 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 0x560657975db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.925+0000 7efd47e00640 1 -- 172.21.15.82:0/727575604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 msgr2=0x560657975db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd47e00640 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 0x560657975db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd47e00640 1 -- 172.21.15.82:0/727575604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 msgr2=0x560657976830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd47e00640 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657976830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd47e00640 1 -- 172.21.15.82:0/727575604 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56065763b540 con 0x5606575a70a0 2024-06-06T02:36:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd4ce00640 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 0x560657975db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd47e00640 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x5606579762f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd38009530 tx=0x7efd38011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba76dff4bb30c91 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd45600640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 0x7efd2c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd3d600640 1 -- 172.21.15.82:0/727575604 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38004220 con 0x5606575a70a0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd45600640 1 -- 172.21.15.82:0/3898381022 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efd300e24f0 con 0x7efd48109a30 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd3d600640 1 -- 172.21.15.82:0/727575604 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380043c0 con 0x5606575a70a0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.926+0000 7efd4ce00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 0x7efd2c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.927+0000 7efd3d600640 1 -- 172.21.15.82:0/727575604 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38019780 con 0x5606575a70a0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd4ce00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 0x7efd2c0b4d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd40006010 tx=0x7efd400092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- 172.21.15.82:0/727575604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 msgr2=0x5606579762f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x5606579762f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efd38009530 tx=0x7efd38011810 comp rx=0 tx=0).stop 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- 172.21.15.82:0/727575604 shutdown_connections 2024-06-06T02:36:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657976830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x5606579762f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 --2- 172.21.15.82:0/727575604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575cff60 0x560657975db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- 172.21.15.82:0/727575604 >> 172.21.15.82:0/727575604 conn(0x5606575c4350 msgr2=0x560657972620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- 172.21.15.82:0/727575604 shutdown_connections 2024-06-06T02:36:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- 172.21.15.82:0/727575604 wait complete. 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.928+0000 7efd55399740 1 -- start start 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 Processor -- start 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 0x5606579803e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657986220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56065773e5f0 con 0x5606575af280 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5606578775e0 con 0x5606575a70a0 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560657982f20 con 0x5606575cff60 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd55399740 10 client.0 _ll_register_callbacks cb 0x560657890360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.929+0000 7efd47e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 0x5606579803e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33626/0 (socket says 172.21.15.82:33626) 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd3fe00640 1 -- 172.21.15.82:0/746435413 learned_addr learned my addr 172.21.15.82:0/746435413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd4ce00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657986220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 -- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 msgr2=0x560657986220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657986220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 -- 172.21.15.82:0/746435413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 msgr2=0x560657980920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 -- 172.21.15.82:0/746435413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606578a2d50 con 0x5606575a70a0 2024-06-06T02:36:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd3fe00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd47e00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 0x5606579803e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd3801b040 tx=0x7efd380038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743207343027b21c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.930+0000 7efd36000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38028070 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd380043c0 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efd38005250 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd38034050 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd55399740 10 client.25031 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56065798ef40 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.931+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380043c0 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7efd38004b70 con 0x5606575a70a0 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 10 client.25031 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 10 client.25031 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T02:36:54.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 20 client.25031 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56065758e8e0 0x560657992790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 4 client.25031 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606578ecaf0 con 0x56065758e8e0 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.932+0000 7efd3fe00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56065758e8e0 0x560657992790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.933+0000 7efd3fe00640 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56065758e8e0 0x560657992790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cf29bf863f294dc server_cookie=8175baefaab2e811 in_seq=0 out_seq=0 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.933+0000 7efd36000640 10 client.25031 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd36000640 1 -- 172.21.15.82:0/746435413 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5606578ecaf0 con 0x56065758e8e0 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd36000640 10 client.25031 handle_command_reply: tid=0 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 client.25031 shutdown 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 msgr2=0x5606579803e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 0x5606579803e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd3801b040 tx=0x7efd380038a0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 shutdown_connections 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56065758e8e0 0x560657992790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657986220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575af280 0x560657980920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 --2- 172.21.15.82:0/746435413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575a70a0 0x5606579803e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd36000640 0 client.25031 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 >> 172.21.15.82:0/746435413 conn(0x5606575c4350 msgr2=0x560657977b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.934+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 shutdown_connections 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.935+0000 7efd55399740 1 -- 172.21.15.82:0/746435413 wait complete. 2024-06-06T02:36:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.935+0000 7efd55399740 20 client.25031 trim_cache size 0 max 16384 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.955+0000 7efd55399740 1 Processor -- start 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.955+0000 7efd55399740 1 -- start start 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x560657992790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x560657976b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 0x560657979b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560657990ad0 con 0x5606575cff60 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5606579911a0 con 0x5606575af280 2024-06-06T02:36:54.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd55399740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560657991870 con 0x5606575a70a0 2024-06-06T02:36:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd4ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 0x560657979b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd47e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x560657992790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd4ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 0x560657979b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33634/0 (socket says 172.21.15.82:33634) 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd4ce00640 1 -- 172.21.15.82:0/2634501588 learned_addr learned my addr 172.21.15.82:0/2634501588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.956+0000 7efd3fe00640 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x560657976b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 -- 172.21.15.82:0/2634501588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 msgr2=0x560657976b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x560657976b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 -- 172.21.15.82:0/2634501588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 msgr2=0x560657979b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 0x560657979b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 -- 172.21.15.82:0/2634501588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560657980da0 con 0x5606575a70a0 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd47e00640 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x560657992790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd38005780 tx=0x7efd38000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374bdc35cd9e05a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd3cc00640 1 -- 172.21.15.82:0/2634501588 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3803d070 con 0x5606575a70a0 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd3cc00640 1 -- 172.21.15.82:0/2634501588 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd38009e70 con 0x5606575a70a0 2024-06-06T02:36:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.957+0000 7efd3cc00640 1 -- 172.21.15.82:0/2634501588 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38028040 con 0x5606575a70a0 2024-06-06T02:36:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 -- 172.21.15.82:0/2634501588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 msgr2=0x560657992790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x560657992790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efd38005780 tx=0x7efd38000bc0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 -- 172.21.15.82:0/2634501588 shutdown_connections 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575cff60 0x560657979b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x560657976b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 --2- 172.21.15.82:0/2634501588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575a70a0 0x560657992790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 -- 172.21.15.82:0/2634501588 >> 172.21.15.82:0/2634501588 conn(0x5606575c4350 msgr2=0x56065797b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.958+0000 7efd55399740 1 -- 172.21.15.82:0/2634501588 shutdown_connections 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.959+0000 7efd55399740 1 -- 172.21.15.82:0/2634501588 wait complete. 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.959+0000 7efd55399740 1 -- start start 2024-06-06T02:36:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.959+0000 7efd55399740 1 Processor -- start 2024-06-06T02:36:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575a70a0 0x56065799aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657985180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560657992610 con 0x5606575a70a0 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560657991f40 con 0x5606575af280 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560657992ce0 con 0x5606575cff60 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd55399740 10 client.0 _ll_register_callbacks cb 0x7efd38011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd3fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41376/0 (socket says 172.21.15.82:41376) 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd3fe00640 1 -- 172.21.15.82:0/4106865207 learned_addr learned my addr 172.21.15.82:0/4106865207 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.960+0000 7efd4ce00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657985180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 -- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 msgr2=0x560657985180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657985180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 -- 172.21.15.82:0/4106865207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575a70a0 msgr2=0x56065799aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575a70a0 0x56065799aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 -- 172.21.15.82:0/4106865207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56065799b5f0 con 0x5606575af280 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd3fe00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c6a0 tx=0x7efd300dfe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7432cddd16095851 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd36000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3000ce60 con 0x5606575af280 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd38009e70 con 0x5606575af280 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.961+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7efd300a60c0 con 0x5606575af280 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd300a5260 con 0x5606575af280 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 10 client.25037 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:54.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56065798c600 con 0x5606575af280 2024-06-06T02:36:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd38009e70 con 0x5606575af280 2024-06-06T02:36:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7efd300a9d30 con 0x5606575af280 2024-06-06T02:36:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 10 client.25037 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 10 client.25037 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 20 client.25037 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x560657563c90 0x5606579fe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 4 client.25037 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.962+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "status"}) -- 0x5606578e8590 con 0x560657563c90 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.963+0000 7efd47e00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x560657563c90 0x5606579fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.963+0000 7efd47e00640 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x560657563c90 0x5606579fe560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c5bdce894992309 server_cookie=7bedcd5182cfd56c in_seq=0 out_seq=0 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.963+0000 7efd36000640 10 client.25037 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd36000640 1 -- 172.21.15.82:0/4106865207 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5606578e8590 con 0x560657563c90 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd36000640 10 client.25037 handle_command_reply: tid=0 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 client.25037 shutdown 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 msgr2=0x56065799afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c6a0 tx=0x7efd300dfe80 comp rx=0 tx=0).stop 2024-06-06T02:36:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 shutdown_connections 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x560657563c90 0x5606579fe560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606575cff60 0x560657985180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5606575af280 0x56065799afb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 --2- 172.21.15.82:0/4106865207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606575a70a0 0x56065799aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 >> 172.21.15.82:0/4106865207 conn(0x5606575c4350 msgr2=0x56065797ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd36000640 0 client.25037 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 shutdown_connections 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 1 -- 172.21.15.82:0/4106865207 wait complete. 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.964+0000 7efd55399740 20 client.25037 trim_cache size 0 max 16384 2024-06-06T02:36:54.966 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24664, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 154.069592511, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 201.718595609 2024-06-06T02:36:54.967 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:36:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 msgr2=0x7efd2c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 0x7efd2c0b4d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efd40006010 tx=0x7efd400092a0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 msgr2=0x7efd481a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd3000e9c0 tx=0x7efd3000ee80 comp rx=0 tx=0).stop 2024-06-06T02:36:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 shutdown_connections 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd4810a380 0x7efd4819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7efd2c0b27f0 0x7efd2c0b4d00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd48109a30 0x7efd481a1cf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 --2- 172.21.15.82:0/3898381022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efd48105100 0x7efd481a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 >> 172.21.15.82:0/3898381022 conn(0x7efd48100b60 msgr2=0x7efd48101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 shutdown_connections 2024-06-06T02:36:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:54.965+0000 7efd4ee00640 1 -- 172.21.15.82:0/3898381022 wait complete. 2024-06-06T02:36:55.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.g status 2024-06-06T02:36:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:36:56.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:56 smithi082 ceph-mon[31579]: pgmap v420: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:56 smithi103 ceph-mon[36349]: pgmap v420: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:56 smithi184 ceph-mon[36922]: pgmap v420: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:36:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.587+0000 7f4836200640 1 -- 172.21.15.82:0/81627655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 msgr2=0x7f4830111cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.587+0000 7f4836200640 1 --2- 172.21.15.82:0/81627655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f4830111cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4828009890 tx=0x7f482802a360 comp rx=0 tx=0).stop 2024-06-06T02:36:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 -- 172.21.15.82:0/81627655 shutdown_connections 2024-06-06T02:36:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 --2- 172.21.15.82:0/81627655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f4830111cc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 --2- 172.21.15.82:0/81627655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 0x7f4830109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 --2- 172.21.15.82:0/81627655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 -- 172.21.15.82:0/81627655 >> 172.21.15.82:0/81627655 conn(0x7f4830100b40 msgr2=0x7f4830102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 -- 172.21.15.82:0/81627655 shutdown_connections 2024-06-06T02:36:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.588+0000 7f4836200640 1 -- 172.21.15.82:0/81627655 wait complete. 2024-06-06T02:36:58.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.589+0000 7f4836200640 1 Processor -- start 2024-06-06T02:36:58.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.589+0000 7f4836200640 1 -- start start 2024-06-06T02:36:58.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 0x7f48301a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f483019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4830115090 con 0x7f4830109a10 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4830114f10 con 0x7f48301050e0 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f4836200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4830115210 con 0x7f483010a360 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f482f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f482ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 0x7f48301a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f482f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41396/0 (socket says 172.21.15.82:41396) 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f482f400640 1 -- 172.21.15.82:0/96828696 learned_addr learned my addr 172.21.15.82:0/96828696 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.590+0000 7f482fe00640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f483019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 -- 172.21.15.82:0/96828696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 msgr2=0x7f483019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f483019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 -- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 msgr2=0x7f48301a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 0x7f48301a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 -- 172.21.15.82:0/96828696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483019bf30 con 0x7f48301050e0 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f482f400640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f482000eb90 tx=0x7f482000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f4827e00640 1 -- 172.21.15.82:0/96828696 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820004d20 con 0x7f48301050e0 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483019c220 con 0x7f48301050e0 2024-06-06T02:36:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f4827e00640 1 -- 172.21.15.82:0/96828696 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f482000ee90 con 0x7f48301050e0 2024-06-06T02:36:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f4827e00640 1 -- 172.21.15.82:0/96828696 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820010670 con 0x7f48301050e0 2024-06-06T02:36:58.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.591+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48301a8530 con 0x7f48301050e0 2024-06-06T02:36:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.596+0000 7f483c844740 1 Processor -- start 2024-06-06T02:36:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.596+0000 7f483c844740 1 -- start start 2024-06-06T02:36:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.596+0000 7f483c844740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f483c844740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 0x55c3755ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f483c844740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375203280 0x55c3755ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f483c844740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c37553eba0 con 0x55c375203280 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f483c844740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c37552e140 con 0x55c3751fb0a0 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f483c844740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c375532180 con 0x55c375223f60 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f4827e00640 1 -- 172.21.15.82:0/96828696 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4820005020 con 0x7f48301050e0 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375203280 0x55c3755ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45526/0 (socket says 172.21.15.82:45526) 2024-06-06T02:36:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 -- 172.21.15.82:0/226595929 learned_addr learned my addr 172.21.15.82:0/226595929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482f400640 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 0x55c3755ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 -- 172.21.15.82:0/226595929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 msgr2=0x55c3755ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 0x55c3755ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 -- 172.21.15.82:0/226595929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375203280 msgr2=0x55c3755ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375203280 0x55c3755ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.597+0000 7f482fe00640 1 -- 172.21.15.82:0/226595929 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c37528f540 con 0x55c375223f60 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.598+0000 7f482f400640 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 0x55c3755ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.598+0000 7f482fe00640 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4828035040 tx=0x7f4828005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b91c678d0b35e0d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.598+0000 7f4824c00640 1 -- 172.21.15.82:0/226595929 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828043020 con 0x55c375223f60 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.598+0000 7f4824c00640 1 -- 172.21.15.82:0/226595929 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4828038040 con 0x55c375223f60 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.598+0000 7f4824c00640 1 -- 172.21.15.82:0/226595929 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828037040 con 0x55c375223f60 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f4827e00640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 0x7f48140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 -- 172.21.15.82:0/226595929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 msgr2=0x55c3755c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4828035040 tx=0x7f4828005e00 comp rx=0 tx=0).stop 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f482f400640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 0x7f48140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 -- 172.21.15.82:0/226595929 shutdown_connections 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375203280 0x55c3755ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c3751fb0a0 0x55c3755ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 --2- 172.21.15.82:0/226595929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755c9db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 -- 172.21.15.82:0/226595929 >> 172.21.15.82:0/226595929 conn(0x55c375218350 msgr2=0x55c3755c6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f4827e00640 1 -- 172.21.15.82:0/96828696 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48200e2870 con 0x7f48301050e0 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.599+0000 7f483c844740 1 -- 172.21.15.82:0/226595929 shutdown_connections 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.600+0000 7f483c844740 1 -- 172.21.15.82:0/226595929 wait complete. 2024-06-06T02:36:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.600+0000 7f482f400640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 0x7f48140b4d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f48200a70c0 tx=0x7f482000cf90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.600+0000 7f483c844740 1 -- start start 2024-06-06T02:36:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.600+0000 7f483c844740 1 Processor -- start 2024-06-06T02:36:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3751fb0a0 0x55c3755d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3753925f0 con 0x55c375223f60 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c3754cb5e0 con 0x55c375203280 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c3755d6ec0 con 0x55c3751fb0a0 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f483c844740 10 client.0 _ll_register_callbacks cb 0x55c3754e4360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41424/0 (socket says 172.21.15.82:41424) 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33678/0 (socket says 172.21.15.82:33678) 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482ea00640 1 -- 172.21.15.82:0/3810713318 learned_addr learned my addr 172.21.15.82:0/3810713318 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.601+0000 7f482fe00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3751fb0a0 0x55c3755d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 -- 172.21.15.82:0/3810713318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3751fb0a0 msgr2=0x55c3755d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3751fb0a0 0x55c3755d4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 -- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 msgr2=0x55c3755da230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 -- 172.21.15.82:0/3810713318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3754f6d50 con 0x55c375203280 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482fe00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f482ea00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4818005fd0 tx=0x7f4818009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef684b6592d8abb server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f481d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818004020 con 0x55c375203280 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4828038040 con 0x55c375203280 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.602+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48180041c0 con 0x55c375203280 2024-06-06T02:36:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f48180043c0 con 0x55c375203280 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f483c844740 10 client.25046 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c3755e2f90 con 0x55c375203280 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4828038040 con 0x55c375203280 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f48180053f0 con 0x55c375203280 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.603+0000 7f483c844740 10 client.25046 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f483c844740 10 client.25046 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f483c844740 20 client.25046 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751e28e0 0x55c3755e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f483c844740 4 client.25046 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c375540af0 con 0x55c3751e28e0 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f482fe00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751e28e0 0x55c3755e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f482fe00640 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751e28e0 0x55c3755e6a60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd47fcde8d40bce server_cookie=c95031aa3a9bb820 in_seq=0 out_seq=0 2024-06-06T02:36:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.604+0000 7f481d600640 10 client.25046 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.605+0000 7f481d600640 1 -- 172.21.15.82:0/3810713318 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c375540af0 con 0x55c3751e28e0 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.605+0000 7f481d600640 10 client.25046 handle_command_reply: tid=0 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.605+0000 7f483c844740 1 client.25046 shutdown 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 msgr2=0x55c3755d4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4818005fd0 tx=0x7f4818009f90 comp rx=0 tx=0).stop 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 shutdown_connections 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751e28e0 0x55c3755e6a60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c375223f60 0x55c3755da230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d4a40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 --2- 172.21.15.82:0/3810713318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c3751fb0a0 0x55c3755d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f481d600640 0 client.25046 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:36:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 >> 172.21.15.82:0/3810713318 conn(0x55c375218350 msgr2=0x55c3755c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 shutdown_connections 2024-06-06T02:36:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 1 -- 172.21.15.82:0/3810713318 wait complete. 2024-06-06T02:36:58.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.606+0000 7f483c844740 20 client.25046 trim_cache size 0 max 16384 2024-06-06T02:36:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.626+0000 7f483c844740 1 Processor -- start 2024-06-06T02:36:58.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.626+0000 7f483c844740 1 -- start start 2024-06-06T02:36:58.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:58 smithi082 ceph-mon[31579]: pgmap v421: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e4da0 con 0x55c3751fb0a0 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e5470 con 0x55c375203280 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f483c844740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e5b40 con 0x55c375223f60 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33684/0 (socket says 172.21.15.82:33684) 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f482fe00640 1 -- 172.21.15.82:0/2996709359 learned_addr learned my addr 172.21.15.82:0/2996709359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f482ea00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.627+0000 7f482fe00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 -- 172.21.15.82:0/2996709359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 msgr2=0x55c3755d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755d4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 -- 172.21.15.82:0/2996709359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 msgr2=0x55c3755d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 -- 172.21.15.82:0/2996709359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3755da5a0 con 0x55c3751fb0a0 2024-06-06T02:36:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482ea00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f482fe00640 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4828004340 tx=0x7f4828030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929da77a0e483933 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f481fe00640 1 -- 172.21.15.82:0/2996709359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828043040 con 0x55c3751fb0a0 2024-06-06T02:36:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f481fe00640 1 -- 172.21.15.82:0/2996709359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4828005050 con 0x55c3751fb0a0 2024-06-06T02:36:58.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.628+0000 7f481fe00640 1 -- 172.21.15.82:0/2996709359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48280046c0 con 0x55c3751fb0a0 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 -- 172.21.15.82:0/2996709359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 msgr2=0x55c3755e6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4828004340 tx=0x7f4828030340 comp rx=0 tx=0).stop 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 -- 172.21.15.82:0/2996709359 shutdown_connections 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375223f60 0x55c3755d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375203280 0x55c3755d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 --2- 172.21.15.82:0/2996709359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755e6a60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.629+0000 7f483c844740 1 -- 172.21.15.82:0/2996709359 >> 172.21.15.82:0/2996709359 conn(0x55c375218350 msgr2=0x55c3755ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.630+0000 7f483c844740 1 -- 172.21.15.82:0/2996709359 shutdown_connections 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.630+0000 7f483c844740 1 -- 172.21.15.82:0/2996709359 wait complete. 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.630+0000 7f483c844740 1 -- start start 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.630+0000 7f483c844740 1 Processor -- start 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 0x55c3755ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375223f60 0x55c3755eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e68e0 con 0x55c3751fb0a0 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e6210 con 0x55c375223f60 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c3755e6fb0 con 0x55c375203280 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f483c844740 10 client.0 _ll_register_callbacks cb 0x7f4818009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:36:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f482fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33698/0 (socket says 172.21.15.82:33698) 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f482fe00640 1 -- 172.21.15.82:0/3623285779 learned_addr learned my addr 172.21.15.82:0/3623285779 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f482ea00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 0x55c3755ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.631+0000 7f482fe00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375223f60 0x55c3755eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 -- 172.21.15.82:0/3623285779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375223f60 msgr2=0x55c3755eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375223f60 0x55c3755eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 -- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 msgr2=0x55c3755ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 -- 172.21.15.82:0/3623285779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3755ee580 con 0x55c375203280 2024-06-06T02:36:58.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482fe00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:36:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f482ea00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 0x55c3755ef5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4818001eb0 tx=0x7f481800fe30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c36e614df9cf86 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:36:58.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f481d600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:36:58.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481800fea0 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4828005050 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.632+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4818004660 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4818037050 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 10 client.25090 fetch_fsmap learned FSMap version 25 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c37564e750 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4828005050 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f481801c770 con 0x55c375203280 2024-06-06T02:36:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 10 client.25090 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 10 client.25090 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 20 client.25090 populate_metadata read hostname 'smithi082' 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.633+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751b7c90 0x55c375651f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.634+0000 7f483c844740 4 client.25090 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.634+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "status"}) -- 0x55c37553c590 con 0x55c3751b7c90 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.634+0000 7f482fe00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751b7c90 0x55c375651f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.634+0000 7f482fe00640 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751b7c90 0x55c375651f60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bbda4b9104258f server_cookie=291b71b4ed20317 in_seq=0 out_seq=0 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.634+0000 7f481d600640 10 client.25090 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f481d600640 1 -- 172.21.15.82:0/3623285779 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c37553c590 con 0x55c3751b7c90 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f481d600640 10 client.25090 handle_command_reply: tid=0 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 client.25090 shutdown 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 msgr2=0x55c3755ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 0x55c3755ef5a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4818001eb0 tx=0x7f481800fe30 comp rx=0 tx=0).stop 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 shutdown_connections 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c375223f60 0x55c3755eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c375203280 0x55c3755ef5a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c3751b7c90 0x55c375651f60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 --2- 172.21.15.82:0/3623285779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c3751fb0a0 0x55c3755ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.635+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 >> 172.21.15.82:0/3623285779 conn(0x55c375218350 msgr2=0x55c3755c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.636+0000 7f481d600640 0 client.25090 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.636+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 shutdown_connections 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.636+0000 7f483c844740 1 -- 172.21.15.82:0/3623285779 wait complete. 2024-06-06T02:36:58.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.636+0000 7f483c844740 20 client.25090 trim_cache size 0 max 16384 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24676, 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 175.006786737, 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:36:58.640 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:36:58.641 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:36:58.641 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 201.08732932300001 2024-06-06T02:36:58.641 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:36:58.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 msgr2=0x7f48140b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 0x7f48140b4d00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f48200a70c0 tx=0x7f482000cf90 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 msgr2=0x7f48301a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f482000eb90 tx=0x7f482000c6a0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 shutdown_connections 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48140b27f0 0x7f48140b4d00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f483010a360 0x7f483019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4830109a10 0x7f48301a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 --2- 172.21.15.82:0/96828696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48301050e0 0x7f48301a16a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 >> 172.21.15.82:0/96828696 conn(0x7f4830100b40 msgr2=0x7f4830101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 shutdown_connections 2024-06-06T02:36:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:36:58.637+0000 7f4836200640 1 -- 172.21.15.82:0/96828696 wait complete. 2024-06-06T02:36:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:58 smithi103 ceph-mon[36349]: pgmap v421: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:58 smithi184 ceph-mon[36922]: pgmap v421: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:36:59.552 INFO:tasks.cephadm:Setup complete, yielding 2024-06-06T02:36:59.553 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T02:36:59.571 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:36:59.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-06T02:36:59.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:36:59 smithi103 ceph-mon[36349]: pgmap v422: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:59.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:36:59 smithi082 ceph-mon[31579]: pgmap v422: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:36:59.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:36:59 smithi184 ceph-mon[36922]: pgmap v422: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:00.024 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:02.102 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:01 smithi082 ceph-mon[31579]: pgmap v423: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:02.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:01 smithi184 ceph-mon[36922]: pgmap v423: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 -- 172.21.15.82:0/720721163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f8105b70 msgr2=0x7f73f8108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 --2- 172.21.15.82:0/720721163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f8105b70 0x7f73f8108050 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ca0 tx=0x7f73e002a950 comp rx=0 tx=0).stop 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 -- 172.21.15.82:0/720721163 shutdown_connections 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 --2- 172.21.15.82:0/720721163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f810ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 --2- 172.21.15.82:0/720721163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f8105b70 0x7f73f8108050 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 --2- 172.21.15.82:0/720721163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f806b2b0 0x7f73f8105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 -- 172.21.15.82:0/720721163 >> 172.21.15.82:0/720721163 conn(0x7f73f80fd190 msgr2=0x7f73f80ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 -- 172.21.15.82:0/720721163 shutdown_connections 2024-06-06T02:37:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.314+0000 7f73f7e00640 1 -- 172.21.15.82:0/720721163 wait complete. 2024-06-06T02:37:02.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 Processor -- start 2024-06-06T02:37:02.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 -- start start 2024-06-06T02:37:02.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 0x7f73f8199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73f810e560 con 0x7f73f8108710 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f73f810e3e0 con 0x7f73f806b2b0 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.316+0000 7f73f7e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f73f810e6e0 con 0x7f73f8105b70 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 0x7f73f8199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51532/0 (socket says 172.21.15.82:51532) 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 0x7f73f8199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:48906/0 (socket says 172.21.15.82:48906) 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 -- 172.21.15.82:0/3920851470 learned_addr learned my addr 172.21.15.82:0/3920851470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:02.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f7400640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 -- 172.21.15.82:0/3920851470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 msgr2=0x7f73f8199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 0x7f73f8199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 -- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 msgr2=0x7f73f81a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:02.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f81a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 -- 172.21.15.82:0/3920851470 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f81a0cb0 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f7400640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.317+0000 7f73f6000640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73e0030040 tx=0x7f73e002fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.318+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0034040 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.318+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e00308f0 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.318+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f81a0f40 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.318+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0004840 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.318+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f81a1340 con 0x7f73f8105b70 2024-06-06T02:37:02.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.319+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f80fecb0 con 0x7f73f8105b70 2024-06-06T02:37:02.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.322+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f73e0037020 con 0x7f73f8105b70 2024-06-06T02:37:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.323+0000 7f73ef400640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 0x7f73d80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.323+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f73e01034c0 con 0x7f73f8105b70 2024-06-06T02:37:02.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.323+0000 7f73f6a00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 0x7f73d80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:02.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.324+0000 7f73f6a00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 0x7f73d80b4d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73f806afb0 tx=0x7f73e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:02.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.325+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f73e00cb230 con 0x7f73f8105b70 2024-06-06T02:37:02.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:01 smithi103 ceph-mon[36349]: pgmap v423: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:02.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.547+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f73f8062ba0 con 0x7f73d80b27f0 2024-06-06T02:37:02.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.549+0000 7f73ef400640 1 -- 172.21.15.82:0/3920851470 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f73f8062ba0 con 0x7f73d80b27f0 2024-06-06T02:37:02.548 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-06-06T02:37:02.548 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-06-06T02:37:02.548 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 msgr2=0x7f73d80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 0x7f73d80b4d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f73f806afb0 tx=0x7f73e8005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 msgr2=0x7f73f81996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73e0030040 tx=0x7f73e002fc20 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 shutdown_connections 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73f8108710 0x7f73f81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f73d80b27f0 0x7f73d80b4d00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73f8105b70 0x7f73f81996d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 --2- 172.21.15.82:0/3920851470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73f806b2b0 0x7f73f8199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:02.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.552+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 >> 172.21.15.82:0/3920851470 conn(0x7f73f80fd190 msgr2=0x7f73f8103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.553+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 shutdown_connections 2024-06-06T02:37:02.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:02.553+0000 7f73f7e00640 1 -- 172.21.15.82:0/3920851470 wait complete. 2024-06-06T02:37:03.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:02 smithi082 ceph-mon[31579]: from='client.25096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:03.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:02 smithi103 ceph-mon[36349]: from='client.25096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:03.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:02 smithi184 ceph-mon[36922]: from='client.25096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:03.437 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-06T02:37:03.875 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:04.203 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:03 smithi082 ceph-mon[31579]: pgmap v424: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:04.268 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:03 smithi103 ceph-mon[36349]: pgmap v424: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:04.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:03 smithi184 ceph-mon[36922]: pgmap v424: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 -- 172.21.15.82:0/1472528696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 msgr2=0x7f1c341041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 --2- 172.21.15.82:0/1472528696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c341041a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009be0 tx=0x7f1c1c02a6c0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 -- 172.21.15.82:0/1472528696 shutdown_connections 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 --2- 172.21.15.82:0/1472528696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c341046e0 0x7f1c3410afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 --2- 172.21.15.82:0/1472528696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c341041a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 --2- 172.21.15.82:0/1472528696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c34102c60 0x7f1c34103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 -- 172.21.15.82:0/1472528696 >> 172.21.15.82:0/1472528696 conn(0x7f1c340fe490 msgr2=0x7f1c34100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 -- 172.21.15.82:0/1472528696 shutdown_connections 2024-06-06T02:37:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.172+0000 7f1c38c00640 1 -- 172.21.15.82:0/1472528696 wait complete. 2024-06-06T02:37:06.174 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:05 smithi082 ceph-mon[31579]: pgmap v425: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.173+0000 7f1c38c00640 1 Processor -- start 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 -- start start 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c34102c60 0x7f1c34076400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c341046e0 0x7f1c34074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3410e790 con 0x7f1c34102c60 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3410e610 con 0x7f1c34103d90 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c38c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3410e910 con 0x7f1c341046e0 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c31e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c34102c60 0x7f1c34076400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c31400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c31400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:48936/0 (socket says 172.21.15.82:48936) 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c31400640 1 -- 172.21.15.82:0/2730099166 learned_addr learned my addr 172.21.15.82:0/2730099166 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.174+0000 7f1c32800640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c341046e0 0x7f1c34074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 -- 172.21.15.82:0/2730099166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c341046e0 msgr2=0x7f1c34074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c341046e0 0x7f1c34074ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 -- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c34102c60 msgr2=0x7f1c34076400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c34102c60 0x7f1c34076400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 -- 172.21.15.82:0/2730099166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c34075720 con 0x7f1c34103d90 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c31400640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034040 tx=0x7f1c1c030c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.175+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c041020 con 0x7f1c34103d90 2024-06-06T02:37:06.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.176+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c003e20 con 0x7f1c34103d90 2024-06-06T02:37:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.176+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c341a3470 con 0x7f1c34103d90 2024-06-06T02:37:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.176+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c036040 con 0x7f1c34103d90 2024-06-06T02:37:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.176+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c341a3860 con 0x7f1c34103d90 2024-06-06T02:37:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.177+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c34103070 con 0x7f1c34103d90 2024-06-06T02:37:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.179+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1c1c044020 con 0x7f1c34103d90 2024-06-06T02:37:06.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.181+0000 7f1c2aa00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 0x7f1c140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:06.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.181+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1c1c103260 con 0x7f1c34103d90 2024-06-06T02:37:06.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.181+0000 7f1c31e00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 0x7f1c140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:06.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.182+0000 7f1c31e00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 0x7f1c140b4d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c34103c90 tx=0x7f1c24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:06.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.182+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1c1c04b020 con 0x7f1c34103d90 2024-06-06T02:37:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:05 smithi103 ceph-mon[36349]: pgmap v425: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:06.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:05 smithi184 ceph-mon[36922]: pgmap v425: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.400+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1c34062ba0 con 0x7f1c140b27f0 2024-06-06T02:37:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.414+0000 7f1c2aa00640 1 -- 172.21.15.82:0/2730099166 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f1c34062ba0 con 0x7f1c140b27f0 2024-06-06T02:37:06.415 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-06T02:37:06.415 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (3m) 42s ago 3m 86.9M - 19.0.0-4083-g3c55257c 89767a4d6e85 6e8a2d8509c5 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi103 running (3m) 64s ago 3m 89.3M - 19.0.0-4083-g3c55257c 89767a4d6e85 594c98f72ece 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi184 running (3m) 64s ago 3m 86.7M - 19.0.0-4083-g3c55257c 89767a4d6e85 3169eebc007f 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (3m) 42s ago 3m 80.7M - 19.0.0-4083-g3c55257c 89767a4d6e85 7213d19da9f9 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi103 running (3m) 64s ago 3m 82.5M - 19.0.0-4083-g3c55257c 89767a4d6e85 5e2fab446b1a 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi184 running (3m) 64s ago 3m 89.0M - 19.0.0-4083-g3c55257c 89767a4d6e85 e032381c4358 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (3m) 42s ago 3m 92.7M - 19.0.0-4083-g3c55257c 89767a4d6e85 65108066dde0 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi103 running (3m) 64s ago 3m 82.4M - 19.0.0-4083-g3c55257c 89767a4d6e85 b55638e53048 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi184 running (3m) 64s ago 3m 86.7M - 19.0.0-4083-g3c55257c 89767a4d6e85 069b05fc18e1 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (3m) 42s ago 3m 80.7M - 19.0.0-4083-g3c55257c 89767a4d6e85 048a7ba5f691 2024-06-06T02:37:06.416 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi103 running (3m) 64s ago 3m 84.6M - 19.0.0-4083-g3c55257c 89767a4d6e85 73278f10d54f 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi184 running (3m) 64s ago 3m 81.9M - 19.0.0-4083-g3c55257c 89767a4d6e85 804892025ac2 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (12m) 42s ago 12m 590M - 19.0.0-4083-g3c55257c 89767a4d6e85 a95cc51a49b8 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi103 *:8443,8765 running (10m) 64s ago 10m 522M - 19.0.0-4083-g3c55257c 89767a4d6e85 4ac01346e753 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi184 *:8443,8765 running (10m) 64s ago 10m 521M - 19.0.0-4083-g3c55257c 89767a4d6e85 78403e9a8bb9 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (12m) 42s ago 12m 116M 2048M 19.0.0-4083-g3c55257c 89767a4d6e85 563b694cf93d 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi103 running (10m) 64s ago 10m 111M 2048M 19.0.0-4083-g3c55257c 89767a4d6e85 4c2c3bd7abfb 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi184 running (11m) 64s ago 10m 111M 2048M 19.0.0-4083-g3c55257c 89767a4d6e85 ca166eb3f822 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (9m) 42s ago 9m 123M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 bdf069ea824d 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi103 running (8m) 64s ago 8m 123M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 c9072f90d1cf 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi184 running (8m) 64s ago 8m 116M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 ae5207db7ed8 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (7m) 42s ago 7m 109M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 49d8d164c1e2 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi103 running (7m) 64s ago 7m 121M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 3f8c7c59945e 2024-06-06T02:37:06.417 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi184 running (7m) 64s ago 7m 112M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 8fda6ff2a2dd 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (6m) 42s ago 6m 119M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 bf08ca5b4afe 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi103 running (6m) 64s ago 6m 120M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 432935466bb4 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi184 running (5m) 64s ago 5m 110M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 e03e8ca5b17a 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (5m) 42s ago 5m 110M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 6d73511a283f 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi103 running (4m) 64s ago 4m 109M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 04cda07eae23 2024-06-06T02:37:06.418 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi184 running (4m) 64s ago 4m 108M 4272M 19.0.0-4083-g3c55257c 89767a4d6e85 5dd33256de68 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 msgr2=0x7f1c140b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 0x7f1c140b4d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c34103c90 tx=0x7f1c24005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 msgr2=0x7f1c34074ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034040 tx=0x7f1c1c030c80 comp rx=0 tx=0).stop 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 shutdown_connections 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c140b27f0 0x7f1c140b4d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c341046e0 0x7f1c34074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c34103d90 0x7f1c34074ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 --2- 172.21.15.82:0/2730099166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c34102c60 0x7f1c34076400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.417+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 >> 172.21.15.82:0/2730099166 conn(0x7f1c340fe490 msgr2=0x7f1c34107030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.418+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 shutdown_connections 2024-06-06T02:37:06.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:06.418+0000 7f1c38c00640 1 -- 172.21.15.82:0/2730099166 wait complete. 2024-06-06T02:37:07.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:06 smithi082 ceph-mon[31579]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:07.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-06T02:37:07.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:06 smithi103 ceph-mon[36349]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:07.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:06 smithi184 ceph-mon[36922]: from='client.25064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:07.776 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:07 smithi082 ceph-mon[31579]: pgmap v426: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:08.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:07 smithi103 ceph-mon[36349]: pgmap v426: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:08.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:07 smithi184 ceph-mon[36922]: pgmap v426: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 -- 172.21.15.82:0/3862861306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 msgr2=0x7f9b70079460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3862861306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b70079460 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009be0 tx=0x7f9b6802a6c0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 -- 172.21.15.82:0/3862861306 shutdown_connections 2024-06-06T02:37:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3862861306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b70079460 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3862861306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 0x7f9b70078630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3862861306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b700774b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 -- 172.21.15.82:0/3862861306 >> 172.21.15.82:0/3862861306 conn(0x7f9b701006e0 msgr2=0x7f9b70102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 -- 172.21.15.82:0/3862861306 shutdown_connections 2024-06-06T02:37:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:09.999+0000 7f9b74a00640 1 -- 172.21.15.82:0/3862861306 wait complete. 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.001+0000 7f9b74a00640 1 Processor -- start 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.001+0000 7f9b74a00640 1 -- start start 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.001+0000 7f9b74a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 0x7f9b7019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b701a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b74a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70114d90 con 0x7f9b700770a0 2024-06-06T02:37:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b74a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70114c10 con 0x7f9b70078b70 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b74a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70114f10 con 0x7f9b70078220 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39522/0 (socket says 172.21.15.82:39522) 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 -- 172.21.15.82:0/3109644100 learned_addr learned my addr 172.21.15.82:0/3109644100 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b67e00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 0x7f9b7019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6e800640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b701a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 -- 172.21.15.82:0/3109644100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 msgr2=0x7f9b7019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 0x7f9b7019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 -- 172.21.15.82:0/3109644100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 msgr2=0x7f9b701a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b701a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.002+0000 7f9b6de00640 1 -- 172.21.15.82:0/3109644100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b701a73d0 con 0x7f9b700770a0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b6de00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9c0 tx=0x7f9b6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ccc0 con 0x7f9b700770a0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600035f0 con 0x7f9b700770a0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b701a76c0 con 0x7f9b700770a0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ce60 con 0x7f9b700770a0 2024-06-06T02:37:10.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.003+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701a7c00 con 0x7f9b700770a0 2024-06-06T02:37:10.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.004+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b70111f70 con 0x7f9b700770a0 2024-06-06T02:37:10.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.007+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9b600037a0 con 0x7f9b700770a0 2024-06-06T02:37:10.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.008+0000 7f9b66a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 0x7f9b540b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.009+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f9b600e26e0 con 0x7f9b700770a0 2024-06-06T02:37:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.009+0000 7f9b67e00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 0x7f9b540b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.009+0000 7f9b67e00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 0x7f9b540b4d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b701a0960 tx=0x7f9b58009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.010+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b600aa450 con 0x7f9b700770a0 2024-06-06T02:37:10.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:09 smithi082 ceph-mon[31579]: pgmap v427: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.229+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9b70062ba0 con 0x7f9b540b27f0 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.237+0000 7f9b66a00640 1 -- 172.21.15.82:0/3109644100 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9b70062ba0 con 0x7f9b540b27f0 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 67s ago 4m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi103=b;smithi103=e;smithi103=h;smithi103=k;smithi184=c;smithi184=f;smithi184=i;smithi184=l;count:12 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 67s ago 10m smithi082=x;smithi103=y;smithi184=z;count:3 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 67s ago 11m smithi082:172.21.15.82=a;smithi103:172.21.15.103=b;smithi184:172.21.15.184=c;count:3 2024-06-06T02:37:10.237 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 67s ago - 2024-06-06T02:37:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.239+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 msgr2=0x7f9b540b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.239+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 0x7f9b540b4d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b701a0960 tx=0x7f9b58009260 comp rx=0 tx=0).stop 2024-06-06T02:37:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.239+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 msgr2=0x7f9b7019f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.239+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e9c0 tx=0x7f9b6000edc0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 shutdown_connections 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b70078b70 0x7f9b701a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9b540b27f0 0x7f9b540b4d00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b70078220 0x7f9b7019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 --2- 172.21.15.82:0/3109644100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b700770a0 0x7f9b7019f8b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 >> 172.21.15.82:0/3109644100 conn(0x7f9b701006e0 msgr2=0x7f9b7010f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 shutdown_connections 2024-06-06T02:37:10.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:10.240+0000 7f9b74a00640 1 -- 172.21.15.82:0/3109644100 wait complete. 2024-06-06T02:37:10.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:09 smithi103 ceph-mon[36349]: pgmap v427: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:10.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:09 smithi184 ceph-mon[36922]: pgmap v427: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:11.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-06T02:37:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:10 smithi103 ceph-mon[36349]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:11.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:10 smithi082 ceph-mon[31579]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:11.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:10 smithi184 ceph-mon[36922]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:11.524 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:12.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:11 smithi103 ceph-mon[36349]: pgmap v428: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:12.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:11 smithi082 ceph-mon[31579]: pgmap v428: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:12.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:11 smithi184 ceph-mon[36922]: pgmap v428: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.786+0000 7f268b400640 1 -- 172.21.15.82:0/53888646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684075090 msgr2=0x7f26840754e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.786+0000 7f268b400640 1 --2- 172.21.15.82:0/53888646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684075090 0x7f26840754e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f266c009900 tx=0x7f266c02a410 comp rx=0 tx=0).stop 2024-06-06T02:37:13.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 -- 172.21.15.82:0/53888646 shutdown_connections 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 --2- 172.21.15.82:0/53888646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f268410d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 --2- 172.21.15.82:0/53888646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684075090 0x7f26840754e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 --2- 172.21.15.82:0/53888646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684076680 0x7f2684074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 -- 172.21.15.82:0/53888646 >> 172.21.15.82:0/53888646 conn(0x7f26840fe490 msgr2=0x7f2684100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 -- 172.21.15.82:0/53888646 shutdown_connections 2024-06-06T02:37:13.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.787+0000 7f268b400640 1 -- 172.21.15.82:0/53888646 wait complete. 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.788+0000 7f268b400640 1 Processor -- start 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.788+0000 7f268b400640 1 -- start start 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684075090 0x7f268419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 0x7f268419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f26841a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2684110970 con 0x7f2684076680 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26841107f0 con 0x7f268410ab10 2024-06-06T02:37:13.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f268b400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2684110af0 con 0x7f2684075090 2024-06-06T02:37:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2683e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 0x7f268419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2683e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 0x7f268419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34266/0 (socket says 172.21.15.82:34266) 2024-06-06T02:37:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2683e00640 1 -- 172.21.15.82:0/4129688771 learned_addr learned my addr 172.21.15.82:0/4129688771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2689400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f26841a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:13.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2688a00640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684075090 0x7f268419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.789+0000 7f2689400640 1 -- 172.21.15.82:0/4129688771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684075090 msgr2=0x7f268419b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2689400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684075090 0x7f268419b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2689400640 1 -- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 msgr2=0x7f268419baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2689400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 0x7f268419baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2689400640 1 -- 172.21.15.82:0/4129688771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26841a3080 con 0x7f268410ab10 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2689400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f26841a2a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f267c009fd0 tx=0x7f267c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c00ce20 con 0x7f268410ab10 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f267c005020 con 0x7f268410ab10 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c010690 con 0x7f268410ab10 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26841a3370 con 0x7f268410ab10 2024-06-06T02:37:13.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.790+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26841a38b0 con 0x7f268410ab10 2024-06-06T02:37:13.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.791+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26841098d0 con 0x7f268410ab10 2024-06-06T02:37:13.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.794+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f267c0054d0 con 0x7f268410ab10 2024-06-06T02:37:13.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.795+0000 7f2681600640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 0x7f26680b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:13.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.796+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f267c0e2890 con 0x7f268410ab10 2024-06-06T02:37:13.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.796+0000 7f2688a00640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 0x7f26680b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:13.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.796+0000 7f2688a00640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 0x7f26680b4d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2684076380 tx=0x7f2674005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:13.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:13.797+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f267c0aa570 con 0x7f268410ab10 2024-06-06T02:37:14.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.012+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2684062ba0 con 0x7f26680b2870 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.015+0000 7f2681600640 1 -- 172.21.15.82:0/4129688771 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2684062ba0 con 0x7f26680b2870 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:smithi103 172.21.15.103 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:smithi184 172.21.15.184 2024-06-06T02:37:14.016 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-06-06T02:37:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 msgr2=0x7f26680b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 0x7f26680b4d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2684076380 tx=0x7f2674005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 msgr2=0x7f26841a2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f26841a2a40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f267c009fd0 tx=0x7f267c00ef10 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 shutdown_connections 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f268410ab10 0x7f26841a2a40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2684076680 0x7f268419baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f26680b2870 0x7f26680b4d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 --2- 172.21.15.82:0/4129688771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2684075090 0x7f268419b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 >> 172.21.15.82:0/4129688771 conn(0x7f26840fe490 msgr2=0x7f2684106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.018+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 shutdown_connections 2024-06-06T02:37:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:14.019+0000 7f268b400640 1 -- 172.21.15.82:0/4129688771 wait complete. 2024-06-06T02:37:14.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:13 smithi103 ceph-mon[36349]: pgmap v429: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:14.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:13 smithi082 ceph-mon[31579]: pgmap v429: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:14.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:13 smithi184 ceph-mon[36922]: pgmap v429: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:14.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-06T02:37:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:14 smithi082 ceph-mon[31579]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:14 smithi103 ceph-mon[36349]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:15.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:14 smithi184 ceph-mon[36922]: from='client.25076 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:16.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:15 smithi082 ceph-mon[31579]: pgmap v430: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:16.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:15 smithi103 ceph-mon[36349]: pgmap v430: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:16.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:15 smithi184 ceph-mon[36922]: pgmap v430: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:17.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 -- 172.21.15.82:0/795395222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 msgr2=0x7fc60c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 --2- 172.21.15.82:0/795395222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c109490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009900 tx=0x7fc5fc02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 -- 172.21.15.82:0/795395222 shutdown_connections 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 --2- 172.21.15.82:0/795395222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 0x7fc60c111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 --2- 172.21.15.82:0/795395222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 --2- 172.21.15.82:0/795395222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c109490 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 -- 172.21.15.82:0/795395222 >> 172.21.15.82:0/795395222 conn(0x7fc60c078320 msgr2=0x7fc60c07a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 -- 172.21.15.82:0/795395222 shutdown_connections 2024-06-06T02:37:17.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.503+0000 7fc60b200640 1 -- 172.21.15.82:0/795395222 wait complete. 2024-06-06T02:37:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.505+0000 7fc60b200640 1 Processor -- start 2024-06-06T02:37:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.505+0000 7fc60b200640 1 -- start start 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.505+0000 7fc60b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.505+0000 7fc60b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc60b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 0x7fc60c1a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc60b200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c114c10 con 0x7fc60c10a1b0 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc60b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c114a90 con 0x7fc60c109080 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc60b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c114d90 con 0x7fc60c10ab00 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:17.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c19f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58834/0 (socket says 172.21.15.82:58834) 2024-06-06T02:37:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609e00640 1 -- 172.21.15.82:0/1606546848 learned_addr learned my addr 172.21.15.82:0/1606546848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc60a800640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 0x7fc60c1a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 -- 172.21.15.82:0/1606546848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 msgr2=0x7fc60c1a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:17.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 0x7fc60c1a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 -- 172.21.15.82:0/1606546848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 msgr2=0x7fc60c19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.506+0000 7fc609400640 1 -- 172.21.15.82:0/1606546848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c1a7270 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc609400640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c19fc90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400e9f0 tx=0x7fc5f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400ccc0 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c1a7560 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5f40108e0 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4018880 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.507+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c1a7af0 con 0x7fc60c10a1b0 2024-06-06T02:37:17.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.508+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c110210 con 0x7fc60c10a1b0 2024-06-06T02:37:17.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.511+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc5f4010430 con 0x7fc60c10a1b0 2024-06-06T02:37:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.513+0000 7fc602a00640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 0x7fc5f00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.513+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc5f40e2a90 con 0x7fc60c10a1b0 2024-06-06T02:37:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.513+0000 7fc609e00640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 0x7fc5f00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.514+0000 7fc609e00640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 0x7fc5f00b4d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0096c0 tx=0x7fc5fc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.514+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc5f40aa770 con 0x7fc60c10a1b0 2024-06-06T02:37:17.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.732+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc60c062ba0 con 0x7fc5f00b27f0 2024-06-06T02:37:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.736+0000 7fc602a00640 1 -- 172.21.15.82:0/1606546848 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc60c062ba0 con 0x7fc5f00b27f0 2024-06-06T02:37:17.737 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-06T02:37:17.737 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-06-06T02:37:17.737 INFO:teuthology.orchestra.run.smithi082.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-06-06T02:37:17.737 INFO:teuthology.orchestra.run.smithi082.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 msgr2=0x7fc5f00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 0x7fc5f00b4d00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0096c0 tx=0x7fc5fc0314a0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 msgr2=0x7fc60c19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c19fc90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5f400e9f0 tx=0x7fc5f400eeb0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 shutdown_connections 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc5f00b27f0 0x7fc5f00b4d00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc60c10ab00 0x7fc60c1a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc60c10a1b0 0x7fc60c19fc90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 --2- 172.21.15.82:0/1606546848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc60c109080 0x7fc60c19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.739+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 >> 172.21.15.82:0/1606546848 conn(0x7fc60c078320 msgr2=0x7fc60c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.740+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 shutdown_connections 2024-06-06T02:37:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:17.740+0000 7fc60b200640 1 -- 172.21.15.82:0/1606546848 wait complete. 2024-06-06T02:37:18.090 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:17 smithi082 ceph-mon[31579]: pgmap v431: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:18.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:17 smithi103 ceph-mon[36349]: pgmap v431: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:17 smithi184 ceph-mon[36922]: pgmap v431: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:18.476 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-06T02:37:18.487 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:37:18.487 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-06T02:37:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:19.266 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:18 smithi082 ceph-mon[31579]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:19.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:18 smithi103 ceph-mon[36349]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:19.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:18 smithi184 ceph-mon[36922]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:20.278 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:19 smithi082 ceph-mon[31579]: pgmap v432: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:20.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:19 smithi103 ceph-mon[36349]: pgmap v432: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:20.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:19 smithi184 ceph-mon[36922]: pgmap v432: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 -- 172.21.15.82:0/632977088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c109080 msgr2=0x7fa62c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 --2- 172.21.15.82:0/632977088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c109080 0x7fa62c109490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa620009900 tx=0x7fa62002a3f0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 -- 172.21.15.82:0/632977088 shutdown_connections 2024-06-06T02:37:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 --2- 172.21.15.82:0/632977088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c10ab00 0x7fa62c111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 --2- 172.21.15.82:0/632977088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10a1b0 0x7fa62c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 --2- 172.21.15.82:0/632977088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c109080 0x7fa62c109490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 -- 172.21.15.82:0/632977088 >> 172.21.15.82:0/632977088 conn(0x7fa62c078320 msgr2=0x7fa62c07a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 -- 172.21.15.82:0/632977088 shutdown_connections 2024-06-06T02:37:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.169+0000 7fa632800640 1 -- 172.21.15.82:0/632977088 wait complete. 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.170+0000 7fa632800640 1 Processor -- start 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.170+0000 7fa632800640 1 -- start start 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 0x7fa62c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 0x7fa62c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10ab00 0x7fa62c1a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c114c10 con 0x7fa62c10a1b0 2024-06-06T02:37:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c114a90 con 0x7fa62c10ab00 2024-06-06T02:37:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa632800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c114d90 con 0x7fa62c109080 2024-06-06T02:37:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa630a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 0x7fa62c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa631400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 0x7fa62c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa630a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 0x7fa62c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34306/0 (socket says 172.21.15.82:34306) 2024-06-06T02:37:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa630a00640 1 -- 172.21.15.82:0/3645234763 learned_addr learned my addr 172.21.15.82:0/3645234763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.171+0000 7fa631e00640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10ab00 0x7fa62c1a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 -- 172.21.15.82:0/3645234763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10ab00 msgr2=0x7fa62c1a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10ab00 0x7fa62c1a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 -- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 msgr2=0x7fa62c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 0x7fa62c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 -- 172.21.15.82:0/3645234763 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c1a7270 con 0x7fa62c109080 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa631400640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 0x7fa62c19f750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa62002a910 tx=0x7fa620003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62003f070 con 0x7fa62c109080 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa620031c50 con 0x7fa62c109080 2024-06-06T02:37:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620035030 con 0x7fa62c109080 2024-06-06T02:37:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.172+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c1a7500 con 0x7fa62c109080 2024-06-06T02:37:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.173+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c1a7960 con 0x7fa62c109080 2024-06-06T02:37:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.174+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c110210 con 0x7fa62c109080 2024-06-06T02:37:21.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.176+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa620042070 con 0x7fa62c109080 2024-06-06T02:37:21.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.177+0000 7fa62a000640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 0x7fa6140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:21.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.178+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa6201032f0 con 0x7fa62c109080 2024-06-06T02:37:21.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.178+0000 7fa630a00640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 0x7fa6140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:21.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.178+0000 7fa630a00640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 0x7fa6140b4d00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa62c1a0800 tx=0x7fa618005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:21.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.179+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa6200ca980 con 0x7fa62c109080 2024-06-06T02:37:21.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.427+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa62c02df50 con 0x7fa62c109080 2024-06-06T02:37:21.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.428+0000 7fa62a000640 1 -- 172.21.15.82:0/3645234763 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3050 (secure 0 0 0) 0x7fa6200cec80 con 0x7fa62c109080 2024-06-06T02:37:21.429 INFO:teuthology.orchestra.run.smithi082.stdout:e25 2024-06-06T02:37:21.429 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-06T02:37:21.430 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T02:37:21.430 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-06-06T02:37:21.430 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:21.430 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-06-06T02:37:21.431 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-06-06T02:37:21.431 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 25 2024-06-06T02:37:21.431 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-06T02:37:21.431 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-06-06T02:34:03.585827+0000 2024-06-06T02:37:21.431 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-06-06T02:34:28.647869+0000 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-06-06T02:37:21.432 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 3 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24676,1=24664,2=24659} 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-06-06T02:37:21.433 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 24676 members: 24676,24664,24659 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{0:24676} state up:active seq 8 addr [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{0:24653} state up:standby-replay seq 1 addr [v2:172.21.15.82:6840/109083450,v1:172.21.15.82:6841/109083450] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.434 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{1:24664} state up:active seq 13 addr [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{1:24649} state up:standby-replay seq 1 addr [v2:172.21.15.184:6836/387834603,v1:172.21.15.184:6837/387834603] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{2:24659} state up:active seq 11 addr [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{2:24643} state up:standby-replay seq 1 addr [v2:172.21.15.184:6834/1227923673,v1:172.21.15.184:6835/1227923673] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14487} state up:standby seq 1 addr [v2:172.21.15.82:6834/2462955509,v1:172.21.15.82:6835/2462955509] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14499} state up:standby seq 1 addr [v2:172.21.15.82:6836/2409954600,v1:172.21.15.82:6837/2409954600] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{-1:24578} state up:standby seq 1 addr [v2:172.21.15.103:6832/2511438275,v1:172.21.15.103:6833/2511438275] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{-1:24598} state up:standby seq 1 addr [v2:172.21.15.184:6832/660710871,v1:172.21.15.184:6833/660710871] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{-1:24608} state up:standby seq 1 addr [v2:172.21.15.103:6834/407132761,v1:172.21.15.103:6835/407132761] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.435 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{-1:24626} state up:standby seq 1 addr [v2:172.21.15.103:6836/2953735672,v1:172.21.15.103:6837/2953735672] compat {c=[1],r=[1],i=[1fff]}] 2024-06-06T02:37:21.436 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:37:21.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 msgr2=0x7fa6140b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:21.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 0x7fa6140b4d00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa62c1a0800 tx=0x7fa618005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:21.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 msgr2=0x7fa62c19f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 0x7fa62c19f750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa62002a910 tx=0x7fa620003c10 comp rx=0 tx=0).stop 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 shutdown_connections 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa62c10ab00 0x7fa62c1a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa62c10a1b0 0x7fa62c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa6140b27f0 0x7fa6140b4d00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 --2- 172.21.15.82:0/3645234763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa62c109080 0x7fa62c19f750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 >> 172.21.15.82:0/3645234763 conn(0x7fa62c078320 msgr2=0x7fa62c10d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 shutdown_connections 2024-06-06T02:37:21.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:21.432+0000 7fa632800640 1 -- 172.21.15.82:0/3645234763 wait complete. 2024-06-06T02:37:22.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:21 smithi082 ceph-mon[31579]: pgmap v433: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:22.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:21 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3645234763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T02:37:22.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-06T02:37:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:21 smithi103 ceph-mon[36349]: pgmap v433: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:21 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3645234763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T02:37:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:21 smithi184 ceph-mon[36922]: pgmap v433: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:22.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:21 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3645234763' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-06T02:37:22.657 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:24.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:23 smithi082 ceph-mon[31579]: pgmap v434: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:24 smithi103 ceph-mon[36349]: pgmap v434: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:23 smithi184 ceph-mon[36922]: pgmap v434: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 -- 172.21.15.82:0/1411942394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 msgr2=0x7f00c0075420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 --2- 172.21.15.82:0/1411942394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c0075420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009900 tx=0x7f00ac02a410 comp rx=0 tx=0).stop 2024-06-06T02:37:24.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 -- 172.21.15.82:0/1411942394 shutdown_connections 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 --2- 172.21.15.82:0/1411942394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 0x7f00c010d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 --2- 172.21.15.82:0/1411942394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c0075420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 --2- 172.21.15.82:0/1411942394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c0074ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 -- 172.21.15.82:0/1411942394 >> 172.21.15.82:0/1411942394 conn(0x7f00c00fe490 msgr2=0x7f00c0100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 -- 172.21.15.82:0/1411942394 shutdown_connections 2024-06-06T02:37:24.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.928+0000 7f00c5200640 1 -- 172.21.15.82:0/1411942394 wait complete. 2024-06-06T02:37:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.929+0000 7f00c5200640 1 Processor -- start 2024-06-06T02:37:24.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.929+0000 7f00c5200640 1 -- start start 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 0x7f00c01a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00c0110990 con 0x7f00c0075010 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00c0110810 con 0x7f00c0076600 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00c5200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f00c0110b10 con 0x7f00c010ab40 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00bd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00bd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40392/0 (socket says 172.21.15.82:40392) 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00bd400640 1 -- 172.21.15.82:0/1226148953 learned_addr learned my addr 172.21.15.82:0/1226148953 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00bde00640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.930+0000 7f00be800640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 0x7f00c01a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 -- 172.21.15.82:0/1226148953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 msgr2=0x7f00c01a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 0x7f00c01a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 -- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 msgr2=0x7f00c019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 -- 172.21.15.82:0/1226148953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c01a3080 con 0x7f00c0076600 2024-06-06T02:37:24.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00bd400640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00ac031440 tx=0x7f00ac003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac03f070 con 0x7f00c0076600 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c01a3310 con 0x7f00c0076600 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00ac031c50 con 0x7f00c0076600 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac035030 con 0x7f00c0076600 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.931+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c01a3840 con 0x7f00c0076600 2024-06-06T02:37:24.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.933+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c0109950 con 0x7f00c0076600 2024-06-06T02:37:24.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.935+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f00ac042070 con 0x7f00c0076600 2024-06-06T02:37:24.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.937+0000 7f00b6a00640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 0x7f00a40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:24.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.937+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f00ac103170 con 0x7f00c0076600 2024-06-06T02:37:24.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.937+0000 7f00bde00640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 0x7f00a40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:24.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.938+0000 7f00bde00640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 0x7f00a40b4d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00c0076300 tx=0x7f00b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:24.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:24.938+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f00ac0cae50 con 0x7f00c0076600 2024-06-06T02:37:25.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.151+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f00c002dd00 con 0x7f00c0076600 2024-06-06T02:37:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.152+0000 7f00b6a00640 1 -- 172.21.15.82:0/1226148953 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5311 (secure 0 0 0) 0x7f00ac0ca750 con 0x7f00c0076600 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 80 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-06-06T02:24:12.041095+0000 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-06-06T02:34:15.831272+0000 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 26 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-06-06T02:37:25.154 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/1718007195,v1:172.21.15.82:6803/1718007195] [v2:172.21.15.82:6804/1718007195,v1:172.21.15.82:6805/1718007195] exists,up 924068dd-3df9-4f5e-8793-d853e41803ca 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6800/496472221,v1:172.21.15.103:6801/496472221] [v2:172.21.15.103:6802/496472221,v1:172.21.15.103:6803/496472221] exists,up 2cba94c6-c648-4beb-a92a-51cc809abb4b 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/3542247207,v1:172.21.15.184:6801/3542247207] [v2:172.21.15.184:6802/3542247207,v1:172.21.15.184:6803/3542247207] exists,up 79f93c60-64fb-4787-9060-e630dc82b86a 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 25 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/2283254494,v1:172.21.15.82:6811/2283254494] [v2:172.21.15.82:6812/2283254494,v1:172.21.15.82:6813/2283254494] exists,up 3525ec4e-8aba-4b93-a2a0-53d0768d6024 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 31 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6808/3776177074,v1:172.21.15.103:6809/3776177074] [v2:172.21.15.103:6810/3776177074,v1:172.21.15.103:6811/3776177074] exists,up e6577bfe-f247-4018-abca-2aa1e02cd3f7 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 36 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/3267310596,v1:172.21.15.184:6809/3267310596] [v2:172.21.15.184:6810/3267310596,v1:172.21.15.184:6811/3267310596] exists,up 7650a94a-7c8c-4eb2-8c34-937d964e525c 2024-06-06T02:37:25.155 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 42 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/1499298999,v1:172.21.15.82:6819/1499298999] [v2:172.21.15.82:6820/1499298999,v1:172.21.15.82:6821/1499298999] exists,up dca2a063-43f3-474f-a96d-478981f1837e 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 47 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6816/293167460,v1:172.21.15.103:6817/293167460] [v2:172.21.15.103:6818/293167460,v1:172.21.15.103:6819/293167460] exists,up 36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 53 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/3131602198,v1:172.21.15.184:6817/3131602198] [v2:172.21.15.184:6818/3131602198,v1:172.21.15.184:6819/3131602198] exists,up b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 59 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/1326866066,v1:172.21.15.82:6827/1326866066] [v2:172.21.15.82:6828/1326866066,v1:172.21.15.82:6829/1326866066] exists,up 4e0ab7ce-21f3-4c86-a051-c7e28dfd8069 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 64 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6824/667256862,v1:172.21.15.103:6825/667256862] [v2:172.21.15.103:6826/667256862,v1:172.21.15.103:6827/667256862] exists,up 077d6b20-a049-43e8-bdab-9683e568ff7c 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 70 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/3826867745,v1:172.21.15.184:6825/3826867745] [v2:172.21.15.184:6826/3826867745,v1:172.21.15.184:6827/3826867745] exists,up 0f20b235-215a-43d5-af49-13634a770b8d 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.a [2,11] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.14 [2,4] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1a [8,1] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1d [8,11] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.21 [4,6] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.25 [5,9] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.2c [4,9] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.31 [4,8] 2024-06-06T02:37:25.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.38 [3,9] 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1235186567 expires 2024-06-07T02:25:14.582200+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/1579417717 expires 2024-06-07T02:25:14.582200+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1616509269 expires 2024-06-07T02:25:14.582200+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/498850809 expires 2024-06-07T02:24:44.429691+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3563640747 expires 2024-06-07T02:24:44.429691+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3563640747 expires 2024-06-07T02:24:44.429691+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/1579417717 expires 2024-06-07T02:25:14.582200+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/4084733545 expires 2024-06-07T02:25:14.582200+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1869865938 expires 2024-06-07T02:24:44.429691+0000 2024-06-06T02:37:25.157 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/370056535 expires 2024-06-07T02:24:44.429691+0000 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 msgr2=0x7f00a40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 0x7f00a40b4d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00c0076300 tx=0x7f00b0005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 msgr2=0x7f00c019baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f00ac031440 tx=0x7f00ac003c10 comp rx=0 tx=0).stop 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 shutdown_connections 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f00a40b2870 0x7f00a40b4d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c010ab40 0x7f00c01a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0076600 0x7f00c019baa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:25.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 --2- 172.21.15.82:0/1226148953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00c0075010 0x7f00c019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.155+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 >> 172.21.15.82:0/1226148953 conn(0x7f00c00fe490 msgr2=0x7f00c0106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.156+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 shutdown_connections 2024-06-06T02:37:25.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:25.156+0000 7f00c5200640 1 -- 172.21.15.82:0/1226148953 wait complete. 2024-06-06T02:37:25.962 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-06T02:37:25.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:37:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:26 smithi103 ceph-mon[36349]: pgmap v435: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:26 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1226148953' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T02:37:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:37:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:26 smithi082 ceph-mon[31579]: pgmap v435: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:26 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1226148953' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T02:37:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:37:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:26 smithi184 ceph-mon[36922]: pgmap v435: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:26 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1226148953' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-06T02:37:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:37:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:27.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:37:27.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:37:27.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:37:27.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:37:27.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:37:27.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:37:27.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:37:27.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:37:27.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:37:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 -- 172.21.15.82:0/1674373660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff81045a0 msgr2=0x7faff810caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 --2- 172.21.15.82:0/1674373660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff81045a0 0x7faff810caf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009900 tx=0x7fafe402a490 comp rx=0 tx=0).stop 2024-06-06T02:37:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 -- 172.21.15.82:0/1674373660 shutdown_connections 2024-06-06T02:37:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 --2- 172.21.15.82:0/1674373660 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff810d030 0x7faff810f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 --2- 172.21.15.82:0/1674373660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff81045a0 0x7faff810caf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 --2- 172.21.15.82:0/1674373660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff8103c50 0x7faff8104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 -- 172.21.15.82:0/1674373660 >> 172.21.15.82:0/1674373660 conn(0x7faff80fd6f0 msgr2=0x7faff80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 -- 172.21.15.82:0/1674373660 shutdown_connections 2024-06-06T02:37:28.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:28 smithi082 ceph-mon[31579]: pgmap v436: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.562+0000 7faffca00640 1 -- 172.21.15.82:0/1674373660 wait complete. 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 Processor -- start 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 -- start start 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff8103c50 0x7faff81a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff810d030 0x7faff819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faff81023a0 con 0x7faff8103c50 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faff8102220 con 0x7faff810d030 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.564+0000 7faffca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faff8102520 con 0x7faff81045a0 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:56466/0 (socket says 172.21.15.82:56466) 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 -- 172.21.15.82:0/2803636735 learned_addr learned my addr 172.21.15.82:0/2803636735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff7400640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff8103c50 0x7faff81a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff7e00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff810d030 0x7faff819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 -- 172.21.15.82:0/2803636735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff810d030 msgr2=0x7faff819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff810d030 0x7faff819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 -- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff8103c50 msgr2=0x7faff81a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff8103c50 0x7faff81a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.565+0000 7faff6a00640 1 -- 172.21.15.82:0/2803636735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff819bd80 con 0x7faff81045a0 2024-06-06T02:37:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.566+0000 7faff6a00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafe4031440 tx=0x7fafe4003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.566+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe403f070 con 0x7faff81045a0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.566+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff819c010 con 0x7faff81045a0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.567+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff819c540 con 0x7faff81045a0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.567+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafe4031d60 con 0x7faff81045a0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.567+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4049060 con 0x7faff81045a0 2024-06-06T02:37:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.568+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff806ae70 con 0x7faff81045a0 2024-06-06T02:37:28.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.570+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fafe4042070 con 0x7faff81045a0 2024-06-06T02:37:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.572+0000 7fafefe00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 0x7fafdc0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.572+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fafe4102cc0 con 0x7faff81045a0 2024-06-06T02:37:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.572+0000 7faff7400640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 0x7fafdc0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:28.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.573+0000 7faff7400640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 0x7fafdc0b4d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fafe8005d00 tx=0x7fafe800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:28.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.574+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fafe40ca350 con 0x7faff81045a0 2024-06-06T02:37:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:28 smithi103 ceph-mon[36349]: pgmap v436: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:28 smithi184 ceph-mon[36922]: pgmap v436: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:28.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.825+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faff81071b0 con 0x7faff81045a0 2024-06-06T02:37:28.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.827+0000 7fafefe00640 1 -- 172.21.15.82:0/2803636735 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7fafe40ce650 con 0x7faff81045a0 2024-06-06T02:37:28.828 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:28.828 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:37:28.828 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:37:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 msgr2=0x7fafdc0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 0x7fafdc0b4d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fafe8005d00 tx=0x7fafe800b410 comp rx=0 tx=0).stop 2024-06-06T02:37:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 msgr2=0x7faff81a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafe4031440 tx=0x7fafe4003cd0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 shutdown_connections 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faff810d030 0x7faff819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fafdc0b2870 0x7fafdc0b4d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faff81045a0 0x7faff81a1af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 --2- 172.21.15.82:0/2803636735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff8103c50 0x7faff81a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 >> 172.21.15.82:0/2803636735 conn(0x7faff80fd6f0 msgr2=0x7faff8100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 shutdown_connections 2024-06-06T02:37:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:28.831+0000 7faffca00640 1 -- 172.21.15.82:0/2803636735 wait complete. 2024-06-06T02:37:29.546 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:29 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2803636735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:29.593 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:37:29.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:29 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2803636735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:29.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:29 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2803636735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:30.014 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:30.417 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:30 smithi082 ceph-mon[31579]: pgmap v437: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:30 smithi103 ceph-mon[36349]: pgmap v437: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:30.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:30 smithi184 ceph-mon[36922]: pgmap v437: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:32.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 -- 172.21.15.82:0/2477016801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396410f530 msgr2=0x7f3964111950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:32.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 --2- 172.21.15.82:0/2477016801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396410f530 0x7f3964111950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f395c009ca0 tx=0x7f395c02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 -- 172.21.15.82:0/2477016801 shutdown_connections 2024-06-06T02:37:32.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 --2- 172.21.15.82:0/2477016801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396410f530 0x7f3964111950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 --2- 172.21.15.82:0/2477016801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3964102360 0x7f396410eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 --2- 172.21.15.82:0/2477016801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f3964101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.226+0000 7f396c000640 1 -- 172.21.15.82:0/2477016801 >> 172.21.15.82:0/2477016801 conn(0x7f3964078a80 msgr2=0x7f3964078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:32.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.227+0000 7f396c000640 1 -- 172.21.15.82:0/2477016801 shutdown_connections 2024-06-06T02:37:32.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.227+0000 7f396c000640 1 -- 172.21.15.82:0/2477016801 wait complete. 2024-06-06T02:37:32.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 Processor -- start 2024-06-06T02:37:32.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 -- start start 2024-06-06T02:37:32.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f396410f530 0x7f396419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3964115030 con 0x7f3964102360 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3964114eb0 con 0x7f396410f530 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.228+0000 7f396c000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39641151b0 con 0x7f3964101980 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3968c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47324/0 (socket says 172.21.15.82:47324) 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3968c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54046/0 (socket says 172.21.15.82:54046) 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 -- 172.21.15.82:0/2926866165 learned_addr learned my addr 172.21.15.82:0/2926866165 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:32.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f396a000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f396410f530 0x7f396419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 -- 172.21.15.82:0/2926866165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f396410f530 msgr2=0x7f396419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f396410f530 0x7f396419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 -- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 msgr2=0x7f39641a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 -- 172.21.15.82:0/2926866165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396419bf10 con 0x7f3964101980 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3968c00640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:32.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.229+0000 7f3969600640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f395400e9f0 tx=0x7f395400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.230+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395400cd80 con 0x7f3964101980 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.230+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39540108e0 con 0x7f3964101980 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.230+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396419c200 con 0x7f3964101980 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.230+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954018980 con 0x7f3964101980 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.230+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641a8510 con 0x7f3964101980 2024-06-06T02:37:32.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.231+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3964101d90 con 0x7f3964101980 2024-06-06T02:37:32.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.233+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3954010430 con 0x7f3964101980 2024-06-06T02:37:32.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.235+0000 7f3962000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 0x7f39480b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:32.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.235+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39540e2570 con 0x7f3964101980 2024-06-06T02:37:32.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.235+0000 7f3968c00640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 0x7f39480b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:32.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.236+0000 7f3968c00640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 0x7f39480b4d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39641012a0 tx=0x7f3950005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:32.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.239+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f39540a9c00 con 0x7f3964101980 2024-06-06T02:37:32.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:32 smithi082 ceph-mon[31579]: pgmap v438: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.490+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f396410a6c0 con 0x7f3964101980 2024-06-06T02:37:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.491+0000 7f3962000640 1 -- 172.21.15.82:0/2926866165 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11869 (secure 0 0 0) 0x7f39540adf00 con 0x7f3964101980 2024-06-06T02:37:32.492 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:32.492 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:34:28.647869+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:37:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2024-06-06T02:37:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.494+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 msgr2=0x7f39480b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.494+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 0x7f39480b4d00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f39641012a0 tx=0x7f3950005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.494+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 msgr2=0x7f39641a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.494+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f395400e9f0 tx=0x7f395400eeb0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.494+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 shutdown_connections 2024-06-06T02:37:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f396410f530 0x7f396419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3964102360 0x7f39641a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39480b27f0 0x7f39480b4d00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 --2- 172.21.15.82:0/2926866165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3964101980 0x7f39641a1680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:32.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 >> 172.21.15.82:0/2926866165 conn(0x7f3964078a80 msgr2=0x7f3964110a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:32.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 shutdown_connections 2024-06-06T02:37:32.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:32.495+0000 7f396c000640 1 -- 172.21.15.82:0/2926866165 wait complete. 2024-06-06T02:37:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:32 smithi103 ceph-mon[36349]: pgmap v438: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:32.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:32 smithi184 ceph-mon[36922]: pgmap v438: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:33.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:37:33.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:33 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2926866165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:33.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:33 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2926866165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:33.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:33 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2926866165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:37:33.770 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:34 smithi103 ceph-mon[36349]: pgmap v439: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:34 smithi082 ceph-mon[31579]: pgmap v439: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:34 smithi184 ceph-mon[36922]: pgmap v439: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 -- 172.21.15.82:0/1228532407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 msgr2=0x7f8968109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 --2- 172.21.15.82:0/1228532407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f8968109c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8958009880 tx=0x7f895802a360 comp rx=0 tx=0).stop 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 -- 172.21.15.82:0/1228532407 shutdown_connections 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 --2- 172.21.15.82:0/1228532407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f896810a1b0 0x7f8968111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 --2- 172.21.15.82:0/1228532407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f8968109c70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 --2- 172.21.15.82:0/1228532407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8968104f30 0x7f8968105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 -- 172.21.15.82:0/1228532407 >> 172.21.15.82:0/1228532407 conn(0x7f8968100990 msgr2=0x7f8968102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:36.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 -- 172.21.15.82:0/1228532407 shutdown_connections 2024-06-06T02:37:36.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.021+0000 7f896e200640 1 -- 172.21.15.82:0/1228532407 wait complete. 2024-06-06T02:37:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 Processor -- start 2024-06-06T02:37:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 -- start start 2024-06-06T02:37:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8968104f30 0x7f89681a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:36.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f896810a1b0 0x7f896819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8968114ec0 con 0x7f8968104f30 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8968114d40 con 0x7f8968109860 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.023+0000 7f896e200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8968115040 con 0x7f896810a1b0 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f896ce00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8968104f30 0x7f89681a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53540/0 (socket says 172.21.15.82:53540) 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 -- 172.21.15.82:0/993574924 learned_addr learned my addr 172.21.15.82:0/993574924 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f896d800640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f896810a1b0 0x7f896819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 -- 172.21.15.82:0/993574924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f896810a1b0 msgr2=0x7f896819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f896810a1b0 0x7f896819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 -- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8968104f30 msgr2=0x7f89681a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8968104f30 0x7f89681a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.024+0000 7f895fe00640 1 -- 172.21.15.82:0/993574924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896819bf00 con 0x7f8968109860 2024-06-06T02:37:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f895fe00640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f895802a950 tx=0x7f8958030e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895803f020 con 0x7f8968109860 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8958032ca0 con 0x7f8968109860 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896819c130 con 0x7f8968109860 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958037040 con 0x7f8968109860 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.025+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f896819c610 con 0x7f8968109860 2024-06-06T02:37:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.027+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89681063e0 con 0x7f8968109860 2024-06-06T02:37:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.029+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8958042020 con 0x7f8968109860 2024-06-06T02:37:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.030+0000 7f8966000640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 0x7f89480b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.031+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8958101ef0 con 0x7f8968109860 2024-06-06T02:37:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.031+0000 7f896ce00640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 0x7f89480b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.031+0000 7f896ce00640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 0x7f89480b4d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f896819cb00 tx=0x7f8950005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.034+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8958049020 con 0x7f8968109860 2024-06-06T02:37:36.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.249+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f896810d1a0 con 0x7f8968109860 2024-06-06T02:37:36.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.251+0000 7f8966000640 1 -- 172.21.15.82:0/993574924 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7f89580c9bd0 con 0x7f8968109860 2024-06-06T02:37:36.252 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:36.252 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:37:36.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 msgr2=0x7f89480b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:36.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 0x7f89480b4d00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f896819cb00 tx=0x7f8950005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 msgr2=0x7f89681a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f895802a950 tx=0x7f8958030e40 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 shutdown_connections 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f89480b27f0 0x7f89480b4d00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f896810a1b0 0x7f896819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8968109860 0x7f89681a1ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 --2- 172.21.15.82:0/993574924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8968104f30 0x7f89681a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 >> 172.21.15.82:0/993574924 conn(0x7f8968100990 msgr2=0x7f8968101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 shutdown_connections 2024-06-06T02:37:36.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:36.254+0000 7f896e200640 1 -- 172.21.15.82:0/993574924 wait complete. 2024-06-06T02:37:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:36 smithi103 ceph-mon[36349]: pgmap v440: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:36 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/993574924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:36 smithi082 ceph-mon[31579]: pgmap v440: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:36 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/993574924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:36 smithi184 ceph-mon[36922]: pgmap v440: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:36 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/993574924' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:37.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-06T02:34:03.585827+0000', 'modified': '2024-06-06T02:34:28.647869+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24676, 'mds_1': 24664, 'mds_2': 24659}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24643': {'gid': 24643, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/1227923673', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 1227923673}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 1227923673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6837/387834603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 387834603}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 387834603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'a', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/109083450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 109083450}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 109083450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'b', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.103:6839/426995210', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6838', 'nonce': 426995210}, {'type': 'v1', 'addr': '172.21.15.103:6839', 'nonce': 426995210}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.184:6839/1945283306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 1945283306}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 1945283306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'g', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.82:6839/3528791947', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3528791947}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3528791947}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24676, 'qdb_cluster': [24676, 24664, 24659]} 2024-06-06T02:37:37.116 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-06-06T02:37:37.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.b status 2024-06-06T02:37:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:38.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:38 smithi082 ceph-mon[31579]: pgmap v441: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:38 smithi103 ceph-mon[36349]: pgmap v441: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:38 smithi184 ceph-mon[36922]: pgmap v441: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:39.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.827+0000 7f0785c00640 1 -- 172.21.15.82:0/1947729933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0780109310 msgr2=0x7f0780109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.827+0000 7f0785c00640 1 --2- 172.21.15.82:0/1947729933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0780109310 0x7f0780109720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0770009960 tx=0x7f077002a460 comp rx=0 tx=0).stop 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 -- 172.21.15.82:0/1947729933 shutdown_connections 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 --2- 172.21.15.82:0/1947729933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f078010e590 0x7f0780115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 --2- 172.21.15.82:0/1947729933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010dc40 0x7f078010e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 --2- 172.21.15.82:0/1947729933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0780109310 0x7f0780109720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 -- 172.21.15.82:0/1947729933 >> 172.21.15.82:0/1947729933 conn(0x7f0780078a80 msgr2=0x7f0780107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 -- 172.21.15.82:0/1947729933 shutdown_connections 2024-06-06T02:37:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.828+0000 7f0785c00640 1 -- 172.21.15.82:0/1947729933 wait complete. 2024-06-06T02:37:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 Processor -- start 2024-06-06T02:37:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 -- start start 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f078010dc40 0x7f07801a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 0x7f07801a4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0780119300 con 0x7f078010dc40 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0780119180 con 0x7f0780109310 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.829+0000 7f0785c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0780119480 con 0x7f078010e590 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f078010dc40 0x7f07801a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f077fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 0x7f07801a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f077fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53566/0 (socket says 172.21.15.82:53566) 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f077fe00640 1 -- 172.21.15.82:0/2232832271 learned_addr learned my addr 172.21.15.82:0/2232832271 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 -- 172.21.15.82:0/2232832271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 msgr2=0x7f078019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 -- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f078010dc40 msgr2=0x7f07801a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f078010dc40 0x7f07801a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f0785200640 1 -- 172.21.15.82:0/2232832271 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07801a4bb0 con 0x7f078010e590 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.830+0000 7f077fe00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f0785200640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 0x7f07801a4570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f077800ea80 tx=0x7f077800ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f077d600640 1 -- 172.21.15.82:0/2232832271 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077800cea0 con 0x7f078010e590 2024-06-06T02:37:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f077d600640 1 -- 172.21.15.82:0/2232832271 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0778005020 con 0x7f078010e590 2024-06-06T02:37:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07801a4ea0 con 0x7f078010e590 2024-06-06T02:37:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f077d600640 1 -- 172.21.15.82:0/2232832271 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778010690 con 0x7f078010e590 2024-06-06T02:37:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.831+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801ac820 con 0x7f078010e590 2024-06-06T02:37:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.836+0000 7f078d7f4740 1 Processor -- start 2024-06-06T02:37:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.837+0000 7f077d600640 1 -- 172.21.15.82:0/2232832271 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f07780054d0 con 0x7f078010e590 2024-06-06T02:37:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.837+0000 7f078d7f4740 1 -- start start 2024-06-06T02:37:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.837+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 0x55874b49cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.837+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.837+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b49da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f078d7f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55874b411b80 con 0x55874b0f6f60 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f078d7f4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55874b401120 con 0x55874b0d6280 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f078d7f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55874b405160 con 0x55874b0ce0a0 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 0x55874b49cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 0x55874b49cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54084/0 (socket says 172.21.15.82:54084) 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f0777400640 1 -- 172.21.15.82:0/966358717 learned_addr learned my addr 172.21.15.82:0/966358717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47356/0 (socket says 172.21.15.82:47356) 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f0777400640 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b49da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 -- 172.21.15.82:0/966358717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 msgr2=0x55874b49da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b49da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 -- 172.21.15.82:0/966358717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 msgr2=0x55874b49cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 0x55874b49cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.838+0000 7f077fe00640 1 -- 172.21.15.82:0/966358717 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55874b162540 con 0x55874b0ce0a0 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f077d600640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 0x7f07640b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f077fe00640 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0770005ec0 tx=0x7f0770005150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=293f3f2ec99dbc8c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f077d600640 1 -- 172.21.15.82:0/2232832271 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f07780e2860 con 0x7f078010e590 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f0777400640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 0x7f07640b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f0775600640 1 -- 172.21.15.82:0/966358717 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035040 con 0x55874b0ce0a0 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f0775600640 1 -- 172.21.15.82:0/966358717 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0770005600 con 0x55874b0ce0a0 2024-06-06T02:37:39.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.839+0000 7f0775600640 1 -- 172.21.15.82:0/966358717 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700048e0 con 0x55874b0ce0a0 2024-06-06T02:37:39.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 -- 172.21.15.82:0/966358717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 msgr2=0x55874b49d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f0777400640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 0x7f07640b4d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55874b49a1a0 tx=0x7f0768015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0770005ec0 tx=0x7f0770005150 comp rx=0 tx=0).stop 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 -- 172.21.15.82:0/966358717 shutdown_connections 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b49da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b49d4c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 --2- 172.21.15.82:0/966358717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0f6f60 0x55874b49cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.840+0000 7f078d7f4740 1 -- 172.21.15.82:0/966358717 >> 172.21.15.82:0/966358717 conn(0x55874b0eb350 msgr2=0x55874b4997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.841+0000 7f078d7f4740 1 -- 172.21.15.82:0/966358717 shutdown_connections 2024-06-06T02:37:39.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.841+0000 7f078d7f4740 1 -- 172.21.15.82:0/966358717 wait complete. 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.841+0000 7f078d7f4740 1 -- start start 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.841+0000 7f078d7f4740 1 Processor -- start 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55874b2655f0 con 0x55874b0d6280 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55874b39e5c0 con 0x55874b0f6f60 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55874b4aa090 con 0x55874b0ce0a0 2024-06-06T02:37:39.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f078d7f4740 10 client.0 _ll_register_callbacks cb 0x55874b3b7340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f077fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f077fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47372/0 (socket says 172.21.15.82:47372) 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f077fe00640 1 -- 172.21.15.82:0/2488312310 learned_addr learned my addr 172.21.15.82:0/2488312310 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.842+0000 7f0785200640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 -- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 msgr2=0x55874b4ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 -- 172.21.15.82:0/2488312310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 msgr2=0x55874b4a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 -- 172.21.15.82:0/2488312310 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55874b3c9d30 con 0x55874b0ce0a0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f077fe00640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0770006010 tx=0x7f0770004890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43dc20ab4287e41 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f076e000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035070 con 0x55874b0ce0a0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0770005400 con 0x55874b0ce0a0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.843+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0770005600 con 0x55874b0ce0a0 2024-06-06T02:37:39.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.844+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0770004c10 con 0x55874b0ce0a0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.844+0000 7f078d7f4740 10 client.25159 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.844+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55874b4b61b0 con 0x55874b0ce0a0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.844+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0770005600 con 0x55874b0ce0a0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.844+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f077003c440 con 0x55874b0ce0a0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 10 client.25159 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 10 client.25159 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 20 client.25159 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b0b58e0 0x55874b4b9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 4 client.25159 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55874b413ad0 con 0x55874b0b58e0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.845+0000 7f0777400640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b0b58e0 0x55874b4b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.846+0000 7f0777400640 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b0b58e0 0x55874b4b9740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98e3e927d23345ef server_cookie=5c1ca1dd471cc95 in_seq=0 out_seq=0 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.846+0000 7f076e000640 10 client.25159 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:37:39.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.846+0000 7f076e000640 1 -- 172.21.15.82:0/2488312310 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55874b413ad0 con 0x55874b0b58e0 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.846+0000 7f076e000640 10 client.25159 handle_command_reply: tid=0 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.846+0000 7f078d7f4740 1 client.25159 shutdown 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 msgr2=0x55874b4a7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0770006010 tx=0x7f0770004890 comp rx=0 tx=0).stop 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 shutdown_connections 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b0b58e0 0x55874b4b9740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f076e000640 0 client.25159 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2488312310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4a7670 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 >> 172.21.15.82:0/2488312310 conn(0x55874b0eb350 msgr2=0x55874b49ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 shutdown_connections 2024-06-06T02:37:39.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 1 -- 172.21.15.82:0/2488312310 wait complete. 2024-06-06T02:37:39.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.847+0000 7f078d7f4740 20 client.25159 trim_cache size 0 max 16384 2024-06-06T02:37:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.867+0000 7f078d7f4740 1 Processor -- start 2024-06-06T02:37:39.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.867+0000 7f078d7f4740 1 -- start start 2024-06-06T02:37:39.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b4ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 0x55874b4a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b7a80 con 0x55874b0ce0a0 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b8150 con 0x55874b0d6280 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f078d7f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b8820 con 0x55874b0f6f60 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f077fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f077fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54100/0 (socket says 172.21.15.82:54100) 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f077fe00640 1 -- 172.21.15.82:0/2546454903 learned_addr learned my addr 172.21.15.82:0/2546454903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b4ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0785200640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 0x55874b4a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 -- 172.21.15.82:0/2546454903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 msgr2=0x55874b4a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 0x55874b4a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 -- 172.21.15.82:0/2546454903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 msgr2=0x55874b4ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0777400640 1 -- 172.21.15.82:0/2546454903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55874b49a470 con 0x55874b0d6280 2024-06-06T02:37:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f0785200640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 0x55874b4a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:37:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.868+0000 7f077fe00640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:39.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.869+0000 7f0777400640 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b4ad8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55874b4a8220 tx=0x7f0768004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611c3ffc86ea6058 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.869+0000 7f0774c00640 1 -- 172.21.15.82:0/2546454903 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076800fd00 con 0x55874b0d6280 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.869+0000 7f0774c00640 1 -- 172.21.15.82:0/2546454903 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07680054d0 con 0x55874b0d6280 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.869+0000 7f0774c00640 1 -- 172.21.15.82:0/2546454903 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768004cc0 con 0x55874b0d6280 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 -- 172.21.15.82:0/2546454903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 msgr2=0x55874b4ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b4ad8a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55874b4a8220 tx=0x7f0768004730 comp rx=0 tx=0).stop 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 -- 172.21.15.82:0/2546454903 shutdown_connections 2024-06-06T02:37:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0f6f60 0x55874b4a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0d6280 0x55874b4ad8a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 --2- 172.21.15.82:0/2546454903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0ce0a0 0x55874b4ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 -- 172.21.15.82:0/2546454903 >> 172.21.15.82:0/2546454903 conn(0x55874b0eb350 msgr2=0x55874b4a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 -- 172.21.15.82:0/2546454903 shutdown_connections 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.870+0000 7f078d7f4740 1 -- 172.21.15.82:0/2546454903 wait complete. 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 -- start start 2024-06-06T02:37:39.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 Processor -- start 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b95c0 con 0x55874b0d6280 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b8ef0 con 0x55874b0f6f60 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.871+0000 7f078d7f4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55874b4b9c90 con 0x55874b0ce0a0 2024-06-06T02:37:39.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f078d7f4740 10 client.0 _ll_register_callbacks cb 0x7f0768009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f077fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0777400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54104/0 (socket says 172.21.15.82:54104) 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53608/0 (socket says 172.21.15.82:53608) 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0777400640 1 -- 172.21.15.82:0/889092158 learned_addr learned my addr 172.21.15.82:0/889092158 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f077fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47396/0 (socket says 172.21.15.82:47396) 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 -- 172.21.15.82:0/889092158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 msgr2=0x55874b4b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 -- 172.21.15.82:0/889092158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 msgr2=0x55874b4c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.872+0000 7f0785200640 1 -- 172.21.15.82:0/889092158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55874b4c22a0 con 0x55874b0f6f60 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f0785200640 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07780a70b0 tx=0x7f07780aa650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=836ed6e7b607785 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f076e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07780ac040 con 0x55874b0f6f60 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07680054d0 con 0x55874b0f6f60 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f07780b2810 con 0x55874b0f6f60 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07780b2ca0 con 0x55874b0f6f60 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f078d7f4740 10 client.25130 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:39.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55874b5229e0 con 0x55874b0f6f60 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.873+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07680054d0 con 0x55874b0f6f60 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f07780a8ba0 con 0x55874b0f6f60 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 10 client.25130 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 10 client.25130 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 20 client.25130 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b08ac90 0x55874b526200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 4 client.25130 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "status"}) -- 0x55874b40f570 con 0x55874b08ac90 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.874+0000 7f077fe00640 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b08ac90 0x55874b526200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f077fe00640 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b08ac90 0x55874b526200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb777915d3820fd8 server_cookie=d4dc15d326ccb2d2 in_seq=0 out_seq=0 2024-06-06T02:37:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f076e000640 10 client.25130 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f076e000640 1 -- 172.21.15.82:0/889092158 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55874b40f570 con 0x55874b08ac90 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f076e000640 10 client.25130 handle_command_reply: tid=0 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f078d7f4740 1 client.25130 shutdown 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 msgr2=0x55874b4c1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.875+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f07780a70b0 tx=0x7f07780aa650 comp rx=0 tx=0).stop 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 shutdown_connections 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55874b08ac90 0x55874b526200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55874b0f6f60 0x55874b4c1b60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55874b0d6280 0x55874b4c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 --2- 172.21.15.82:0/889092158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55874b0ce0a0 0x55874b4b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f076e000640 0 client.25130 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 >> 172.21.15.82:0/889092158 conn(0x55874b0eb350 msgr2=0x55874b4a7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 shutdown_connections 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 1 -- 172.21.15.82:0/889092158 wait complete. 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.876+0000 7f078d7f4740 20 client.25130 trim_cache size 0 max 16384 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24659, 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:37:39.879 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 197.968352837, 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 234.361579651 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 msgr2=0x7f07640b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 0x7f07640b4d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55874b49a1a0 tx=0x7f0768015040 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 msgr2=0x7f07801a4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 0x7f07801a4570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f077800ea80 tx=0x7f077800ef40 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 shutdown_connections 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07640b2870 0x7f07640b4d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f078010e590 0x7f07801a4570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f078010dc40 0x7f07801a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 --2- 172.21.15.82:0/2232832271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0780109310 0x7f078019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 >> 172.21.15.82:0/2232832271 conn(0x7f0780078a80 msgr2=0x7f0780079170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 shutdown_connections 2024-06-06T02:37:39.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:39.877+0000 7f0785c00640 1 -- 172.21.15.82:0/2232832271 wait complete. 2024-06-06T02:37:40.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:40 smithi082 ceph-mon[31579]: pgmap v442: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:40.600 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.i status 2024-06-06T02:37:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:40 smithi103 ceph-mon[36349]: pgmap v442: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:40 smithi184 ceph-mon[36922]: pgmap v442: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:41.053 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:42.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:42 smithi082 ceph-mon[31579]: pgmap v443: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:42 smithi103 ceph-mon[36349]: pgmap v443: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:42 smithi184 ceph-mon[36922]: pgmap v443: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.287+0000 7f4cc6600640 1 -- 172.21.15.82:0/2729855854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 msgr2=0x7f4cc0113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.287+0000 7f4cc6600640 1 --2- 172.21.15.82:0/2729855854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc0113570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009900 tx=0x7f4ca802a480 comp rx=0 tx=0).stop 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 -- 172.21.15.82:0/2729855854 shutdown_connections 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 --2- 172.21.15.82:0/2729855854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 0x7f4cc0115ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 --2- 172.21.15.82:0/2729855854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc0113570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 --2- 172.21.15.82:0/2729855854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc0074f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 -- 172.21.15.82:0/2729855854 >> 172.21.15.82:0/2729855854 conn(0x7f4cc00fe790 msgr2=0x7f4cc0100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 -- 172.21.15.82:0/2729855854 shutdown_connections 2024-06-06T02:37:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.288+0000 7f4cc6600640 1 -- 172.21.15.82:0/2729855854 wait complete. 2024-06-06T02:37:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.289+0000 7f4cc6600640 1 Processor -- start 2024-06-06T02:37:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.289+0000 7f4cc6600640 1 -- start start 2024-06-06T02:37:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc01a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 0x7f4cc01a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc01192f0 con 0x7f4cc0075450 2024-06-06T02:37:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0119170 con 0x7f4cc0113ab0 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc6600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0119470 con 0x7f4cc0074b00 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36918/0 (socket says 172.21.15.82:36918) 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc5200640 1 -- 172.21.15.82:0/4031920733 learned_addr learned my addr 172.21.15.82:0/4031920733 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc01a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.290+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 0x7f4cc01a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 -- 172.21.15.82:0/4031920733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 msgr2=0x7f4cc01a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 0x7f4cc01a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 -- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 msgr2=0x7f4cc01a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc01a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 -- 172.21.15.82:0/4031920733 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc01a4c20 con 0x7f4cc0074b00 2024-06-06T02:37:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.291+0000 7f4cc5200640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000ea20 tx=0x7f4cb000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.294+0000 7f4cbd600640 1 -- 172.21.15.82:0/4031920733 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000cd80 con 0x7f4cc0074b00 2024-06-06T02:37:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.294+0000 7f4cbd600640 1 -- 172.21.15.82:0/4031920733 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb00054d0 con 0x7f4cc0074b00 2024-06-06T02:37:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.294+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc01a4f10 con 0x7f4cc0074b00 2024-06-06T02:37:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.294+0000 7f4cbd600640 1 -- 172.21.15.82:0/4031920733 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0010430 con 0x7f4cc0074b00 2024-06-06T02:37:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.294+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01a5420 con 0x7f4cc0074b00 2024-06-06T02:37:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 Processor -- start 2024-06-06T02:37:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 -- start start 2024-06-06T02:37:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cbd600640 1 -- 172.21.15.82:0/4031920733 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4cb0005020 con 0x7f4cc0074b00 2024-06-06T02:37:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf5ef60 0x55a8ae304fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae3054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae279ba0 con 0x55a8adf3e280 2024-06-06T02:37:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae269140 con 0x55a8adf5ef60 2024-06-06T02:37:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.299+0000 7f4cce255740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae26d180 con 0x55a8adf360a0 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44434/0 (socket says 172.21.15.82:44434) 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae3054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 -- 172.21.15.82:0/471632124 learned_addr learned my addr 172.21.15.82:0/471632124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf5ef60 0x55a8ae304fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 -- 172.21.15.82:0/471632124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 msgr2=0x55a8ae3054e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae3054e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 -- 172.21.15.82:0/471632124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf5ef60 msgr2=0x55a8ae304fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf5ef60 0x55a8ae304fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cbfe00640 1 -- 172.21.15.82:0/471632124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8adfca540 con 0x55a8adf3e280 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.300+0000 7f4cc5200640 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae3054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4cc006b2f0 tx=0x7f4ca8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb53f179faff347 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cb6000640 1 -- 172.21.15.82:0/471632124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8035040 con 0x55a8adf3e280 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cb6000640 1 -- 172.21.15.82:0/471632124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ca80054f0 con 0x55a8adf3e280 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cb6000640 1 -- 172.21.15.82:0/471632124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80035f0 con 0x55a8adf3e280 2024-06-06T02:37:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cbd600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 0x7f4ca40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cbd600640 1 -- 172.21.15.82:0/4031920733 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4cb00e2580 con 0x7f4cc0074b00 2024-06-06T02:37:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.301+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 0x7f4ca40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 -- 172.21.15.82:0/471632124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 msgr2=0x55a8ae305a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4cc006b2f0 tx=0x7f4ca8004040 comp rx=0 tx=0).stop 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 0x7f4ca40b4d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55a8ae3021c0 tx=0x7f4cb8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 -- 172.21.15.82:0/471632124 shutdown_connections 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae305a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae3054e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 --2- 172.21.15.82:0/471632124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf5ef60 0x55a8ae304fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 -- 172.21.15.82:0/471632124 >> 172.21.15.82:0/471632124 conn(0x55a8adf53350 msgr2=0x55a8ae301810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 -- 172.21.15.82:0/471632124 shutdown_connections 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.302+0000 7f4cce255740 1 -- 172.21.15.82:0/471632124 wait complete. 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.303+0000 7f4cce255740 1 -- start start 2024-06-06T02:37:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.303+0000 7f4cce255740 1 Processor -- start 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae3153e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae0cd5f0 con 0x55a8adf360a0 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae2065e0 con 0x55a8adf3e280 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae3120b0 con 0x55a8adf5ef60 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cce255740 10 client.0 _ll_register_callbacks cb 0x55a8ae21f360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44440/0 (socket says 172.21.15.82:44440) 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cc5200640 1 -- 172.21.15.82:0/455481208 learned_addr learned my addr 172.21.15.82:0/455481208 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.304+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae3153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 -- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 msgr2=0x55a8ae3153e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae3153e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 -- 172.21.15.82:0/455481208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 msgr2=0x55a8ae30fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 -- 172.21.15.82:0/455481208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ae231d50 con 0x55a8adf360a0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4cc5200640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000e9f0 tx=0x7f4cb00a5ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc1416d7e5b661b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4caea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a52f0 con 0x55a8adf360a0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.305+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4cb00b2530 con 0x55a8adf360a0 2024-06-06T02:37:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca80054f0 con 0x55a8adf360a0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4cb0005310 con 0x55a8adf360a0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 10 client.15012 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8ae31e1e0 con 0x55a8adf360a0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ca80054f0 con 0x55a8adf360a0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f4cb00e20d0 con 0x55a8adf360a0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 10 client.15012 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 10 client.15012 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.306+0000 7f4cce255740 20 client.15012 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adf1d8e0 0x55a8ae321c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4cce255740 4 client.15012 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ae27baf0 con 0x55a8adf1d8e0 2024-06-06T02:37:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adf1d8e0 0x55a8ae321c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4caea00640 10 client.15012 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.307+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adf1d8e0 0x55a8ae321c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4bbde0860ef4e89 server_cookie=cba3c86b2cea114d in_seq=0 out_seq=0 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.308+0000 7f4caea00640 1 -- 172.21.15.82:0/455481208 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a8ae27baf0 con 0x55a8adf1d8e0 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.308+0000 7f4caea00640 10 client.15012 handle_command_reply: tid=0 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.308+0000 7f4cce255740 1 client.15012 shutdown 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 msgr2=0x55a8ae30f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000e9f0 tx=0x7f4cb00a5ae0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 shutdown_connections 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adf1d8e0 0x55a8ae321c10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae3153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 --2- 172.21.15.82:0/455481208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf360a0 0x55a8ae30f6d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 >> 172.21.15.82:0/455481208 conn(0x55a8adf53350 msgr2=0x55a8ae304d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4caea00640 0 client.15012 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:37:43.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 shutdown_connections 2024-06-06T02:37:43.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 1 -- 172.21.15.82:0/455481208 wait complete. 2024-06-06T02:37:43.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.309+0000 7f4cce255740 20 client.15012 trim_cache size 0 max 16384 2024-06-06T02:37:43.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.329+0000 7f4cce255740 1 Processor -- start 2024-06-06T02:37:43.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.329+0000 7f4cce255740 1 -- start start 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae30dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 0x55a8ae304d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae31ff50 con 0x55a8adf5ef60 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae320620 con 0x55a8adf3e280 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cce255740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae320cf0 con 0x55a8adf360a0 2024-06-06T02:37:43.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49418/0 (socket says 172.21.15.82:49418) 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cbfe00640 1 -- 172.21.15.82:0/2462296886 learned_addr learned my addr 172.21.15.82:0/2462296886 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 0x55a8ae304d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.330+0000 7f4cc5200640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae30dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 -- 172.21.15.82:0/2462296886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 msgr2=0x55a8ae30dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae30dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 -- 172.21.15.82:0/2462296886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 msgr2=0x55a8ae304d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 0x55a8ae304d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 -- 172.21.15.82:0/2462296886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ae30da20 con 0x55a8adf3e280 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 0x55a8ae304d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cc5200640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae30dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:37:43.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ca802a9a0 tx=0x7f4ca802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc14e04a0cd18181 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.331+0000 7f4cb5600640 1 -- 172.21.15.82:0/2462296886 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8035040 con 0x55a8adf3e280 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.332+0000 7f4cb5600640 1 -- 172.21.15.82:0/2462296886 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ca8004950 con 0x55a8adf3e280 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.332+0000 7f4cb5600640 1 -- 172.21.15.82:0/2462296886 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80050c0 con 0x55a8adf3e280 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- 172.21.15.82:0/2462296886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 msgr2=0x55a8ae30e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ca802a9a0 tx=0x7f4ca802a480 comp rx=0 tx=0).stop 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- 172.21.15.82:0/2462296886 shutdown_connections 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf5ef60 0x55a8ae304d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf3e280 0x55a8ae30e2e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 --2- 172.21.15.82:0/2462296886 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf360a0 0x55a8ae30dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- 172.21.15.82:0/2462296886 >> 172.21.15.82:0/2462296886 conn(0x55a8adf53350 msgr2=0x55a8ae30a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- 172.21.15.82:0/2462296886 shutdown_connections 2024-06-06T02:37:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- 172.21.15.82:0/2462296886 wait complete. 2024-06-06T02:37:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.333+0000 7f4cce255740 1 -- start start 2024-06-06T02:37:43.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 Processor -- start 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae317050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae388ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae321a90 con 0x55a8adf3e280 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae3213c0 con 0x55a8adf360a0 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8ae322160 con 0x55a8adf5ef60 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cce255740 10 client.0 _ll_register_callbacks cb 0x7f4cb00e5cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cbfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae317050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cc5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49428/0 (socket says 172.21.15.82:49428) 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.334+0000 7f4cc5200640 1 -- 172.21.15.82:0/1281231147 learned_addr learned my addr 172.21.15.82:0/1281231147 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5c00640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae388ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 -- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 msgr2=0x55a8ae388ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae388ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 -- 172.21.15.82:0/1281231147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 msgr2=0x55a8ae317050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae317050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 -- 172.21.15.82:0/1281231147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ae3893e0 con 0x55a8adf360a0 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4cc5200640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00a5b90 tx=0x7f4cb00b2760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff3c8d55c40b403 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.335+0000 7f4caea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a52f0 con 0x55a8adf360a0 2024-06-06T02:37:43.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4cb00a6150 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ca8004950 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4cb00a94b0 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4cce255740 10 client.25148 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8ae38a590 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.336+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ca8004950 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f4cb00a8830 con 0x55a8adf360a0 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 10 client.25148 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 10 client.25148 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 20 client.25148 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adef2c90 0x55a8ae38de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 4 client.25148 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:37:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "status"}) -- 0x55a8ae277590 con 0x55a8adef2c90 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.337+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adef2c90 0x55a8ae38de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cbfe00640 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adef2c90 0x55a8ae38de50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=320dde2010ad4be4 server_cookie=761f401c22d9628 in_seq=0 out_seq=0 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4caea00640 10 client.25148 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4caea00640 1 -- 172.21.15.82:0/1281231147 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a8ae277590 con 0x55a8adef2c90 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4caea00640 10 client.25148 handle_command_reply: tid=0 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 client.25148 shutdown 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 msgr2=0x55a8ae316b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00a5b90 tx=0x7f4cb00b2760 comp rx=0 tx=0).stop 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 shutdown_connections 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55a8adef2c90 0x55a8ae38de50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8adf5ef60 0x55a8ae388ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8adf3e280 0x55a8ae317050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 --2- 172.21.15.82:0/1281231147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8adf360a0 0x55a8ae316b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4caea00640 0 client.25148 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.338+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 >> 172.21.15.82:0/1281231147 conn(0x55a8adf53350 msgr2=0x55a8ae304d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 shutdown_connections 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cce255740 1 -- 172.21.15.82:0/1281231147 wait complete. 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cce255740 20 client.25148 trim_cache size 0 max 16384 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24664, 2024-06-06T02:37:43.342 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 202.44505563300001, 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 250.09405778799999 2024-06-06T02:37:43.343 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 msgr2=0x7f4ca40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 0x7f4ca40b4d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55a8ae3021c0 tx=0x7f4cb8009500 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 msgr2=0x7f4cc019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.339+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000ea20 tx=0x7f4cb000ee20 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 shutdown_connections 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc0113ab0 0x7f4cc01a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cc0075450 0x7f4cc01a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4ca40b2870 0x7f4ca40b4d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 --2- 172.21.15.82:0/4031920733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cc0074b00 0x7f4cc019fdb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 >> 172.21.15.82:0/4031920733 conn(0x7f4cc00fe790 msgr2=0x7f4cc00ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:43.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 shutdown_connections 2024-06-06T02:37:43.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:43.340+0000 7f4cc6600640 1 -- 172.21.15.82:0/4031920733 wait complete. 2024-06-06T02:37:44.139 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.g status 2024-06-06T02:37:44.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:44 smithi082 ceph-mon[31579]: pgmap v444: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:44.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:44 smithi103 ceph-mon[36349]: pgmap v444: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:44.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:44 smithi184 ceph-mon[36922]: pgmap v444: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:46.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:46 smithi082 ceph-mon[31579]: pgmap v445: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:46 smithi103 ceph-mon[36349]: pgmap v445: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:46.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:46 smithi184 ceph-mon[36922]: pgmap v445: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:46.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.834+0000 7f85cd000640 1 -- 172.21.15.82:0/821387503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 msgr2=0x7f85c810cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.834+0000 7f85cd000640 1 --2- 172.21.15.82:0/821387503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c810cc80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b002a490 comp rx=0 tx=0).stop 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 -- 172.21.15.82:0/821387503 shutdown_connections 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 --2- 172.21.15.82:0/821387503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 0x7f85c810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 --2- 172.21.15.82:0/821387503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c810cc80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 --2- 172.21.15.82:0/821387503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c81041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 -- 172.21.15.82:0/821387503 >> 172.21.15.82:0/821387503 conn(0x7f85c8078a80 msgr2=0x7f85c8078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 -- 172.21.15.82:0/821387503 shutdown_connections 2024-06-06T02:37:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.835+0000 7f85cd000640 1 -- 172.21.15.82:0/821387503 wait complete. 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.836+0000 7f85cd000640 1 Processor -- start 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.836+0000 7f85cd000640 1 -- start start 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.836+0000 7f85cd000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.836+0000 7f85cd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.836+0000 7f85cd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 0x7f85c8199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85cd000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8112e30 con 0x7f85c8103de0 2024-06-06T02:37:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85cd000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8112cb0 con 0x7f85c8104730 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85cd000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8112fb0 con 0x7f85c810d1c0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44472/0 (socket says 172.21.15.82:44472) 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 -- 172.21.15.82:0/2256663697 learned_addr learned my addr 172.21.15.82:0/2256663697 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85bfe00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c6800640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 0x7f85c8199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 -- 172.21.15.82:0/2256663697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 msgr2=0x7f85c8199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 0x7f85c8199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 -- 172.21.15.82:0/2256663697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 msgr2=0x7f85c819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c819fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.837+0000 7f85c5e00640 1 -- 172.21.15.82:0/2256663697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c8199e90 con 0x7f85c8103de0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f85b800e9f0 tx=0x7f85b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85bea00640 1 -- 172.21.15.82:0/2256663697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b800cd80 con 0x7f85c8103de0 2024-06-06T02:37:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c819a180 con 0x7f85c8103de0 2024-06-06T02:37:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85bea00640 1 -- 172.21.15.82:0/2256663697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b80108e0 con 0x7f85c8103de0 2024-06-06T02:37:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81a6380 con 0x7f85c8103de0 2024-06-06T02:37:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.838+0000 7f85bea00640 1 -- 172.21.15.82:0/2256663697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b8018980 con 0x7f85c8103de0 2024-06-06T02:37:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.841+0000 7f85d3607740 1 Processor -- start 2024-06-06T02:37:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 -- start start 2024-06-06T02:37:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x5623583fe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x5623583fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85bea00640 1 -- 172.21.15.82:0/2256663697 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f85b8010430 con 0x7f85c8103de0 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562358372b80 con 0x56235802f0a0 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562358362120 con 0x562358057f60 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85d3607740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562358366160 con 0x562358037280 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.842+0000 7f85c6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49438/0 (socket says 172.21.15.82:49438) 2024-06-06T02:37:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 -- 172.21.15.82:0/2736025628 learned_addr learned my addr 172.21.15.82:0/2736025628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x5623583fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85bfe00640 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x5623583fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 -- 172.21.15.82:0/2736025628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 msgr2=0x5623583fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x5623583fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 -- 172.21.15.82:0/2736025628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 msgr2=0x5623583fe1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x5623583fe1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 -- 172.21.15.82:0/2736025628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623580c3540 con 0x562358057f60 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85c6800640 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009f50 tx=0x7f85c00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4112e3cd7a09099a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.843+0000 7f85b7400640 1 -- 172.21.15.82:0/2736025628 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c001e070 con 0x562358057f60 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.844+0000 7f85b7400640 1 -- 172.21.15.82:0/2736025628 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c0004030 con 0x562358057f60 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.844+0000 7f85b7400640 1 -- 172.21.15.82:0/2736025628 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c000f6e0 con 0x562358057f60 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85bea00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 0x7f85ac0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 -- 172.21.15.82:0/2736025628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 msgr2=0x5623583fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009f50 tx=0x7f85c00118d0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85bea00640 1 -- 172.21.15.82:0/2256663697 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f85b80e2570 con 0x7f85c8103de0 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 0x7f85ac0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 -- 172.21.15.82:0/2736025628 shutdown_connections 2024-06-06T02:37:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x5623583fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x5623583fe1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 --2- 172.21.15.82:0/2736025628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358057f60 0x5623583fdcb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 -- 172.21.15.82:0/2736025628 >> 172.21.15.82:0/2736025628 conn(0x56235804c350 msgr2=0x5623583fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 -- 172.21.15.82:0/2736025628 shutdown_connections 2024-06-06T02:37:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.845+0000 7f85d3607740 1 -- 172.21.15.82:0/2736025628 wait complete. 2024-06-06T02:37:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.846+0000 7f85c5e00640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 0x7f85ac0b4d00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c6a0 tx=0x7f85b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.846+0000 7f85d3607740 1 -- start start 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.846+0000 7f85d3607740 1 Processor -- start 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x56235840e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x56235840c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623581c65f0 con 0x56235802f0a0 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623582ff5c0 con 0x562358037280 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56235840f310 con 0x562358057f60 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85d3607740 10 client.0 _ll_register_callbacks cb 0x562358318340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85c6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x56235840e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49442/0 (socket says 172.21.15.82:49442) 2024-06-06T02:37:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85bfe00640 1 -- 172.21.15.82:0/4105971903 learned_addr learned my addr 172.21.15.82:0/4105971903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85c6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x56235840e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44482/0 (socket says 172.21.15.82:44482) 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.847+0000 7f85c6800640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x56235840c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 -- 172.21.15.82:0/4105971903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 msgr2=0x56235840c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x56235840c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 -- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 msgr2=0x56235840e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x56235840e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 -- 172.21.15.82:0/4105971903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56235832ad30 con 0x562358037280 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85bfe00640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b0032e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20685dbcc650965 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85abe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0035040 con 0x562358037280 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.848+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85c0004030 con 0x562358037280 2024-06-06T02:37:46.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f85b0031760 con 0x562358037280 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85b0004040 con 0x562358037280 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85d3607740 10 client.25160 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56235841b4a0 con 0x562358037280 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85c0004030 con 0x562358037280 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f85b0004750 con 0x562358037280 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.849+0000 7f85d3607740 10 client.25160 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85d3607740 10 client.25160 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85d3607740 20 client.25160 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623580168e0 0x56235841ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85d3607740 4 client.25160 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:37:46.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562358374ad0 con 0x5623580168e0 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85c6800640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623580168e0 0x56235841ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85c6800640 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623580168e0 0x56235841ef10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35d9dda88d6806be server_cookie=d3858d2dfbdcc2c1 in_seq=0 out_seq=0 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.850+0000 7f85abe00640 10 client.25160 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.851+0000 7f85abe00640 1 -- 172.21.15.82:0/4105971903 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562358374ad0 con 0x5623580168e0 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.851+0000 7f85abe00640 10 client.25160 handle_command_reply: tid=0 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.851+0000 7f85d3607740 1 client.25160 shutdown 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 msgr2=0x56235840e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009900 tx=0x7f85b0032e90 comp rx=0 tx=0).stop 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 shutdown_connections 2024-06-06T02:37:46.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x56235840c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562358037280 0x56235840e770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623580168e0 0x56235841ef10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 --2- 172.21.15.82:0/4105971903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56235802f0a0 0x56235840e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 >> 172.21.15.82:0/4105971903 conn(0x56235804c350 msgr2=0x562358400460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85abe00640 0 client.25160 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 shutdown_connections 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 1 -- 172.21.15.82:0/4105971903 wait complete. 2024-06-06T02:37:46.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.852+0000 7f85d3607740 20 client.25160 trim_cache size 0 max 16384 2024-06-06T02:37:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 Processor -- start 2024-06-06T02:37:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 -- start start 2024-06-06T02:37:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x56235841daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358057f60 0x56235840b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56235841d250 con 0x562358057f60 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56235841d920 con 0x56235802f0a0 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85d3607740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56235841dff0 con 0x562358037280 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.873+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37000/0 (socket says 172.21.15.82:37000) 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 -- 172.21.15.82:0/3484946891 learned_addr learned my addr 172.21.15.82:0/3484946891 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85c6800640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x56235841daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85c6800640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358057f60 0x56235840b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 -- 172.21.15.82:0/3484946891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 msgr2=0x56235841daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x56235841daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 -- 172.21.15.82:0/3484946891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358057f60 msgr2=0x56235840b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358057f60 0x56235840b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 -- 172.21.15.82:0/3484946891 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623583fb480 con 0x562358037280 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85c6800640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x56235841daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.874+0000 7f85bfe00640 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006010 tx=0x7f85b002a490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d544cddbdb548ea server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.875+0000 7f85b6a00640 1 -- 172.21.15.82:0/3484946891 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0035070 con 0x562358037280 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.875+0000 7f85b6a00640 1 -- 172.21.15.82:0/3484946891 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b00043e0 con 0x562358037280 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.875+0000 7f85b6a00640 1 -- 172.21.15.82:0/3484946891 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0004ff0 con 0x562358037280 2024-06-06T02:37:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.875+0000 7f85d3607740 1 -- 172.21.15.82:0/3484946891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 msgr2=0x56235840afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.875+0000 7f85d3607740 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006010 tx=0x7f85b002a490 comp rx=0 tx=0).stop 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 -- 172.21.15.82:0/3484946891 shutdown_connections 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358057f60 0x56235840b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358037280 0x56235840afb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 --2- 172.21.15.82:0/3484946891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x56235841daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 -- 172.21.15.82:0/3484946891 >> 172.21.15.82:0/3484946891 conn(0x56235804c350 msgr2=0x5623583f54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 -- 172.21.15.82:0/3484946891 shutdown_connections 2024-06-06T02:37:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 -- 172.21.15.82:0/3484946891 wait complete. 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.876+0000 7f85d3607740 1 -- start start 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 Processor -- start 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x562358402d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 0x562358403260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56235841ed90 con 0x562358037280 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56235841e6c0 con 0x56235802f0a0 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56235841f460 con 0x562358057f60 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85d3607740 10 client.0 _ll_register_callbacks cb 0x7f85b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 0x562358403260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85c6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85c6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37016/0 (socket says 172.21.15.82:37016) 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85bfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 0x562358403260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44502/0 (socket says 172.21.15.82:44502) 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85c6800640 1 -- 172.21.15.82:0/2876276198 learned_addr learned my addr 172.21.15.82:0/2876276198 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.877+0000 7f85c6800640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x562358402d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 -- 172.21.15.82:0/2876276198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 msgr2=0x562358402d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x562358402d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 -- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 msgr2=0x562358403260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:37:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 0x562358403260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 -- 172.21.15.82:0/2876276198 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562358426200 con 0x562358057f60 2024-06-06T02:37:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85c6800640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85c0012fd0 tx=0x7f85c0013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6544b5e96f29127 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85abe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.878+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c001e070 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f85c0004180 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b00043e0 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85c0004380 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85d3607740 10 client.25201 fetch_fsmap learned FSMap version 25 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562358427480 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85b00043e0 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.879+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 25) ==== 8338+0+0 (secure 0 0 0) 0x7f85c000fca0 con 0x562358057f60 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 10 client.25201 fetch_fsmap finished waiting for FSMap version 25 2024-06-06T02:37:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 10 client.25201 resolve_mds: resolved name 'g' to daemon mds.g 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 20 client.25201 populate_metadata read hostname 'smithi082' 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562357febc90 0x56235848f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 4 client.25201 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "status"}) -- 0x562358370570 con 0x562357febc90 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.880+0000 7f85bfe00640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562357febc90 0x56235848f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85bfe00640 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562357febc90 0x56235848f500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ef06b3fb861845c server_cookie=af3deea7590bc2c in_seq=0 out_seq=0 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85abe00640 10 client.25201 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85abe00640 1 -- 172.21.15.82:0/2876276198 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x562358370570 con 0x562357febc90 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85abe00640 10 client.25201 handle_command_reply: tid=0 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 client.25201 shutdown 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 msgr2=0x5623584037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85c0012fd0 tx=0x7f85c0013040 comp rx=0 tx=0).stop 2024-06-06T02:37:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 shutdown_connections 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562358057f60 0x5623584037a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562357febc90 0x56235848f500 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562358037280 0x562358403260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 --2- 172.21.15.82:0/2876276198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56235802f0a0 0x562358402d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85abe00640 0 client.25201 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.881+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 >> 172.21.15.82:0/2876276198 conn(0x56235804c350 msgr2=0x5623583f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 shutdown_connections 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85d3607740 1 -- 172.21.15.82:0/2876276198 wait complete. 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85d3607740 20 client.25201 trim_cache size 0 max 16384 2024-06-06T02:37:46.883 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "b8ccb8a2-23ab-11ef-bc9b-c7b262605968", 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24676, 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 223.252983465, 2024-06-06T02:37:46.884 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 80, 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 249.333528462 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 msgr2=0x7f85ac0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 0x7f85ac0b4d00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f85b800c6a0 tx=0x7f85b8000bc0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 msgr2=0x7f85c819f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.882+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f85b800e9f0 tx=0x7f85b800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 shutdown_connections 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f85ac0b27f0 0x7f85ac0b4d00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c810d1c0 0x7f85c8199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8104730 0x7f85c819fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 --2- 172.21.15.82:0/2256663697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85c8103de0 0x7f85c819f5d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 >> 172.21.15.82:0/2256663697 conn(0x7f85c8078a80 msgr2=0x7f85c80fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 shutdown_connections 2024-06-06T02:37:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:46.883+0000 7f85cd000640 1 -- 172.21.15.82:0/2256663697 wait complete. 2024-06-06T02:37:47.731 INFO:teuthology.run_tasks:Running task sequential... 2024-06-06T02:37:47.751 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-06T02:37:47.751 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-06T02:37:47.752 INFO:teuthology.task.print:Enabling mgr modules 2024-06-06T02:37:47.752 INFO:teuthology.run_tasks:Running task kclient... 2024-06-06T02:37:47.796 INFO:tasks.kclient:Mounting kernel clients... 2024-06-06T02:37:47.796 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-06T02:37:47.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:47.796 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-06T02:37:47.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:47.857 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-06-06T02:37:47.946 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-06-06T02:37:47.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T02:37:47.951 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-06-06T02:37:47.951 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-06T02:37:47.951 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T02:37:47.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-06T02:37:48.396 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:48.585 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:48 smithi082 ceph-mon[31579]: pgmap v446: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:48.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:48 smithi103 ceph-mon[36349]: pgmap v446: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:48 smithi184 ceph-mon[36922]: pgmap v446: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 -- 172.21.15.82:0/4104074076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 msgr2=0x7ffb24109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 --2- 172.21.15.82:0/4104074076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb24109e20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009cd0 tx=0x7ffb1002a8e0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 -- 172.21.15.82:0/4104074076 shutdown_connections 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 --2- 172.21.15.82:0/4104074076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 0x7ffb24111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 --2- 172.21.15.82:0/4104074076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb24109e20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 --2- 172.21.15.82:0/4104074076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 -- 172.21.15.82:0/4104074076 >> 172.21.15.82:0/4104074076 conn(0x7ffb24100b40 msgr2=0x7ffb24102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:50.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 -- 172.21.15.82:0/4104074076 shutdown_connections 2024-06-06T02:37:50.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.549+0000 7ffb2c200640 1 -- 172.21.15.82:0/4104074076 wait complete. 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 Processor -- start 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 -- start start 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb241a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 0x7ffb2419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb241150a0 con 0x7ffb2410a360 2024-06-06T02:37:50.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24114f20 con 0x7ffb24109a10 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.551+0000 7ffb2c200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ffb24115220 con 0x7ffb241050e0 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:37042/0 (socket says 172.21.15.82:37042) 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb241a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 -- 172.21.15.82:0/2665987823 learned_addr learned my addr 172.21.15.82:0/2665987823 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb2a200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 0x7ffb2419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 -- 172.21.15.82:0/2665987823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 msgr2=0x7ffb241a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb241a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 -- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 msgr2=0x7ffb2419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 0x7ffb2419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 -- 172.21.15.82:0/2665987823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2419bfc0 con 0x7ffb241050e0 2024-06-06T02:37:50.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.552+0000 7ffb29800640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e9f0 tx=0x7ffb1400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:50.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.553+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400cd80 con 0x7ffb241050e0 2024-06-06T02:37:50.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.553+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2419c2b0 con 0x7ffb241050e0 2024-06-06T02:37:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.553+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb140054d0 con 0x7ffb241050e0 2024-06-06T02:37:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.553+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14010690 con 0x7ffb241050e0 2024-06-06T02:37:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.553+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb241a85c0 con 0x7ffb241050e0 2024-06-06T02:37:50.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.554+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb241054f0 con 0x7ffb241050e0 2024-06-06T02:37:50.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.556+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffb14004e90 con 0x7ffb241050e0 2024-06-06T02:37:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.558+0000 7ffb22000640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 0x7ffb080b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.558+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ffb140e2670 con 0x7ffb241050e0 2024-06-06T02:37:50.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.558+0000 7ffb28e00640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 0x7ffb080b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:50.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.559+0000 7ffb28e00640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 0x7ffb080b4d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb10000f80 tx=0x7ffb10005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:50.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.562+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffb140aa350 con 0x7ffb241050e0 2024-06-06T02:37:50.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:50 smithi082 ceph-mon[31579]: pgmap v447: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:50 smithi103 ceph-mon[36349]: pgmap v447: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:50 smithi184 ceph-mon[36922]: pgmap v447: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:37:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.812+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffb2410d380 con 0x7ffb241050e0 2024-06-06T02:37:50.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.813+0000 7ffb22000640 1 -- 172.21.15.82:0/2665987823 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7ffb140a9c50 con 0x7ffb241050e0 2024-06-06T02:37:50.813 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-06T02:37:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.816+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 msgr2=0x7ffb080b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.816+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 0x7ffb080b4d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb10000f80 tx=0x7ffb10005fd0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 msgr2=0x7ffb241a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400e9f0 tx=0x7ffb1400edf0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 shutdown_connections 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb2410a360 0x7ffb2419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb24109a10 0x7ffb241a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ffb080b27f0 0x7ffb080b4d00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 --2- 172.21.15.82:0/2665987823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb241050e0 0x7ffb241a1730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 >> 172.21.15.82:0/2665987823 conn(0x7ffb24100b40 msgr2=0x7ffb241011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 shutdown_connections 2024-06-06T02:37:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:50.817+0000 7ffb2c200640 1 -- 172.21.15.82:0/2665987823 wait complete. 2024-06-06T02:37:51.594 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:51 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2665987823' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T02:37:51.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:51 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2665987823' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T02:37:51.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:51 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2665987823' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-06T02:37:51.651 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-06T02:37:51.652 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-06-06T02:37:51.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:51.652 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-06T02:37:51.707 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-06-06T02:37:51.708 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41819sec preferred_lft 41819sec 2024-06-06T02:37:51.709 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-06-06T02:37:51.709 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-06-06T02:37:51.709 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-06T02:37:51.709 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T02:37:51.709 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-06T02:37:51.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-06-06T02:37:51.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-06-06T02:37:51.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-06-06T02:37:51.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-06T02:37:51.710 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-06T02:37:51.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:52.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:52.199 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-06T02:37:52.267 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-06-06T02:37:52.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:52.273 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-06-06T02:37:52.330 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-06-06T02:37:52.331 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-06T02:37:52.331 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-06T02:37:52.331 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-06T02:37:52.331 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-06T02:37:52.332 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T02:37:52.332 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-06T02:37:52.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-06T02:37:52.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-06T02:37:52.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-06T02:37:52.333 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-06T02:37:52.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:52 smithi082 ceph-mon[31579]: pgmap v448: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:52.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:52 smithi103 ceph-mon[36349]: pgmap v448: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:52.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:52 smithi184 ceph-mon[36922]: pgmap v448: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:53.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:53.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:53.093 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-06T02:37:53.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:53.191 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-06-06T02:37:53.247 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T02:37:53.247 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-06T02:37:53.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T02:37:53.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-06-06T02:37:53.247 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-06T02:37:53.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:53.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:53.432 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-06-06T02:37:53.433 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-06T02:37:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:53.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:53.731 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-06-06T02:37:53.731 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-06-06T02:37:53.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-06-06T02:37:53.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-06-06T02:37:53.731 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-06-06T02:37:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:53.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:53.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T02:37:53.930 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-06-06T02:37:53.976 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-06-06T02:37:53.977 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-06T02:37:53.977 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-06-06T02:37:54.065 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-06T02:37:54.065 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-06T02:37:54.065 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/aa56730a-0b0b-49a1-b2a3-7d6ed36a3030 2024-06-06T02:37:54.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:54.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/aa56730a-0b0b-49a1-b2a3-7d6ed36a3030 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-06-06T02:37:54.300 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-06-06T02:37:54.300 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-06-06T02:37:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:54 smithi103 ceph-mon[36349]: pgmap v449: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:54.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:54 smithi082 ceph-mon[31579]: pgmap v449: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:54 smithi184 ceph-mon[36922]: pgmap v449: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-06-06T02:37:54.998 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,nowsync,nofallback 2024-06-06T02:37:54.998 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync". 2024-06-06T02:37:54.998 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.103:6789,172.21.15.184:6789" 2024-06-06T02:37:54.999 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with new device syntax: 0@b8ccb8a2-23ab-11ef-bc9b-c7b262605968.cephfs=/volumes/qa/sv_1/aa56730a-0b0b-49a1-b2a3-7d6ed36a3030 2024-06-06T02:37:54.999 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,nowsync,name=0,key=0,mon_addr=172.21.15.82:6789/172.21.15.103:6789/172.21.15.184:6789" will pass to kernel 2024-06-06T02:37:55.002 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-06-06T02:37:55.003 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-06-06T02:37:55.003 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-06-06T02:37:55.003 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-06-06T02:37:55.003 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-06-06T02:37:55.008 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-06T02:37:55.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:37:55.008 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-06-06T02:37:55.093 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T02:37:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T02:37:55.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:55.215 INFO:teuthology.orchestra.run.smithi082.stdout:client25175 2024-06-06T02:37:55.215 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:37:55.215 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T02:37:55.266 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T02:37:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T02:37:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:55.389 INFO:teuthology.orchestra.run.smithi082.stdout:client25175 2024-06-06T02:37:55.389 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-06T02:37:55.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-06-06T02:37:55.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:55.502 INFO:teuthology.orchestra.run.smithi082.stdout:client25175 2024-06-06T02:37:55.503 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968.client25175/status') 2024-06-06T02:37:55.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-06-06T02:37:55.633 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.25175 (3)172.21.15.82:0/998252318 2024-06-06T02:37:55.633 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-06-06T02:37:55.634 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-06-06T02:37:55.634 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-06-06T02:37:55.634 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 8.3288e-05 s, 840 kB/s 2024-06-06T02:37:55.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-06-06T02:37:55.646 INFO:teuthology.run_tasks:Running task exec... 2024-06-06T02:37:55.705 INFO:teuthology.task.exec:Executing custom commands... 2024-06-06T02:37:55.706 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:37:55.706 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-06-06T02:37:55.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 -- 172.21.15.82:0/607347019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c10aa60 msgr2=0x7fcb8c10cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:55.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 --2- 172.21.15.82:0/607347019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c10cf70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009900 tx=0x7fcb8402a400 comp rx=0 tx=0).stop 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 -- 172.21.15.82:0/607347019 shutdown_connections 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 --2- 172.21.15.82:0/607347019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c10cf70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 --2- 172.21.15.82:0/607347019 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c075030 0x7fcb8c075440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 --2- 172.21.15.82:0/607347019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 0x7fcb8c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 -- 172.21.15.82:0/607347019 >> 172.21.15.82:0/607347019 conn(0x7fcb8c0fe3d0 msgr2=0x7fcb8c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 -- 172.21.15.82:0/607347019 shutdown_connections 2024-06-06T02:37:55.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.982+0000 7fcb92200640 1 -- 172.21.15.82:0/607347019 wait complete. 2024-06-06T02:37:55.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.983+0000 7fcb92200640 1 Processor -- start 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.983+0000 7fcb92200640 1 -- start start 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 0x7fcb8c19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c1a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c110920 con 0x7fcb8c075030 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1107a0 con 0x7fcb8c076630 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb92200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c110aa0 con 0x7fcb8c10aa60 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:55.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52956/0 (socket says 172.21.15.82:52956) 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 -- 172.21.15.82:0/853009407 learned_addr learned my addr 172.21.15.82:0/853009407 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8aa00640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 0x7fcb8c19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8be00640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c1a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 -- 172.21.15.82:0/853009407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c10aa60 msgr2=0x7fcb8c1a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c1a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 -- 172.21.15.82:0/853009407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 msgr2=0x7fcb8c19ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 0x7fcb8c19ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.984+0000 7fcb8b400640 1 -- 172.21.15.82:0/853009407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c1a3010 con 0x7fcb8c075030 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb8b400640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e9c0 tx=0x7fcb7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400cd80 con 0x7fcb8c075030 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c1a3300 con 0x7fcb8c075030 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb740035f0 con 0x7fcb8c075030 2024-06-06T02:37:55.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74010690 con 0x7fcb8c075030 2024-06-06T02:37:55.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.985+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a38a0 con 0x7fcb8c075030 2024-06-06T02:37:55.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.986+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8c109870 con 0x7fcb8c075030 2024-06-06T02:37:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.989+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcb740037a0 con 0x7fcb8c075030 2024-06-06T02:37:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.990+0000 7fcb83e00640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 0x7fcb700b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:55.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.990+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb740e2710 con 0x7fcb8c075030 2024-06-06T02:37:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.991+0000 7fcb8aa00640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 0x7fcb700b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:55.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.991+0000 7fcb8aa00640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 0x7fcb700b4cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c19c570 tx=0x7fcb7c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:55.992+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcb740aa3f0 con 0x7fcb8c075030 2024-06-06T02:37:56.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.245+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fcb8c02dd00 con 0x7fcb8c075030 2024-06-06T02:37:56.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.331+0000 7fcb83e00640 1 -- 172.21.15.82:0/853009407 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7fcb740a9cf0 con 0x7fcb8c075030 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.334+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 msgr2=0x7fcb700b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.334+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 0x7fcb700b4cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c19c570 tx=0x7fcb7c009500 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.334+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 msgr2=0x7fcb8c19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.334+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400e9c0 tx=0x7fcb7400ee80 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 shutdown_connections 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb700b27e0 0x7fcb700b4cf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb8c10aa60 0x7fcb8c1a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb8c076630 0x7fcb8c19ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 --2- 172.21.15.82:0/853009407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb8c075030 0x7fcb8c19b4d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 >> 172.21.15.82:0/853009407 conn(0x7fcb8c0fe3d0 msgr2=0x7fcb8c106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 shutdown_connections 2024-06-06T02:37:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.335+0000 7fcb92200640 1 -- 172.21.15.82:0/853009407 wait complete. 2024-06-06T02:37:56.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-06-06T02:37:56.383 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-mon[31579]: pgmap v450: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:56.383 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-06T02:37:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:56 smithi103 ceph-mon[36349]: pgmap v450: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:56 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-06T02:37:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 -- 172.21.15.82:0/2375497373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc103cb0 msgr2=0x7fe3fc1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 --2- 172.21.15.82:0/2375497373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc1040c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009900 tx=0x7fe3e802a410 comp rx=0 tx=0).stop 2024-06-06T02:37:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 -- 172.21.15.82:0/2375497373 shutdown_connections 2024-06-06T02:37:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 --2- 172.21.15.82:0/2375497373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc104600 0x7fe3fc10af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 --2- 172.21.15.82:0/2375497373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc1040c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 --2- 172.21.15.82:0/2375497373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc102b90 0x7fe3fc102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 -- 172.21.15.82:0/2375497373 >> 172.21.15.82:0/2375497373 conn(0x7fe3fc0fe390 msgr2=0x7fe3fc100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 -- 172.21.15.82:0/2375497373 shutdown_connections 2024-06-06T02:37:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.635+0000 7fe402600640 1 -- 172.21.15.82:0/2375497373 wait complete. 2024-06-06T02:37:56.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.636+0000 7fe402600640 1 Processor -- start 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.636+0000 7fe402600640 1 -- start start 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc074ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc104600 0x7fe3fc074ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc10e6d0 con 0x7fe3fc102b90 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc10e550 con 0x7fe3fc104600 2024-06-06T02:37:56.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe402600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc10e850 con 0x7fe3fc103cb0 2024-06-06T02:37:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe3fb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:56.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe3fb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52968/0 (socket says 172.21.15.82:52968) 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe3fb400640 1 -- 172.21.15.82:0/3457196924 learned_addr learned my addr 172.21.15.82:0/3457196924 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe3faa00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc074ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.637+0000 7fe3fbe00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc104600 0x7fe3fc074ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 -- 172.21.15.82:0/3457196924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc104600 msgr2=0x7fe3fc074ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc104600 0x7fe3fc074ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 -- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 msgr2=0x7fe3fc076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 -- 172.21.15.82:0/3457196924 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc075720 con 0x7fe3fc103cb0 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3fb400640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3faa00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc074ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e803f070 con 0x7fe3fc103cb0 2024-06-06T02:37:56.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc1a3340 con 0x7fe3fc103cb0 2024-06-06T02:37:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e8032e50 con 0x7fe3fc103cb0 2024-06-06T02:37:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.638+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8035070 con 0x7fe3fc103cb0 2024-06-06T02:37:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.639+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1a37a0 con 0x7fe3fc103cb0 2024-06-06T02:37:56.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.640+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc102fa0 con 0x7fe3fc103cb0 2024-06-06T02:37:56.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.642+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe3e80037f0 con 0x7fe3fc103cb0 2024-06-06T02:37:56.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.644+0000 7fe3f3e00640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 0x7fe3e00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.644+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe3e8102da0 con 0x7fe3fc103cb0 2024-06-06T02:37:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.644+0000 7fe3fb400640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 0x7fe3e00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:56.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.645+0000 7fe3fb400640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 0x7fe3e00b4cf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011550 tx=0x7fe3ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.646+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe3e80ca430 con 0x7fe3fc103cb0 2024-06-06T02:37:56.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:56 smithi184 ceph-mon[36922]: pgmap v450: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-06-06T02:37:56.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:56 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-06T02:37:56.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.883+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fe3fc062c60 con 0x7fe3e00b27e0 2024-06-06T02:37:56.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.906+0000 7fe3f3e00640 1 -- 172.21.15.82:0/3457196924 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fe3fc062c60 con 0x7fe3e00b27e0 2024-06-06T02:37:56.906 INFO:teuthology.orchestra.run.smithi082.stdout:{} 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 msgr2=0x7fe3e00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 0x7fe3e00b4cf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011550 tx=0x7fe3ec005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 msgr2=0x7fe3fc074ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc074ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006010 tx=0x7fe3e8004270 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 shutdown_connections 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc104600 0x7fe3fc074ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe3e00b27e0 0x7fe3e00b4cf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3fc103cb0 0x7fe3fc074ab0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 --2- 172.21.15.82:0/3457196924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3fc102b90 0x7fe3fc076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:56.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 >> 172.21.15.82:0/3457196924 conn(0x7fe3fc0fe390 msgr2=0x7fe3fc106ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:56.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 shutdown_connections 2024-06-06T02:37:56.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:56.909+0000 7fe402600640 1 -- 172.21.15.82:0/3457196924 wait complete. 2024-06-06T02:37:56.932 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-06T02:37:56.950 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-06-06T02:37:56.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-06T02:37:57.037 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:37:56.892+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:37:57.037 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:37:56.892+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:37:57.038 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:37:56.892+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:37:57.038 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:37:56.892+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:37:57.038 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:37:56 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:37:56.892+0000 7ff12c400640 -1 client.0 error registering admin socket command: (17) File exists 2024-06-06T02:37:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 -- 172.21.15.82:0/3425973278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f810a880 msgr2=0x7fb2f810cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/3425973278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f810a880 0x7fb2f810cd70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009900 tx=0x7fb2f002a3f0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 -- 172.21.15.82:0/3425973278 shutdown_connections 2024-06-06T02:37:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/3425973278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f810a880 0x7fb2f810cd70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/3425973278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8075090 0x7fb2f8075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/3425973278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f8076690 0x7fb2f8074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 -- 172.21.15.82:0/3425973278 >> 172.21.15.82:0/3425973278 conn(0x7fb2f80fe1d0 msgr2=0x7fb2f8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 -- 172.21.15.82:0/3425973278 shutdown_connections 2024-06-06T02:37:57.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.241+0000 7fb2fdc00640 1 -- 172.21.15.82:0/3425973278 wait complete. 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 Processor -- start 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 -- start start 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 0x7fb2f819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f810a880 0x7fb2f81a2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f8110720 con 0x7fb2f8075090 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81105a0 con 0x7fb2f810a880 2024-06-06T02:37:57.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.242+0000 7fb2fdc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f81108a0 con 0x7fb2f8076690 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2f7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 0x7fb2f819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2f7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 0x7fb2f819b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52998/0 (socket says 172.21.15.82:52998) 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35270/0 (socket says 172.21.15.82:35270) 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2f7e00640 1 -- 172.21.15.82:0/4096398097 learned_addr learned my addr 172.21.15.82:0/4096398097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2fd200640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f810a880 0x7fb2f81a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 -- 172.21.15.82:0/4096398097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f810a880 msgr2=0x7fb2f81a2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f810a880 0x7fb2f81a2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 -- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 msgr2=0x7fb2f819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 0x7fb2f819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 -- 172.21.15.82:0/4096398097 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f81a2d90 con 0x7fb2f8076690 2024-06-06T02:37:57.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.243+0000 7fb2ef400640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000e9c0 tx=0x7fb2e000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.244+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000cd80 con 0x7fb2f8076690 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.244+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2e00035f0 con 0x7fb2f8076690 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.244+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f81a3080 con 0x7fb2f8076690 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.244+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0010690 con 0x7fb2f8076690 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.244+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f81a35d0 con 0x7fb2f8076690 2024-06-06T02:37:57.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.245+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f8109610 con 0x7fb2f8076690 2024-06-06T02:37:57.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.248+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb2e00037a0 con 0x7fb2f8076690 2024-06-06T02:37:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.249+0000 7fb2f5600640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 0x7fb2dc0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.249+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb2e00e25b0 con 0x7fb2f8076690 2024-06-06T02:37:57.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.249+0000 7fb2f7e00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 0x7fb2dc0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.250+0000 7fb2f7e00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 0x7fb2dc0b4cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80099a0 tx=0x7fb2e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:57.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.251+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb2e00aa320 con 0x7fb2f8076690 2024-06-06T02:37:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.367+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fb2e0009310 con 0x7fb2f8076690 2024-06-06T02:37:57.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.493+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2f802dea0 con 0x7fb2f8076690 2024-06-06T02:37:57.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.495+0000 7fb2f5600640 1 -- 172.21.15.82:0/4096398097 <== mon.1 v2:172.21.15.184:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fb2e0084330 con 0x7fb2f8076690 2024-06-06T02:37:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:37:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:37:57.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 msgr2=0x7fb2dc0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 0x7fb2dc0b4cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb2e80099a0 tx=0x7fb2e8009500 comp rx=0 tx=0).stop 2024-06-06T02:37:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 msgr2=0x7fb2f819b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000e9c0 tx=0x7fb2e000ee80 comp rx=0 tx=0).stop 2024-06-06T02:37:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 shutdown_connections 2024-06-06T02:37:57.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2f810a880 0x7fb2f81a2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb2dc0b27e0 0x7fb2dc0b4cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2f8076690 0x7fb2f819b790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 --2- 172.21.15.82:0/4096398097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8075090 0x7fb2f819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 >> 172.21.15.82:0/4096398097 conn(0x7fb2f80fe1d0 msgr2=0x7fb2f81067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 shutdown_connections 2024-06-06T02:37:57.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.498+0000 7fb2fdc00640 1 -- 172.21.15.82:0/4096398097 wait complete. 2024-06-06T02:37:57.523 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T02:28:46.735414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-06T02:33:55.297725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-06T02:33:59.381038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T02:37:57.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-06T02:37:57.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:57 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-06T02:37:57.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:57 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:37:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:57 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-06T02:37:57.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:57 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:37:57.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:57 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/853009407' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-06T02:37:57.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:57 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:37:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.798+0000 7f1dd2200640 1 -- 172.21.15.82:0/2442104361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 msgr2=0x7f1dcc074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.798+0000 7f1dd2200640 1 --2- 172.21.15.82:0/2442104361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc074b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009900 tx=0x7f1dc002a410 comp rx=0 tx=0).stop 2024-06-06T02:37:57.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 -- 172.21.15.82:0/2442104361 shutdown_connections 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 --2- 172.21.15.82:0/2442104361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 0x7f1dcc10cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 --2- 172.21.15.82:0/2442104361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 0x7f1dcc075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 --2- 172.21.15.82:0/2442104361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc074b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 -- 172.21.15.82:0/2442104361 >> 172.21.15.82:0/2442104361 conn(0x7f1dcc0fe1d0 msgr2=0x7f1dcc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 -- 172.21.15.82:0/2442104361 shutdown_connections 2024-06-06T02:37:57.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.799+0000 7f1dd2200640 1 -- 172.21.15.82:0/2442104361 wait complete. 2024-06-06T02:37:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 Processor -- start 2024-06-06T02:37:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 -- start start 2024-06-06T02:37:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 0x7f1dcc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 0x7f1dcc1a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc110740 con 0x7f1dcc076690 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1105c0 con 0x7f1dcc075090 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.800+0000 7f1dd2200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc1108c0 con 0x7f1dcc10a880 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53012/0 (socket says 172.21.15.82:53012) 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 -- 172.21.15.82:0/4185072454 learned_addr learned my addr 172.21.15.82:0/4185072454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dd1800640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 0x7f1dcc1a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dd0e00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 0x7f1dcc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 -- 172.21.15.82:0/4185072454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 msgr2=0x7f1dcc1a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 0x7f1dcc1a27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 -- 172.21.15.82:0/4185072454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 msgr2=0x7f1dcc19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 0x7f1dcc19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.801+0000 7f1dcbe00640 1 -- 172.21.15.82:0/4185072454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc1a2e40 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dcbe00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e9c0 tx=0x7f1db800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db800cd80 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1db80054d0 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc1a3130 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8010430 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.802+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc1a3680 con 0x7f1dcc076690 2024-06-06T02:37:57.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.803+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc109610 con 0x7f1dcc076690 2024-06-06T02:37:57.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.806+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f1db8004fd0 con 0x7f1dcc076690 2024-06-06T02:37:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.808+0000 7f1dc9600640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 0x7f1db40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.808+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1db80e2840 con 0x7f1dcc076690 2024-06-06T02:37:57.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.808+0000 7f1dd0e00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 0x7f1db40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:57.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.809+0000 7f1dd0e00640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 0x7f1db40b4d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0031440 tx=0x7f1dc00314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:57.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:57.812+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1db80aa3c0 con 0x7f1dcc076690 2024-06-06T02:37:58.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.015+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1dcc063360 con 0x7f1dcc076690 2024-06-06T02:37:58.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.016+0000 7f1dc9600640 1 -- 172.21.15.82:0/4185072454 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f1db80a9cc0 con 0x7f1dcc076690 2024-06-06T02:37:58.015 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-06-06T02:37:58.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 msgr2=0x7f1db40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 0x7f1db40b4d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0031440 tx=0x7f1dc00314a0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 msgr2=0x7f1dcc19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e9c0 tx=0x7f1db800ee80 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 shutdown_connections 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1db40b2870 0x7f1db40b4d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dcc10a880 0x7f1dcc1a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dcc076690 0x7f1dcc19b840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 --2- 172.21.15.82:0/4185072454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1dcc075090 0x7f1dcc19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 >> 172.21.15.82:0/4185072454 conn(0x7f1dcc0fe1d0 msgr2=0x7f1dcc1067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.018+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 shutdown_connections 2024-06-06T02:37:58.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.019+0000 7f1dd2200640 1 -- 172.21.15.82:0/4185072454 wait complete. 2024-06-06T02:37:58.045 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-06T02:37:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.308+0000 7f9455c00640 1 -- 172.21.15.82:0/1555381421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450105e90 msgr2=0x7f94501062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.308+0000 7f9455c00640 1 --2- 172.21.15.82:0/1555381421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450105e90 0x7f94501062a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f943c009900 tx=0x7f943c02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 -- 172.21.15.82:0/1555381421 shutdown_connections 2024-06-06T02:37:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 --2- 172.21.15.82:0/1555381421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 0x7f945010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 --2- 172.21.15.82:0/1555381421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450105e90 0x7f94501062a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 --2- 172.21.15.82:0/1555381421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450104d70 0x7f9450105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 -- 172.21.15.82:0/1555381421 >> 172.21.15.82:0/1555381421 conn(0x7f9450100590 msgr2=0x7f9450102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 -- 172.21.15.82:0/1555381421 shutdown_connections 2024-06-06T02:37:58.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.309+0000 7f9455c00640 1 -- 172.21.15.82:0/1555381421 wait complete. 2024-06-06T02:37:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 Processor -- start 2024-06-06T02:37:58.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 -- start start 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450104d70 0x7f945019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 0x7f94501a2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94501108b0 con 0x7f9450105e90 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9450110730 con 0x7f9450104d70 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.310+0000 7f9455c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9450110a30 con 0x7f94501067e0 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53038/0 (socket says 172.21.15.82:53038) 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 -- 172.21.15.82:0/466522976 learned_addr learned my addr 172.21.15.82:0/466522976 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944ea00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450104d70 0x7f945019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944f400640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 0x7f94501a2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 -- 172.21.15.82:0/466522976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 msgr2=0x7f94501a2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 0x7f94501a2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 -- 172.21.15.82:0/466522976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450104d70 msgr2=0x7f945019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450104d70 0x7f945019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.311+0000 7f944e000640 1 -- 172.21.15.82:0/466522976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94501a2fd0 con 0x7f9450105e90 2024-06-06T02:37:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f944e000640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c03f030 con 0x7f9450105e90 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f943c003aa0 con 0x7f9450105e90 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94501a3260 con 0x7f9450105e90 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c035070 con 0x7f9450105e90 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.312+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94501a3750 con 0x7f9450105e90 2024-06-06T02:37:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.313+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945010bf60 con 0x7f9450105e90 2024-06-06T02:37:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.315+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f943c042030 con 0x7f9450105e90 2024-06-06T02:37:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.317+0000 7f9447400640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 0x7f94340b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.317+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f943c102fa0 con 0x7f9450105e90 2024-06-06T02:37:58.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.317+0000 7f944ea00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 0x7f94340b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.318+0000 7f944ea00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 0x7f94340b4d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9450105d90 tx=0x7f944000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:58.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.319+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f943c0ca4d0 con 0x7f9450105e90 2024-06-06T02:37:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.512+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f945002de90 con 0x7f9450105e90 2024-06-06T02:37:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.513+0000 7f9447400640 1 -- 172.21.15.82:0/466522976 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7f943c0ce7d0 con 0x7f9450105e90 2024-06-06T02:37:58.512 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-06-06T02:37:58.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 msgr2=0x7f94340b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 0x7f94340b4d90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9450105d90 tx=0x7f944000b390 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 msgr2=0x7f945019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f943c006010 tx=0x7f943c032f90 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 shutdown_connections 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94340b2880 0x7f94340b4d90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94501067e0 0x7f94501a2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9450105e90 0x7f945019b9d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 --2- 172.21.15.82:0/466522976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9450104d70 0x7f945019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 >> 172.21.15.82:0/466522976 conn(0x7f9450100590 msgr2=0x7f9450109130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.516+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 shutdown_connections 2024-06-06T02:37:58.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.517+0000 7f9455c00640 1 -- 172.21.15.82:0/466522976 wait complete. 2024-06-06T02:37:58.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-06T02:37:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:58 smithi103 ceph-mon[36349]: pgmap v451: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T02:37:58.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:58 smithi103 ceph-mon[36349]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:58.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:58 smithi103 ceph-mon[36349]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-06-06T02:37:58.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:58 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4096398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:58.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:58 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4185072454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:37:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:58 smithi082 ceph-mon[31579]: pgmap v451: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T02:37:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:58 smithi082 ceph-mon[31579]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:58 smithi082 ceph-mon[31579]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-06-06T02:37:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:58 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4096398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:58 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4185072454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:37:58.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:58 smithi184 ceph-mon[36922]: pgmap v451: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-06-06T02:37:58.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:58 smithi184 ceph-mon[36922]: from='client.25219 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-06T02:37:58.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:58 smithi184 ceph-mon[36922]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-06-06T02:37:58.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:58 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4096398097' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:37:58.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:58 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4185072454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 -- 172.21.15.82:0/4245411293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 msgr2=0x7f3c6810cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 --2- 172.21.15.82:0/4245411293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c6810cf00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009ca0 tx=0x7f3c6002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 -- 172.21.15.82:0/4245411293 shutdown_connections 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 --2- 172.21.15.82:0/4245411293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c6810cf00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 --2- 172.21.15.82:0/4245411293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68105cb0 0x7f3c681060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 --2- 172.21.15.82:0/4245411293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68104b90 0x7f3c68104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 -- 172.21.15.82:0/4245411293 >> 172.21.15.82:0/4245411293 conn(0x7f3c681003b0 msgr2=0x7f3c68102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 -- 172.21.15.82:0/4245411293 shutdown_connections 2024-06-06T02:37:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.806+0000 7f3c67200640 1 -- 172.21.15.82:0/4245411293 wait complete. 2024-06-06T02:37:58.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.807+0000 7f3c67200640 1 Processor -- start 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 -- start start 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68105cb0 0x7f3c6819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c681a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c681106a0 con 0x7f3c68106600 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68110520 con 0x7f3c68104b90 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c67200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3c68110820 con 0x7f3c68105cb0 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c66800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c681a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c65e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c65e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42126/0 (socket says 172.21.15.82:42126) 2024-06-06T02:37:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c65e00640 1 -- 172.21.15.82:0/3405992972 learned_addr learned my addr 172.21.15.82:0/3405992972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.808+0000 7f3c65400640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68105cb0 0x7f3c6819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 -- 172.21.15.82:0/3405992972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68105cb0 msgr2=0x7f3c6819b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68105cb0 0x7f3c6819b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 -- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 msgr2=0x7f3c681a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c681a26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 -- 172.21.15.82:0/3405992972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c681a2d30 con 0x7f3c68104b90 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c66800640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c681a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c65e00640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800e9c0 tx=0x7f3c5800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800cd80 con 0x7f3c68104b90 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c580054d0 con 0x7f3c68104b90 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c681a2fc0 con 0x7f3c68104b90 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.809+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58010430 con 0x7f3c68104b90 2024-06-06T02:37:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.810+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c681a3480 con 0x7f3c68104b90 2024-06-06T02:37:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.811+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6810bd10 con 0x7f3c68104b90 2024-06-06T02:37:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.813+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f3c58004fb0 con 0x7f3c68104b90 2024-06-06T02:37:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.814+0000 7f3c5ea00640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 0x7f3c4c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:37:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.815+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3c580e29f0 con 0x7f3c68104b90 2024-06-06T02:37:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.815+0000 7f3c65400640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 0x7f3c4c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:37:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.815+0000 7f3c65400640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 0x7f3c4c0b4d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c6819c290 tx=0x7f3c54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:37:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:58.816+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3c58054df0 con 0x7f3c68104b90 2024-06-06T02:37:59.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.029+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3c68063360 con 0x7f3c68104b90 2024-06-06T02:37:59.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.030+0000 7f3c5ea00640 1 -- 172.21.15.82:0/3405992972 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f3c580aa570 con 0x7f3c68104b90 2024-06-06T02:37:59.030 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-06-06T02:37:59.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 msgr2=0x7f3c4c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:59.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 0x7f3c4c0b4d90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c6819c290 tx=0x7f3c54005f90 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 msgr2=0x7f3c6819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800e9c0 tx=0x7f3c5800ee80 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 shutdown_connections 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c68106600 0x7f3c681a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3c4c0b2880 0x7f3c4c0b4d90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3c68105cb0 0x7f3c6819b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 --2- 172.21.15.82:0/3405992972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c68104b90 0x7f3c6819b1f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 >> 172.21.15.82:0/3405992972 conn(0x7f3c681003b0 msgr2=0x7f3c68108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 shutdown_connections 2024-06-06T02:37:59.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:37:59.033+0000 7f3c67200640 1 -- 172.21.15.82:0/3405992972 wait complete. 2024-06-06T02:37:59.059 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-06-06T02:37:59.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:37:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:37:59.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:59 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/466522976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:37:59.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:37:59 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3405992972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:37:59.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/466522976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:37:59.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:37:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3405992972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:37:59.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:59 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/466522976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:37:59.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:37:59 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3405992972' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:38:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:00 smithi103 ceph-mon[36349]: pgmap v452: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:38:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:00 smithi082 ceph-mon[31579]: pgmap v452: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:38:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:00 smithi184 ceph-mon[36922]: pgmap v452: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:38:01.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 -- 172.21.15.82:0/1774081196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 msgr2=0x7ff62c115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 --2- 172.21.15.82:0/1774081196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c115f10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff624009cd0 tx=0x7ff62402a8f0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 -- 172.21.15.82:0/1774081196 shutdown_connections 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 --2- 172.21.15.82:0/1774081196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c115f10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 --2- 172.21.15.82:0/1774081196 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 0x7ff62c1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 --2- 172.21.15.82:0/1774081196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c0770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 -- 172.21.15.82:0/1774081196 >> 172.21.15.82:0/1774081196 conn(0x7ff62c100b40 msgr2=0x7ff62c102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 -- 172.21.15.82:0/1774081196 shutdown_connections 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.744+0000 7ff634400640 1 -- 172.21.15.82:0/1774081196 wait complete. 2024-06-06T02:38:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.745+0000 7ff634400640 1 Processor -- start 2024-06-06T02:38:01.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 -- start start 2024-06-06T02:38:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 0x7ff62c1a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c119480 con 0x7ff62c113af0 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c119300 con 0x7ff62c076c90 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff634400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c119600 con 0x7ff62c0775e0 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff631a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff631a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42130/0 (socket says 172.21.15.82:42130) 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.746+0000 7ff631a00640 1 -- 172.21.15.82:0/2464616893 learned_addr learned my addr 172.21.15.82:0/2464616893 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631000640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 0x7ff62c1a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff632400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 -- 172.21.15.82:0/2464616893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 msgr2=0x7ff62c1a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 0x7ff62c1a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 -- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 msgr2=0x7ff62c1a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c1a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 -- 172.21.15.82:0/2464616893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c1a4d70 con 0x7ff62c076c90 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff632400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.747+0000 7ff631a00640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ea90 tx=0x7ff62000ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.748+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62000ce40 con 0x7ff62c076c90 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.748+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62c1a5060 con 0x7ff62c076c90 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.748+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62c1ac9e0 con 0x7ff62c076c90 2024-06-06T02:38:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.748+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6200035f0 con 0x7ff62c076c90 2024-06-06T02:38:01.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.748+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620010690 con 0x7ff62c076c90 2024-06-06T02:38:01.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.749+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62c0770a0 con 0x7ff62c076c90 2024-06-06T02:38:01.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.751+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7ff620003aa0 con 0x7ff62c076c90 2024-06-06T02:38:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.753+0000 7ff62a000640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 0x7ff6140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.753+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff6200e27c0 con 0x7ff62c076c90 2024-06-06T02:38:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.753+0000 7ff631000640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 0x7ff6140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:01.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.754+0000 7ff631000640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 0x7ff6140b4e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6180095f0 tx=0x7ff618005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:01.755+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff6200aa340 con 0x7ff62c076c90 2024-06-06T02:38:02.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.004+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff62c1a1260 con 0x7ff62c076c90 2024-06-06T02:38:02.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.006+0000 7ff62a000640 1 -- 172.21.15.82:0/2464616893 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11869 (secure 0 0 0) 0x7ff62c1a1260 con 0x7ff62c076c90 2024-06-06T02:38:02.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:02.007 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:37:56.246245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24659,24664,24676]},"id":1}]} 2024-06-06T02:38:02.007 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-06-06T02:38:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 msgr2=0x7ff6140b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 0x7ff6140b4e10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff6180095f0 tx=0x7ff618005f90 comp rx=0 tx=0).stop 2024-06-06T02:38:02.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 msgr2=0x7ff62c19ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ea90 tx=0x7ff62000ef50 comp rx=0 tx=0).stop 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 shutdown_connections 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff62c113af0 0x7ff62c1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff6140b2900 0x7ff6140b4e10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c0775e0 0x7ff62c1a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 --2- 172.21.15.82:0/2464616893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff62c076c90 0x7ff62c19ff00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 >> 172.21.15.82:0/2464616893 conn(0x7ff62c100b40 msgr2=0x7ff62c102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 shutdown_connections 2024-06-06T02:38:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:02.009+0000 7ff634400640 1 -- 172.21.15.82:0/2464616893 wait complete. 2024-06-06T02:38:02.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:02 smithi082 ceph-mon[31579]: pgmap v453: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:02 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2464616893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:02.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:02 smithi184 ceph-mon[36922]: pgmap v453: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:02.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:02 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2464616893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:02 smithi103 ceph-mon[36349]: pgmap v453: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:02 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2464616893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:02.979 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-06-06T02:38:02.979 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-06-06T02:38:02.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T02:38:03.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 -- 172.21.15.82:0/1382207860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f3810aa40 msgr2=0x7f5f38111340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 --2- 172.21.15.82:0/1382207860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f3810aa40 0x7f5f38111340 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009be0 tx=0x7f5f3002a6c0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 -- 172.21.15.82:0/1382207860 shutdown_connections 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 --2- 172.21.15.82:0/1382207860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f3810aa40 0x7f5f38111340 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 --2- 172.21.15.82:0/1382207860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3810a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 --2- 172.21.15.82:0/1382207860 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f38108fd0 0x7f5f381093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 -- 172.21.15.82:0/1382207860 >> 172.21.15.82:0/1382207860 conn(0x7f5f38078200 msgr2=0x7f5f3807a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 -- 172.21.15.82:0/1382207860 shutdown_connections 2024-06-06T02:38:03.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.263+0000 7f5f3d000640 1 -- 172.21.15.82:0/1382207860 wait complete. 2024-06-06T02:38:03.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 Processor -- start 2024-06-06T02:38:03.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 -- start start 2024-06-06T02:38:03.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f38108fd0 0x7f5f3819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 0x7f5f381a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38114b00 con 0x7f5f3810a0f0 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38114980 con 0x7f5f38108fd0 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.265+0000 7f5f3d000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38114c80 con 0x7f5f3810aa40 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f37e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 0x7f5f381a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45122/0 (socket says 172.21.15.82:45122) 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f37e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 0x7f5f381a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53284/0 (socket says 172.21.15.82:53284) 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 -- 172.21.15.82:0/3377859045 learned_addr learned my addr 172.21.15.82:0/3377859045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f37400640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f38108fd0 0x7f5f3819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 -- 172.21.15.82:0/3377859045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 msgr2=0x7f5f381a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 0x7f5f381a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 -- 172.21.15.82:0/3377859045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f38108fd0 msgr2=0x7f5f3819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f38108fd0 0x7f5f3819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.266+0000 7f5f2fe00640 1 -- 172.21.15.82:0/3377859045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f381a71a0 con 0x7f5f3810a0f0 2024-06-06T02:38:03.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f2fe00640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000ea60 tx=0x7f5f2000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:03.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2000cd20 con 0x7f5f3810a0f0 2024-06-06T02:38:03.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f381a7490 con 0x7f5f3810a0f0 2024-06-06T02:38:03.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f200035f0 con 0x7f5f3810a0f0 2024-06-06T02:38:03.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f20010690 con 0x7f5f3810a0f0 2024-06-06T02:38:03.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.267+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f381a79e0 con 0x7f5f3810a0f0 2024-06-06T02:38:03.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.268+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f38110150 con 0x7f5f3810a0f0 2024-06-06T02:38:03.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.271+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f5f200037a0 con 0x7f5f3810a0f0 2024-06-06T02:38:03.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.272+0000 7f5f34c00640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 0x7f5f180b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.272+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5f200e2880 con 0x7f5f3810a0f0 2024-06-06T02:38:03.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.273+0000 7f5f37400640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 0x7f5f180b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.273+0000 7f5f37400640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 0x7f5f180b4d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f38109ff0 tx=0x7f5f28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:03.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.274+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f20054df0 con 0x7f5f3810a0f0 2024-06-06T02:38:03.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.477+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f38062ba0 con 0x7f5f180b2870 2024-06-06T02:38:03.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.492+0000 7f5f34c00640 1 -- 172.21.15.82:0/3377859045 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259124 (secure 0 0 0) 0x7f5f38062ba0 con 0x7f5f180b2870 2024-06-06T02:38:03.495 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:38:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 msgr2=0x7f5f180b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 0x7f5f180b4d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f38109ff0 tx=0x7f5f28009260 comp rx=0 tx=0).stop 2024-06-06T02:38:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 msgr2=0x7f5f3819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f2000ea60 tx=0x7f5f2000ee60 comp rx=0 tx=0).stop 2024-06-06T02:38:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 shutdown_connections 2024-06-06T02:38:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5f180b2870 0x7f5f180b4d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3810aa40 0x7f5f381a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f3810a0f0 0x7f5f3819fba0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 --2- 172.21.15.82:0/3377859045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f38108fd0 0x7f5f3819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 >> 172.21.15.82:0/3377859045 conn(0x7f5f38078200 msgr2=0x7f5f3810d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:03.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 shutdown_connections 2024-06-06T02:38:03.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.497+0000 7f5f3d000640 1 -- 172.21.15.82:0/3377859045 wait complete. 2024-06-06T02:38:03.523 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-06-06T02:38:02.869199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667652,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1403,"num_read_kb":808,"num_write":306,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359832,"kb_used_data":10680,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581992,"statfs":{"total":1151940427776,"available":1151571959808,"internally_reserved":0,"allocated":10936320,"data_stored":7098480,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8981,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":45,"num_write":10,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005575"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763442+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:36:14.763442+0000","last_peered":"2024-06-06T02:36:14.763442+0000","last_clean":"2024-06-06T02:36:14.763442+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:36:14.763442+0000","last_undegraded":"2024-06-06T02:36:14.763442+0000","last_fullsized":"2024-06-06T02:36:14.763442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759693+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:36:14.759693+0000","last_peered":"2024-06-06T02:36:14.759693+0000","last_clean":"2024-06-06T02:36:14.759693+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:36:14.759693+0000","last_undegraded":"2024-06-06T02:36:14.759693+0000","last_fullsized":"2024-06-06T02:36:14.759693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761379+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:36:14.761379+0000","last_peered":"2024-06-06T02:36:14.761379+0000","last_clean":"2024-06-06T02:36:14.761379+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:36:14.761379+0000","last_undegraded":"2024-06-06T02:36:14.761379+0000","last_fullsized":"2024-06-06T02:36:14.761379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.726838+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:36:14.726838+0000","last_peered":"2024-06-06T02:36:14.726838+0000","last_clean":"2024-06-06T02:36:14.726838+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:36:14.726838+0000","last_undegraded":"2024-06-06T02:36:14.726838+0000","last_fullsized":"2024-06-06T02:36:14.726838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758155+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:36:14.758155+0000","last_peered":"2024-06-06T02:36:14.758155+0000","last_clean":"2024-06-06T02:36:14.758155+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:36:14.758155+0000","last_undegraded":"2024-06-06T02:36:14.758155+0000","last_fullsized":"2024-06-06T02:36:14.758155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759514+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:36:14.759514+0000","last_peered":"2024-06-06T02:36:14.759514+0000","last_clean":"2024-06-06T02:36:14.759514+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:36:14.759514+0000","last_undegraded":"2024-06-06T02:36:14.759514+0000","last_fullsized":"2024-06-06T02:36:14.759514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753425+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:36:14.753425+0000","last_peered":"2024-06-06T02:36:14.753425+0000","last_clean":"2024-06-06T02:36:14.753425+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:36:14.753425+0000","last_undegraded":"2024-06-06T02:36:14.753425+0000","last_fullsized":"2024-06-06T02:36:14.753425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758966+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:36:14.758966+0000","last_peered":"2024-06-06T02:36:14.758966+0000","last_clean":"2024-06-06T02:36:14.758966+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:36:14.758966+0000","last_undegraded":"2024-06-06T02:36:14.758966+0000","last_fullsized":"2024-06-06T02:36:14.758966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729985+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:36:14.729985+0000","last_peered":"2024-06-06T02:36:14.729985+0000","last_clean":"2024-06-06T02:36:14.729985+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:36:14.729985+0000","last_undegraded":"2024-06-06T02:36:14.729985+0000","last_fullsized":"2024-06-06T02:36:14.729985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733844+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:36:14.733844+0000","last_peered":"2024-06-06T02:36:14.733844+0000","last_clean":"2024-06-06T02:36:14.733844+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:36:14.733844+0000","last_undegraded":"2024-06-06T02:36:14.733844+0000","last_fullsized":"2024-06-06T02:36:14.733844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731157+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:36:14.731157+0000","last_peered":"2024-06-06T02:36:14.731157+0000","last_clean":"2024-06-06T02:36:14.731157+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:36:14.731157+0000","last_undegraded":"2024-06-06T02:36:14.731157+0000","last_fullsized":"2024-06-06T02:36:14.731157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729515+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:36:14.729515+0000","last_peered":"2024-06-06T02:36:14.729515+0000","last_clean":"2024-06-06T02:36:14.729515+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:36:14.729515+0000","last_undegraded":"2024-06-06T02:36:14.729515+0000","last_fullsized":"2024-06-06T02:36:14.729515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770754+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:36:14.770754+0000","last_peered":"2024-06-06T02:36:14.770754+0000","last_clean":"2024-06-06T02:36:14.770754+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:36:14.770754+0000","last_undegraded":"2024-06-06T02:36:14.770754+0000","last_fullsized":"2024-06-06T02:36:14.770754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764529+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:36:14.764529+0000","last_peered":"2024-06-06T02:36:14.764529+0000","last_clean":"2024-06-06T02:36:14.764529+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:36:14.764529+0000","last_undegraded":"2024-06-06T02:36:14.764529+0000","last_fullsized":"2024-06-06T02:36:14.764529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760237+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:36:14.760237+0000","last_peered":"2024-06-06T02:36:14.760237+0000","last_clean":"2024-06-06T02:36:14.760237+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:36:14.760237+0000","last_undegraded":"2024-06-06T02:36:14.760237+0000","last_fullsized":"2024-06-06T02:36:14.760237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760967+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:36:14.760967+0000","last_peered":"2024-06-06T02:36:14.760967+0000","last_clean":"2024-06-06T02:36:14.760967+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:36:14.760967+0000","last_undegraded":"2024-06-06T02:36:14.760967+0000","last_fullsized":"2024-06-06T02:36:14.760967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763688+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:36:14.763688+0000","last_peered":"2024-06-06T02:36:14.763688+0000","last_clean":"2024-06-06T02:36:14.763688+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:36:14.763688+0000","last_undegraded":"2024-06-06T02:36:14.763688+0000","last_fullsized":"2024-06-06T02:36:14.763688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758949+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:36:14.758949+0000","last_peered":"2024-06-06T02:36:14.758949+0000","last_clean":"2024-06-06T02:36:14.758949+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:36:14.758949+0000","last_undegraded":"2024-06-06T02:36:14.758949+0000","last_fullsized":"2024-06-06T02:36:14.758949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768309+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:36:14.768309+0000","last_peered":"2024-06-06T02:36:14.768309+0000","last_clean":"2024-06-06T02:36:14.768309+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:36:14.768309+0000","last_undegraded":"2024-06-06T02:36:14.768309+0000","last_fullsized":"2024-06-06T02:36:14.768309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.757382+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:36:14.757382+0000","last_peered":"2024-06-06T02:36:14.757382+0000","last_clean":"2024-06-06T02:36:14.757382+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:36:14.757382+0000","last_undegraded":"2024-06-06T02:36:14.757382+0000","last_fullsized":"2024-06-06T02:36:14.757382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770574+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:36:14.770574+0000","last_peered":"2024-06-06T02:36:14.770574+0000","last_clean":"2024-06-06T02:36:14.770574+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:36:14.770574+0000","last_undegraded":"2024-06-06T02:36:14.770574+0000","last_fullsized":"2024-06-06T02:36:14.770574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.749670+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:36:14.749670+0000","last_peered":"2024-06-06T02:36:14.749670+0000","last_clean":"2024-06-06T02:36:14.749670+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:36:14.749670+0000","last_undegraded":"2024-06-06T02:36:14.749670+0000","last_fullsized":"2024-06-06T02:36:14.749670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.750612+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:36:14.750612+0000","last_peered":"2024-06-06T02:36:14.750612+0000","last_clean":"2024-06-06T02:36:14.750612+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:36:14.750612+0000","last_undegraded":"2024-06-06T02:36:14.750612+0000","last_fullsized":"2024-06-06T02:36:14.750612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.741918+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:36:14.741918+0000","last_peered":"2024-06-06T02:36:14.741918+0000","last_clean":"2024-06-06T02:36:14.741918+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:36:14.741918+0000","last_undegraded":"2024-06-06T02:36:14.741918+0000","last_fullsized":"2024-06-06T02:36:14.741918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748548+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:36:14.748548+0000","last_peered":"2024-06-06T02:36:14.748548+0000","last_clean":"2024-06-06T02:36:14.748548+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:36:14.748548+0000","last_undegraded":"2024-06-06T02:36:14.748548+0000","last_fullsized":"2024-06-06T02:36:14.748548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733052+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:36:14.733052+0000","last_peered":"2024-06-06T02:36:14.733052+0000","last_clean":"2024-06-06T02:36:14.733052+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:36:14.733052+0000","last_undegraded":"2024-06-06T02:36:14.733052+0000","last_fullsized":"2024-06-06T02:36:14.733052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.756951+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:36:14.756951+0000","last_peered":"2024-06-06T02:36:14.756951+0000","last_clean":"2024-06-06T02:36:14.756951+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:36:14.756951+0000","last_undegraded":"2024-06-06T02:36:14.756951+0000","last_fullsized":"2024-06-06T02:36:14.756951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768068+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:36:14.768068+0000","last_peered":"2024-06-06T02:36:14.768068+0000","last_clean":"2024-06-06T02:36:14.768068+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:36:14.768068+0000","last_undegraded":"2024-06-06T02:36:14.768068+0000","last_fullsized":"2024-06-06T02:36:14.768068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765237+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:36:14.765237+0000","last_peered":"2024-06-06T02:36:14.765237+0000","last_clean":"2024-06-06T02:36:14.765237+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:36:14.765237+0000","last_undegraded":"2024-06-06T02:36:14.765237+0000","last_fullsized":"2024-06-06T02:36:14.765237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748846+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:36:14.748846+0000","last_peered":"2024-06-06T02:36:14.748846+0000","last_clean":"2024-06-06T02:36:14.748846+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:36:14.748846+0000","last_undegraded":"2024-06-06T02:36:14.748846+0000","last_fullsized":"2024-06-06T02:36:14.748846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768337+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:36:14.768337+0000","last_peered":"2024-06-06T02:36:14.768337+0000","last_clean":"2024-06-06T02:36:14.768337+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:36:14.768337+0000","last_undegraded":"2024-06-06T02:36:14.768337+0000","last_fullsized":"2024-06-06T02:36:14.768337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729331+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:36:14.729331+0000","last_peered":"2024-06-06T02:36:14.729331+0000","last_clean":"2024-06-06T02:36:14.729331+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:36:14.729331+0000","last_undegraded":"2024-06-06T02:36:14.729331+0000","last_fullsized":"2024-06-06T02:36:14.729331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759270+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:36:14.759270+0000","last_peered":"2024-06-06T02:36:14.759270+0000","last_clean":"2024-06-06T02:36:14.759270+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:36:14.759270+0000","last_undegraded":"2024-06-06T02:36:14.759270+0000","last_fullsized":"2024-06-06T02:36:14.759270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:38:00.310584+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:38:00.310584+0000","last_peered":"2024-06-06T02:38:00.310584+0000","last_clean":"2024-06-06T02:38:00.310584+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:38:00.310584+0000","last_undegraded":"2024-06-06T02:38:00.310584+0000","last_fullsized":"2024-06-06T02:38:00.310584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":219,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746362+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:36:14.746362+0000","last_peered":"2024-06-06T02:36:14.746362+0000","last_clean":"2024-06-06T02:36:14.746362+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:36:14.746362+0000","last_undegraded":"2024-06-06T02:36:14.746362+0000","last_fullsized":"2024-06-06T02:36:14.746362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925218+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925218+0000","last_peered":"2024-06-06T02:34:21.925218+0000","last_clean":"2024-06-06T02:34:21.925218+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925218+0000","last_undegraded":"2024-06-06T02:34:21.925218+0000","last_fullsized":"2024-06-06T02:34:21.925218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.926067+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.926067+0000","last_peered":"2024-06-06T02:34:21.926067+0000","last_clean":"2024-06-06T02:34:21.926067+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.926067+0000","last_undegraded":"2024-06-06T02:34:21.926067+0000","last_fullsized":"2024-06-06T02:34:21.926067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769025+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:36:14.769025+0000","last_peered":"2024-06-06T02:36:14.769025+0000","last_clean":"2024-06-06T02:36:14.769025+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:36:14.769025+0000","last_undegraded":"2024-06-06T02:36:14.769025+0000","last_fullsized":"2024-06-06T02:36:14.769025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906263+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:20.906263+0000","last_peered":"2024-06-06T02:34:20.906263+0000","last_clean":"2024-06-06T02:34:20.906263+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:20.906263+0000","last_undegraded":"2024-06-06T02:34:20.906263+0000","last_fullsized":"2024-06-06T02:34:20.906263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759728+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:36:14.759728+0000","last_peered":"2024-06-06T02:36:14.759728+0000","last_clean":"2024-06-06T02:36:14.759728+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:36:14.759728+0000","last_undegraded":"2024-06-06T02:36:14.759728+0000","last_fullsized":"2024-06-06T02:36:14.759728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":245,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:58.306774+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:37:58.306774+0000","last_peered":"2024-06-06T02:37:58.306774+0000","last_clean":"2024-06-06T02:37:58.306774+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:37:58.306774+0000","last_undegraded":"2024-06-06T02:37:58.306774+0000","last_fullsized":"2024-06-06T02:37:58.306774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":215,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753330+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:36:14.753330+0000","last_peered":"2024-06-06T02:36:14.753330+0000","last_clean":"2024-06-06T02:36:14.753330+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:36:14.753330+0000","last_undegraded":"2024-06-06T02:36:14.753330+0000","last_fullsized":"2024-06-06T02:36:14.753330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905669+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905669+0000","last_peered":"2024-06-06T02:34:20.905669+0000","last_clean":"2024-06-06T02:34:20.905669+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905669+0000","last_undegraded":"2024-06-06T02:34:20.905669+0000","last_fullsized":"2024-06-06T02:34:20.905669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.766604+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:36:14.766604+0000","last_peered":"2024-06-06T02:36:14.766604+0000","last_clean":"2024-06-06T02:36:14.766604+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:36:14.766604+0000","last_undegraded":"2024-06-06T02:36:14.766604+0000","last_fullsized":"2024-06-06T02:36:14.766604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.947496+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:24.947496+0000","last_peered":"2024-06-06T02:34:24.947496+0000","last_clean":"2024-06-06T02:34:24.947496+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:24.947496+0000","last_undegraded":"2024-06-06T02:34:24.947496+0000","last_fullsized":"2024-06-06T02:34:24.947496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.732777+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:36:14.732777+0000","last_peered":"2024-06-06T02:36:14.732777+0000","last_clean":"2024-06-06T02:36:14.732777+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:36:14.732777+0000","last_undegraded":"2024-06-06T02:36:14.732777+0000","last_fullsized":"2024-06-06T02:36:14.732777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'38","reported_seq":527,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.459748+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:37:59.459748+0000","last_peered":"2024-06-06T02:37:59.459748+0000","last_clean":"2024-06-06T02:37:59.459748+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:37:59.459748+0000","last_undegraded":"2024-06-06T02:37:59.459748+0000","last_fullsized":"2024-06-06T02:37:59.459748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73049,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":294,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.721075+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:36:14.721075+0000","last_peered":"2024-06-06T02:36:14.721075+0000","last_clean":"2024-06-06T02:36:14.721075+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:36:14.721075+0000","last_undegraded":"2024-06-06T02:36:14.721075+0000","last_fullsized":"2024-06-06T02:36:14.721075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944283+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:24.944283+0000","last_peered":"2024-06-06T02:34:24.944283+0000","last_clean":"2024-06-06T02:34:24.944283+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:24.944283+0000","last_undegraded":"2024-06-06T02:34:24.944283+0000","last_fullsized":"2024-06-06T02:34:24.944283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769779+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:36:14.769779+0000","last_peered":"2024-06-06T02:36:14.769779+0000","last_clean":"2024-06-06T02:36:14.769779+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:36:14.769779+0000","last_undegraded":"2024-06-06T02:36:14.769779+0000","last_fullsized":"2024-06-06T02:36:14.769779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911833+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911833+0000","last_peered":"2024-06-06T02:34:20.911833+0000","last_clean":"2024-06-06T02:34:20.911833+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911833+0000","last_undegraded":"2024-06-06T02:34:20.911833+0000","last_fullsized":"2024-06-06T02:34:20.911833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764292+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:36:14.764292+0000","last_peered":"2024-06-06T02:36:14.764292+0000","last_clean":"2024-06-06T02:36:14.764292+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:36:14.764292+0000","last_undegraded":"2024-06-06T02:36:14.764292+0000","last_fullsized":"2024-06-06T02:36:14.764292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:57.437112+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:37:57.437112+0000","last_peered":"2024-06-06T02:37:57.437112+0000","last_clean":"2024-06-06T02:37:57.437112+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:37:57.437112+0000","last_undegraded":"2024-06-06T02:37:57.437112+0000","last_fullsized":"2024-06-06T02:37:57.437112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.704921+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:36:14.704921+0000","last_peered":"2024-06-06T02:36:14.704921+0000","last_clean":"2024-06-06T02:36:14.704921+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:36:14.704921+0000","last_undegraded":"2024-06-06T02:36:14.704921+0000","last_fullsized":"2024-06-06T02:36:14.704921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945265+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:24.945265+0000","last_peered":"2024-06-06T02:34:24.945265+0000","last_clean":"2024-06-06T02:34:24.945265+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:24.945265+0000","last_undegraded":"2024-06-06T02:34:24.945265+0000","last_fullsized":"2024-06-06T02:34:24.945265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730992+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:36:14.730992+0000","last_peered":"2024-06-06T02:36:14.730992+0000","last_clean":"2024-06-06T02:36:14.730992+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:36:14.730992+0000","last_undegraded":"2024-06-06T02:36:14.730992+0000","last_fullsized":"2024-06-06T02:36:14.730992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944016+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:24.944016+0000","last_peered":"2024-06-06T02:34:24.944016+0000","last_clean":"2024-06-06T02:34:24.944016+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:24.944016+0000","last_undegraded":"2024-06-06T02:34:24.944016+0000","last_fullsized":"2024-06-06T02:34:24.944016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725464+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:36:14.725464+0000","last_peered":"2024-06-06T02:36:14.725464+0000","last_clean":"2024-06-06T02:36:14.725464+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:36:14.725464+0000","last_undegraded":"2024-06-06T02:36:14.725464+0000","last_fullsized":"2024-06-06T02:36:14.725464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841147+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.841147+0000","last_peered":"2024-06-06T02:34:15.841147+0000","last_clean":"2024-06-06T02:34:15.841147+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.841147+0000","last_undegraded":"2024-06-06T02:34:15.841147+0000","last_fullsized":"2024-06-06T02:34:15.841147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.724592+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:36:14.724592+0000","last_peered":"2024-06-06T02:36:14.724592+0000","last_clean":"2024-06-06T02:36:14.724592+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:36:14.724592+0000","last_undegraded":"2024-06-06T02:36:14.724592+0000","last_fullsized":"2024-06-06T02:36:14.724592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944251+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:24.944251+0000","last_peered":"2024-06-06T02:34:24.944251+0000","last_clean":"2024-06-06T02:34:24.944251+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944251+0000","last_undegraded":"2024-06-06T02:34:24.944251+0000","last_fullsized":"2024-06-06T02:34:24.944251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752315+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:36:14.752315+0000","last_peered":"2024-06-06T02:36:14.752315+0000","last_clean":"2024-06-06T02:36:14.752315+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:36:14.752315+0000","last_undegraded":"2024-06-06T02:36:14.752315+0000","last_fullsized":"2024-06-06T02:36:14.752315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948916+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:24.948916+0000","last_peered":"2024-06-06T02:34:24.948916+0000","last_clean":"2024-06-06T02:34:24.948916+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:24.948916+0000","last_undegraded":"2024-06-06T02:34:24.948916+0000","last_fullsized":"2024-06-06T02:34:24.948916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731854+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:36:14.731854+0000","last_peered":"2024-06-06T02:36:14.731854+0000","last_clean":"2024-06-06T02:36:14.731854+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:36:14.731854+0000","last_undegraded":"2024-06-06T02:36:14.731854+0000","last_fullsized":"2024-06-06T02:36:14.731854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:11.366061+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:35:11.366061+0000","last_peered":"2024-06-06T02:35:11.366061+0000","last_clean":"2024-06-06T02:35:11.366061+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:35:11.366061+0000","last_undegraded":"2024-06-06T02:35:11.366061+0000","last_fullsized":"2024-06-06T02:35:11.366061+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945512+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945512+0000","last_peered":"2024-06-06T02:34:24.945512+0000","last_clean":"2024-06-06T02:34:24.945512+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945512+0000","last_undegraded":"2024-06-06T02:34:24.945512+0000","last_fullsized":"2024-06-06T02:34:24.945512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746789+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:36:14.746789+0000","last_peered":"2024-06-06T02:36:14.746789+0000","last_clean":"2024-06-06T02:36:14.746789+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:36:14.746789+0000","last_undegraded":"2024-06-06T02:36:14.746789+0000","last_fullsized":"2024-06-06T02:36:14.746789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:56.371461+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:35:56.371461+0000","last_peered":"2024-06-06T02:35:56.371461+0000","last_clean":"2024-06-06T02:35:56.371461+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:35:56.371461+0000","last_undegraded":"2024-06-06T02:35:56.371461+0000","last_fullsized":"2024-06-06T02:35:56.371461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763060+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:36:14.763060+0000","last_peered":"2024-06-06T02:36:14.763060+0000","last_clean":"2024-06-06T02:36:14.763060+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:36:14.763060+0000","last_undegraded":"2024-06-06T02:36:14.763060+0000","last_fullsized":"2024-06-06T02:36:14.763060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.440906+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:37:59.440906+0000","last_peered":"2024-06-06T02:37:59.440906+0000","last_clean":"2024-06-06T02:37:59.440906+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:37:59.440906+0000","last_undegraded":"2024-06-06T02:37:59.440906+0000","last_fullsized":"2024-06-06T02:37:59.440906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725995+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:36:14.725995+0000","last_peered":"2024-06-06T02:36:14.725995+0000","last_clean":"2024-06-06T02:36:14.725995+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:36:14.725995+0000","last_undegraded":"2024-06-06T02:36:14.725995+0000","last_fullsized":"2024-06-06T02:36:14.725995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924916+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:21.924916+0000","last_peered":"2024-06-06T02:34:21.924916+0000","last_clean":"2024-06-06T02:34:21.924916+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:21.924916+0000","last_undegraded":"2024-06-06T02:34:21.924916+0000","last_fullsized":"2024-06-06T02:34:21.924916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761273+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:36:14.761273+0000","last_peered":"2024-06-06T02:36:14.761273+0000","last_clean":"2024-06-06T02:36:14.761273+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:36:14.761273+0000","last_undegraded":"2024-06-06T02:36:14.761273+0000","last_fullsized":"2024-06-06T02:36:14.761273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855684+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855684+0000","last_peered":"2024-06-06T02:34:15.855684+0000","last_clean":"2024-06-06T02:34:15.855684+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855684+0000","last_undegraded":"2024-06-06T02:34:15.855684+0000","last_fullsized":"2024-06-06T02:34:15.855684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763995+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:36:14.763995+0000","last_peered":"2024-06-06T02:36:14.763995+0000","last_clean":"2024-06-06T02:36:14.763995+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:36:14.763995+0000","last_undegraded":"2024-06-06T02:36:14.763995+0000","last_fullsized":"2024-06-06T02:36:14.763995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945270+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:24.945270+0000","last_peered":"2024-06-06T02:34:24.945270+0000","last_clean":"2024-06-06T02:34:24.945270+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:24.945270+0000","last_undegraded":"2024-06-06T02:34:24.945270+0000","last_fullsized":"2024-06-06T02:34:24.945270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767660+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:36:14.767660+0000","last_peered":"2024-06-06T02:36:14.767660+0000","last_clean":"2024-06-06T02:36:14.767660+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:36:14.767660+0000","last_undegraded":"2024-06-06T02:36:14.767660+0000","last_fullsized":"2024-06-06T02:36:14.767660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:55.676087+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:37:55.676087+0000","last_peered":"2024-06-06T02:37:55.676087+0000","last_clean":"2024-06-06T02:37:55.676087+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:37:55.676087+0000","last_undegraded":"2024-06-06T02:37:55.676087+0000","last_fullsized":"2024-06-06T02:37:55.676087+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752248+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:36:14.752248+0000","last_peered":"2024-06-06T02:36:14.752248+0000","last_clean":"2024-06-06T02:36:14.752248+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:36:14.752248+0000","last_undegraded":"2024-06-06T02:36:14.752248+0000","last_fullsized":"2024-06-06T02:36:14.752248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.909733+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.909733+0000","last_peered":"2024-06-06T02:34:20.909733+0000","last_clean":"2024-06-06T02:34:20.909733+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.909733+0000","last_undegraded":"2024-06-06T02:34:20.909733+0000","last_fullsized":"2024-06-06T02:34:20.909733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760152+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:36:14.760152+0000","last_peered":"2024-06-06T02:36:14.760152+0000","last_clean":"2024-06-06T02:36:14.760152+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:36:14.760152+0000","last_undegraded":"2024-06-06T02:36:14.760152+0000","last_fullsized":"2024-06-06T02:36:14.760152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.912238+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.912238+0000","last_peered":"2024-06-06T02:34:20.912238+0000","last_clean":"2024-06-06T02:34:20.912238+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.912238+0000","last_undegraded":"2024-06-06T02:34:20.912238+0000","last_fullsized":"2024-06-06T02:34:20.912238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.685646+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:36:14.685646+0000","last_peered":"2024-06-06T02:36:14.685646+0000","last_clean":"2024-06-06T02:36:14.685646+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:36:14.685646+0000","last_undegraded":"2024-06-06T02:36:14.685646+0000","last_fullsized":"2024-06-06T02:36:14.685646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.914245+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.914245+0000","last_peered":"2024-06-06T02:34:20.914245+0000","last_clean":"2024-06-06T02:34:20.914245+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.914245+0000","last_undegraded":"2024-06-06T02:34:20.914245+0000","last_fullsized":"2024-06-06T02:34:20.914245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760442+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:36:14.760442+0000","last_peered":"2024-06-06T02:36:14.760442+0000","last_clean":"2024-06-06T02:36:14.760442+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:36:14.760442+0000","last_undegraded":"2024-06-06T02:36:14.760442+0000","last_fullsized":"2024-06-06T02:36:14.760442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.901156+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:21.901156+0000","last_peered":"2024-06-06T02:34:21.901156+0000","last_clean":"2024-06-06T02:34:21.901156+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:21.901156+0000","last_undegraded":"2024-06-06T02:34:21.901156+0000","last_fullsized":"2024-06-06T02:34:21.901156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763061+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:36:14.763061+0000","last_peered":"2024-06-06T02:36:14.763061+0000","last_clean":"2024-06-06T02:36:14.763061+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:36:14.763061+0000","last_undegraded":"2024-06-06T02:36:14.763061+0000","last_fullsized":"2024-06-06T02:36:14.763061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944083+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:24.944083+0000","last_peered":"2024-06-06T02:34:24.944083+0000","last_clean":"2024-06-06T02:34:24.944083+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944083+0000","last_undegraded":"2024-06-06T02:34:24.944083+0000","last_fullsized":"2024-06-06T02:34:24.944083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763467+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:36:14.763467+0000","last_peered":"2024-06-06T02:36:14.763467+0000","last_clean":"2024-06-06T02:36:14.763467+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:36:14.763467+0000","last_undegraded":"2024-06-06T02:36:14.763467+0000","last_fullsized":"2024-06-06T02:36:14.763467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731984+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:36:14.731984+0000","last_peered":"2024-06-06T02:36:14.731984+0000","last_clean":"2024-06-06T02:36:14.731984+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:36:14.731984+0000","last_undegraded":"2024-06-06T02:36:14.731984+0000","last_fullsized":"2024-06-06T02:36:14.731984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847090+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.847090+0000","last_peered":"2024-06-06T02:34:15.847090+0000","last_clean":"2024-06-06T02:34:15.847090+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.847090+0000","last_undegraded":"2024-06-06T02:34:15.847090+0000","last_fullsized":"2024-06-06T02:34:15.847090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767647+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:36:14.767647+0000","last_peered":"2024-06-06T02:36:14.767647+0000","last_clean":"2024-06-06T02:36:14.767647+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:36:14.767647+0000","last_undegraded":"2024-06-06T02:36:14.767647+0000","last_fullsized":"2024-06-06T02:36:14.767647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.917042+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.917042+0000","last_peered":"2024-06-06T02:34:21.917042+0000","last_clean":"2024-06-06T02:34:21.917042+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.917042+0000","last_undegraded":"2024-06-06T02:34:21.917042+0000","last_fullsized":"2024-06-06T02:34:21.917042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767683+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:36:14.767683+0000","last_peered":"2024-06-06T02:36:14.767683+0000","last_clean":"2024-06-06T02:36:14.767683+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:36:14.767683+0000","last_undegraded":"2024-06-06T02:36:14.767683+0000","last_fullsized":"2024-06-06T02:36:14.767683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:58.879625+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:35:58.879625+0000","last_peered":"2024-06-06T02:35:58.879625+0000","last_clean":"2024-06-06T02:35:58.879625+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:35:58.879625+0000","last_undegraded":"2024-06-06T02:35:58.879625+0000","last_fullsized":"2024-06-06T02:35:58.879625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.745961+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:36:14.745961+0000","last_peered":"2024-06-06T02:36:14.745961+0000","last_clean":"2024-06-06T02:36:14.745961+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:36:14.745961+0000","last_undegraded":"2024-06-06T02:36:14.745961+0000","last_fullsized":"2024-06-06T02:36:14.745961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948074+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:24.948074+0000","last_peered":"2024-06-06T02:34:24.948074+0000","last_clean":"2024-06-06T02:34:24.948074+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:24.948074+0000","last_undegraded":"2024-06-06T02:34:24.948074+0000","last_fullsized":"2024-06-06T02:34:24.948074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77050,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1327,"num_read_kb":744,"num_write":181,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":231150,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710783,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1090130,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070538,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266768,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1017295,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986277,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":950272,"data_stored":498711,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411442,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":497676,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":73049,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":74084,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":75018,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:38:03.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T02:38:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 -- 172.21.15.82:0/2670636049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 msgr2=0x7f013410ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 --2- 172.21.15.82:0/2670636049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f013410ad20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f012c009ca0 tx=0x7f012c02a8b0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 -- 172.21.15.82:0/2670636049 shutdown_connections 2024-06-06T02:38:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 --2- 172.21.15.82:0/2670636049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f013410ad20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 --2- 172.21.15.82:0/2670636049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f0134103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 --2- 172.21.15.82:0/2670636049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f0134102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 -- 172.21.15.82:0/2670636049 >> 172.21.15.82:0/2670636049 conn(0x7f01340fe1d0 msgr2=0x7f0134100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.841+0000 7f0138c00640 1 -- 172.21.15.82:0/2670636049 shutdown_connections 2024-06-06T02:38:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.842+0000 7f0138c00640 1 -- 172.21.15.82:0/2670636049 wait complete. 2024-06-06T02:38:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 Processor -- start 2024-06-06T02:38:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 -- start start 2024-06-06T02:38:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f013419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f01341a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f013410e4c0 con 0x7f01341029b0 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f013410e340 con 0x7f0134104420 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.843+0000 7f0138c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f013410e640 con 0x7f0134103ad0 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45140/0 (socket says 172.21.15.82:45140) 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 -- 172.21.15.82:0/484199522 learned_addr learned my addr 172.21.15.82:0/484199522 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f012be00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f013419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133e00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f01341a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 -- 172.21.15.82:0/484199522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 msgr2=0x7f013419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f013419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 -- 172.21.15.82:0/484199522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 msgr2=0x7f01341a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f01341a2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133400640 1 -- 172.21.15.82:0/484199522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01341a2dc0 con 0x7f01341029b0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f0133e00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f01341a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.844+0000 7f012be00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f013419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0133400640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f012400e9c0 tx=0x7f012400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012400cd80 con 0x7f01341029b0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01341a30b0 con 0x7f01341029b0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01240054d0 con 0x7f01341029b0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01341a3650 con 0x7f01341029b0 2024-06-06T02:38:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.845+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124021440 con 0x7f01341029b0 2024-06-06T02:38:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.846+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01341a3970 con 0x7f01341029b0 2024-06-06T02:38:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.849+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f0124004f70 con 0x7f01341029b0 2024-06-06T02:38:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.851+0000 7f0130c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 0x7f01180b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:03.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.851+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f01240e2ca0 con 0x7f01341029b0 2024-06-06T02:38:03.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.851+0000 7f012be00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 0x7f01180b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:03.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.852+0000 7f012be00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 0x7f01180b4d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f013419c320 tx=0x7f011c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:03.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:03.852+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f01240aa820 con 0x7f01341029b0 2024-06-06T02:38:04.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.057+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01340760b0 con 0x7f01180b2870 2024-06-06T02:38:04.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.070+0000 7f0130c00640 1 -- 172.21.15.82:0/484199522 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259124 (secure 0 0 0) 0x7f01340760b0 con 0x7f01180b2870 2024-06-06T02:38:04.074 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:04.076 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:38:04.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 msgr2=0x7f01180b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 0x7f01180b4d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f013419c320 tx=0x7f011c005f90 comp rx=0 tx=0).stop 2024-06-06T02:38:04.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 msgr2=0x7f013419b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f012400e9c0 tx=0x7f012400ee80 comp rx=0 tx=0).stop 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 shutdown_connections 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0134104420 0x7f01341a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f01180b2870 0x7f01180b4d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.075+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0134103ad0 0x7f013419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.076+0000 7f0138c00640 1 --2- 172.21.15.82:0/484199522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01341029b0 0x7f013419b280 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.076+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 >> 172.21.15.82:0/484199522 conn(0x7f01340fe1d0 msgr2=0x7f0134074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.076+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 shutdown_connections 2024-06-06T02:38:04.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.076+0000 7f0138c00640 1 -- 172.21.15.82:0/484199522 wait complete. 2024-06-06T02:38:04.103 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-06-06T02:38:02.869199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667652,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1403,"num_read_kb":808,"num_write":306,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359832,"kb_used_data":10680,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581992,"statfs":{"total":1151940427776,"available":1151571959808,"internally_reserved":0,"allocated":10936320,"data_stored":7098480,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8981,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":45,"num_write":10,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005575"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763442+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:36:14.763442+0000","last_peered":"2024-06-06T02:36:14.763442+0000","last_clean":"2024-06-06T02:36:14.763442+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:36:14.763442+0000","last_undegraded":"2024-06-06T02:36:14.763442+0000","last_fullsized":"2024-06-06T02:36:14.763442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759693+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:36:14.759693+0000","last_peered":"2024-06-06T02:36:14.759693+0000","last_clean":"2024-06-06T02:36:14.759693+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:36:14.759693+0000","last_undegraded":"2024-06-06T02:36:14.759693+0000","last_fullsized":"2024-06-06T02:36:14.759693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761379+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:36:14.761379+0000","last_peered":"2024-06-06T02:36:14.761379+0000","last_clean":"2024-06-06T02:36:14.761379+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:36:14.761379+0000","last_undegraded":"2024-06-06T02:36:14.761379+0000","last_fullsized":"2024-06-06T02:36:14.761379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.726838+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:36:14.726838+0000","last_peered":"2024-06-06T02:36:14.726838+0000","last_clean":"2024-06-06T02:36:14.726838+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:36:14.726838+0000","last_undegraded":"2024-06-06T02:36:14.726838+0000","last_fullsized":"2024-06-06T02:36:14.726838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758155+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:36:14.758155+0000","last_peered":"2024-06-06T02:36:14.758155+0000","last_clean":"2024-06-06T02:36:14.758155+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:36:14.758155+0000","last_undegraded":"2024-06-06T02:36:14.758155+0000","last_fullsized":"2024-06-06T02:36:14.758155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759514+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:36:14.759514+0000","last_peered":"2024-06-06T02:36:14.759514+0000","last_clean":"2024-06-06T02:36:14.759514+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:36:14.759514+0000","last_undegraded":"2024-06-06T02:36:14.759514+0000","last_fullsized":"2024-06-06T02:36:14.759514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753425+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:36:14.753425+0000","last_peered":"2024-06-06T02:36:14.753425+0000","last_clean":"2024-06-06T02:36:14.753425+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:36:14.753425+0000","last_undegraded":"2024-06-06T02:36:14.753425+0000","last_fullsized":"2024-06-06T02:36:14.753425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758966+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:36:14.758966+0000","last_peered":"2024-06-06T02:36:14.758966+0000","last_clean":"2024-06-06T02:36:14.758966+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:36:14.758966+0000","last_undegraded":"2024-06-06T02:36:14.758966+0000","last_fullsized":"2024-06-06T02:36:14.758966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729985+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:36:14.729985+0000","last_peered":"2024-06-06T02:36:14.729985+0000","last_clean":"2024-06-06T02:36:14.729985+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:36:14.729985+0000","last_undegraded":"2024-06-06T02:36:14.729985+0000","last_fullsized":"2024-06-06T02:36:14.729985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733844+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:36:14.733844+0000","last_peered":"2024-06-06T02:36:14.733844+0000","last_clean":"2024-06-06T02:36:14.733844+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:36:14.733844+0000","last_undegraded":"2024-06-06T02:36:14.733844+0000","last_fullsized":"2024-06-06T02:36:14.733844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731157+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:36:14.731157+0000","last_peered":"2024-06-06T02:36:14.731157+0000","last_clean":"2024-06-06T02:36:14.731157+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:36:14.731157+0000","last_undegraded":"2024-06-06T02:36:14.731157+0000","last_fullsized":"2024-06-06T02:36:14.731157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729515+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:36:14.729515+0000","last_peered":"2024-06-06T02:36:14.729515+0000","last_clean":"2024-06-06T02:36:14.729515+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:36:14.729515+0000","last_undegraded":"2024-06-06T02:36:14.729515+0000","last_fullsized":"2024-06-06T02:36:14.729515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770754+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:36:14.770754+0000","last_peered":"2024-06-06T02:36:14.770754+0000","last_clean":"2024-06-06T02:36:14.770754+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:36:14.770754+0000","last_undegraded":"2024-06-06T02:36:14.770754+0000","last_fullsized":"2024-06-06T02:36:14.770754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764529+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:36:14.764529+0000","last_peered":"2024-06-06T02:36:14.764529+0000","last_clean":"2024-06-06T02:36:14.764529+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:36:14.764529+0000","last_undegraded":"2024-06-06T02:36:14.764529+0000","last_fullsized":"2024-06-06T02:36:14.764529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760237+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:36:14.760237+0000","last_peered":"2024-06-06T02:36:14.760237+0000","last_clean":"2024-06-06T02:36:14.760237+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:36:14.760237+0000","last_undegraded":"2024-06-06T02:36:14.760237+0000","last_fullsized":"2024-06-06T02:36:14.760237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760967+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:36:14.760967+0000","last_peered":"2024-06-06T02:36:14.760967+0000","last_clean":"2024-06-06T02:36:14.760967+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:36:14.760967+0000","last_undegraded":"2024-06-06T02:36:14.760967+0000","last_fullsized":"2024-06-06T02:36:14.760967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763688+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:36:14.763688+0000","last_peered":"2024-06-06T02:36:14.763688+0000","last_clean":"2024-06-06T02:36:14.763688+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:36:14.763688+0000","last_undegraded":"2024-06-06T02:36:14.763688+0000","last_fullsized":"2024-06-06T02:36:14.763688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758949+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:36:14.758949+0000","last_peered":"2024-06-06T02:36:14.758949+0000","last_clean":"2024-06-06T02:36:14.758949+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:36:14.758949+0000","last_undegraded":"2024-06-06T02:36:14.758949+0000","last_fullsized":"2024-06-06T02:36:14.758949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768309+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:36:14.768309+0000","last_peered":"2024-06-06T02:36:14.768309+0000","last_clean":"2024-06-06T02:36:14.768309+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:36:14.768309+0000","last_undegraded":"2024-06-06T02:36:14.768309+0000","last_fullsized":"2024-06-06T02:36:14.768309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.757382+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:36:14.757382+0000","last_peered":"2024-06-06T02:36:14.757382+0000","last_clean":"2024-06-06T02:36:14.757382+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:36:14.757382+0000","last_undegraded":"2024-06-06T02:36:14.757382+0000","last_fullsized":"2024-06-06T02:36:14.757382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770574+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:36:14.770574+0000","last_peered":"2024-06-06T02:36:14.770574+0000","last_clean":"2024-06-06T02:36:14.770574+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:36:14.770574+0000","last_undegraded":"2024-06-06T02:36:14.770574+0000","last_fullsized":"2024-06-06T02:36:14.770574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.749670+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:36:14.749670+0000","last_peered":"2024-06-06T02:36:14.749670+0000","last_clean":"2024-06-06T02:36:14.749670+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:36:14.749670+0000","last_undegraded":"2024-06-06T02:36:14.749670+0000","last_fullsized":"2024-06-06T02:36:14.749670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.750612+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:36:14.750612+0000","last_peered":"2024-06-06T02:36:14.750612+0000","last_clean":"2024-06-06T02:36:14.750612+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:36:14.750612+0000","last_undegraded":"2024-06-06T02:36:14.750612+0000","last_fullsized":"2024-06-06T02:36:14.750612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.741918+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:36:14.741918+0000","last_peered":"2024-06-06T02:36:14.741918+0000","last_clean":"2024-06-06T02:36:14.741918+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:36:14.741918+0000","last_undegraded":"2024-06-06T02:36:14.741918+0000","last_fullsized":"2024-06-06T02:36:14.741918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748548+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:36:14.748548+0000","last_peered":"2024-06-06T02:36:14.748548+0000","last_clean":"2024-06-06T02:36:14.748548+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:36:14.748548+0000","last_undegraded":"2024-06-06T02:36:14.748548+0000","last_fullsized":"2024-06-06T02:36:14.748548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733052+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:36:14.733052+0000","last_peered":"2024-06-06T02:36:14.733052+0000","last_clean":"2024-06-06T02:36:14.733052+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:36:14.733052+0000","last_undegraded":"2024-06-06T02:36:14.733052+0000","last_fullsized":"2024-06-06T02:36:14.733052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.756951+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:36:14.756951+0000","last_peered":"2024-06-06T02:36:14.756951+0000","last_clean":"2024-06-06T02:36:14.756951+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:36:14.756951+0000","last_undegraded":"2024-06-06T02:36:14.756951+0000","last_fullsized":"2024-06-06T02:36:14.756951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768068+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:36:14.768068+0000","last_peered":"2024-06-06T02:36:14.768068+0000","last_clean":"2024-06-06T02:36:14.768068+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:36:14.768068+0000","last_undegraded":"2024-06-06T02:36:14.768068+0000","last_fullsized":"2024-06-06T02:36:14.768068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765237+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:36:14.765237+0000","last_peered":"2024-06-06T02:36:14.765237+0000","last_clean":"2024-06-06T02:36:14.765237+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:36:14.765237+0000","last_undegraded":"2024-06-06T02:36:14.765237+0000","last_fullsized":"2024-06-06T02:36:14.765237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748846+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:36:14.748846+0000","last_peered":"2024-06-06T02:36:14.748846+0000","last_clean":"2024-06-06T02:36:14.748846+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:36:14.748846+0000","last_undegraded":"2024-06-06T02:36:14.748846+0000","last_fullsized":"2024-06-06T02:36:14.748846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768337+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:36:14.768337+0000","last_peered":"2024-06-06T02:36:14.768337+0000","last_clean":"2024-06-06T02:36:14.768337+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:36:14.768337+0000","last_undegraded":"2024-06-06T02:36:14.768337+0000","last_fullsized":"2024-06-06T02:36:14.768337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729331+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:36:14.729331+0000","last_peered":"2024-06-06T02:36:14.729331+0000","last_clean":"2024-06-06T02:36:14.729331+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:36:14.729331+0000","last_undegraded":"2024-06-06T02:36:14.729331+0000","last_fullsized":"2024-06-06T02:36:14.729331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759270+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:36:14.759270+0000","last_peered":"2024-06-06T02:36:14.759270+0000","last_clean":"2024-06-06T02:36:14.759270+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:36:14.759270+0000","last_undegraded":"2024-06-06T02:36:14.759270+0000","last_fullsized":"2024-06-06T02:36:14.759270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:38:00.310584+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:38:00.310584+0000","last_peered":"2024-06-06T02:38:00.310584+0000","last_clean":"2024-06-06T02:38:00.310584+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:38:00.310584+0000","last_undegraded":"2024-06-06T02:38:00.310584+0000","last_fullsized":"2024-06-06T02:38:00.310584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":219,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746362+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:36:14.746362+0000","last_peered":"2024-06-06T02:36:14.746362+0000","last_clean":"2024-06-06T02:36:14.746362+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:36:14.746362+0000","last_undegraded":"2024-06-06T02:36:14.746362+0000","last_fullsized":"2024-06-06T02:36:14.746362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925218+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925218+0000","last_peered":"2024-06-06T02:34:21.925218+0000","last_clean":"2024-06-06T02:34:21.925218+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925218+0000","last_undegraded":"2024-06-06T02:34:21.925218+0000","last_fullsized":"2024-06-06T02:34:21.925218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.926067+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.926067+0000","last_peered":"2024-06-06T02:34:21.926067+0000","last_clean":"2024-06-06T02:34:21.926067+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.926067+0000","last_undegraded":"2024-06-06T02:34:21.926067+0000","last_fullsized":"2024-06-06T02:34:21.926067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769025+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:36:14.769025+0000","last_peered":"2024-06-06T02:36:14.769025+0000","last_clean":"2024-06-06T02:36:14.769025+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:36:14.769025+0000","last_undegraded":"2024-06-06T02:36:14.769025+0000","last_fullsized":"2024-06-06T02:36:14.769025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906263+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:20.906263+0000","last_peered":"2024-06-06T02:34:20.906263+0000","last_clean":"2024-06-06T02:34:20.906263+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:20.906263+0000","last_undegraded":"2024-06-06T02:34:20.906263+0000","last_fullsized":"2024-06-06T02:34:20.906263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759728+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:36:14.759728+0000","last_peered":"2024-06-06T02:36:14.759728+0000","last_clean":"2024-06-06T02:36:14.759728+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:36:14.759728+0000","last_undegraded":"2024-06-06T02:36:14.759728+0000","last_fullsized":"2024-06-06T02:36:14.759728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":245,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:58.306774+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:37:58.306774+0000","last_peered":"2024-06-06T02:37:58.306774+0000","last_clean":"2024-06-06T02:37:58.306774+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:37:58.306774+0000","last_undegraded":"2024-06-06T02:37:58.306774+0000","last_fullsized":"2024-06-06T02:37:58.306774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":215,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753330+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:36:14.753330+0000","last_peered":"2024-06-06T02:36:14.753330+0000","last_clean":"2024-06-06T02:36:14.753330+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:36:14.753330+0000","last_undegraded":"2024-06-06T02:36:14.753330+0000","last_fullsized":"2024-06-06T02:36:14.753330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905669+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905669+0000","last_peered":"2024-06-06T02:34:20.905669+0000","last_clean":"2024-06-06T02:34:20.905669+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905669+0000","last_undegraded":"2024-06-06T02:34:20.905669+0000","last_fullsized":"2024-06-06T02:34:20.905669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.766604+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:36:14.766604+0000","last_peered":"2024-06-06T02:36:14.766604+0000","last_clean":"2024-06-06T02:36:14.766604+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:36:14.766604+0000","last_undegraded":"2024-06-06T02:36:14.766604+0000","last_fullsized":"2024-06-06T02:36:14.766604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.947496+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:24.947496+0000","last_peered":"2024-06-06T02:34:24.947496+0000","last_clean":"2024-06-06T02:34:24.947496+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:24.947496+0000","last_undegraded":"2024-06-06T02:34:24.947496+0000","last_fullsized":"2024-06-06T02:34:24.947496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.732777+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:36:14.732777+0000","last_peered":"2024-06-06T02:36:14.732777+0000","last_clean":"2024-06-06T02:36:14.732777+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:36:14.732777+0000","last_undegraded":"2024-06-06T02:36:14.732777+0000","last_fullsized":"2024-06-06T02:36:14.732777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'38","reported_seq":527,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.459748+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:37:59.459748+0000","last_peered":"2024-06-06T02:37:59.459748+0000","last_clean":"2024-06-06T02:37:59.459748+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:37:59.459748+0000","last_undegraded":"2024-06-06T02:37:59.459748+0000","last_fullsized":"2024-06-06T02:37:59.459748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73049,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":294,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.721075+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:36:14.721075+0000","last_peered":"2024-06-06T02:36:14.721075+0000","last_clean":"2024-06-06T02:36:14.721075+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:36:14.721075+0000","last_undegraded":"2024-06-06T02:36:14.721075+0000","last_fullsized":"2024-06-06T02:36:14.721075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944283+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:24.944283+0000","last_peered":"2024-06-06T02:34:24.944283+0000","last_clean":"2024-06-06T02:34:24.944283+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:24.944283+0000","last_undegraded":"2024-06-06T02:34:24.944283+0000","last_fullsized":"2024-06-06T02:34:24.944283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769779+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:36:14.769779+0000","last_peered":"2024-06-06T02:36:14.769779+0000","last_clean":"2024-06-06T02:36:14.769779+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:36:14.769779+0000","last_undegraded":"2024-06-06T02:36:14.769779+0000","last_fullsized":"2024-06-06T02:36:14.769779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911833+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911833+0000","last_peered":"2024-06-06T02:34:20.911833+0000","last_clean":"2024-06-06T02:34:20.911833+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911833+0000","last_undegraded":"2024-06-06T02:34:20.911833+0000","last_fullsized":"2024-06-06T02:34:20.911833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764292+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:36:14.764292+0000","last_peered":"2024-06-06T02:36:14.764292+0000","last_clean":"2024-06-06T02:36:14.764292+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:36:14.764292+0000","last_undegraded":"2024-06-06T02:36:14.764292+0000","last_fullsized":"2024-06-06T02:36:14.764292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:57.437112+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:37:57.437112+0000","last_peered":"2024-06-06T02:37:57.437112+0000","last_clean":"2024-06-06T02:37:57.437112+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:37:57.437112+0000","last_undegraded":"2024-06-06T02:37:57.437112+0000","last_fullsized":"2024-06-06T02:37:57.437112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.704921+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:36:14.704921+0000","last_peered":"2024-06-06T02:36:14.704921+0000","last_clean":"2024-06-06T02:36:14.704921+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:36:14.704921+0000","last_undegraded":"2024-06-06T02:36:14.704921+0000","last_fullsized":"2024-06-06T02:36:14.704921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945265+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:24.945265+0000","last_peered":"2024-06-06T02:34:24.945265+0000","last_clean":"2024-06-06T02:34:24.945265+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:24.945265+0000","last_undegraded":"2024-06-06T02:34:24.945265+0000","last_fullsized":"2024-06-06T02:34:24.945265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730992+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:36:14.730992+0000","last_peered":"2024-06-06T02:36:14.730992+0000","last_clean":"2024-06-06T02:36:14.730992+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:36:14.730992+0000","last_undegraded":"2024-06-06T02:36:14.730992+0000","last_fullsized":"2024-06-06T02:36:14.730992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944016+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:24.944016+0000","last_peered":"2024-06-06T02:34:24.944016+0000","last_clean":"2024-06-06T02:34:24.944016+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:24.944016+0000","last_undegraded":"2024-06-06T02:34:24.944016+0000","last_fullsized":"2024-06-06T02:34:24.944016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725464+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:36:14.725464+0000","last_peered":"2024-06-06T02:36:14.725464+0000","last_clean":"2024-06-06T02:36:14.725464+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:36:14.725464+0000","last_undegraded":"2024-06-06T02:36:14.725464+0000","last_fullsized":"2024-06-06T02:36:14.725464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841147+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.841147+0000","last_peered":"2024-06-06T02:34:15.841147+0000","last_clean":"2024-06-06T02:34:15.841147+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.841147+0000","last_undegraded":"2024-06-06T02:34:15.841147+0000","last_fullsized":"2024-06-06T02:34:15.841147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.724592+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:36:14.724592+0000","last_peered":"2024-06-06T02:36:14.724592+0000","last_clean":"2024-06-06T02:36:14.724592+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:36:14.724592+0000","last_undegraded":"2024-06-06T02:36:14.724592+0000","last_fullsized":"2024-06-06T02:36:14.724592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944251+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:24.944251+0000","last_peered":"2024-06-06T02:34:24.944251+0000","last_clean":"2024-06-06T02:34:24.944251+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944251+0000","last_undegraded":"2024-06-06T02:34:24.944251+0000","last_fullsized":"2024-06-06T02:34:24.944251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752315+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:36:14.752315+0000","last_peered":"2024-06-06T02:36:14.752315+0000","last_clean":"2024-06-06T02:36:14.752315+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:36:14.752315+0000","last_undegraded":"2024-06-06T02:36:14.752315+0000","last_fullsized":"2024-06-06T02:36:14.752315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948916+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:24.948916+0000","last_peered":"2024-06-06T02:34:24.948916+0000","last_clean":"2024-06-06T02:34:24.948916+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:24.948916+0000","last_undegraded":"2024-06-06T02:34:24.948916+0000","last_fullsized":"2024-06-06T02:34:24.948916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731854+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:36:14.731854+0000","last_peered":"2024-06-06T02:36:14.731854+0000","last_clean":"2024-06-06T02:36:14.731854+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:36:14.731854+0000","last_undegraded":"2024-06-06T02:36:14.731854+0000","last_fullsized":"2024-06-06T02:36:14.731854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:11.366061+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:35:11.366061+0000","last_peered":"2024-06-06T02:35:11.366061+0000","last_clean":"2024-06-06T02:35:11.366061+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:35:11.366061+0000","last_undegraded":"2024-06-06T02:35:11.366061+0000","last_fullsized":"2024-06-06T02:35:11.366061+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945512+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945512+0000","last_peered":"2024-06-06T02:34:24.945512+0000","last_clean":"2024-06-06T02:34:24.945512+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945512+0000","last_undegraded":"2024-06-06T02:34:24.945512+0000","last_fullsized":"2024-06-06T02:34:24.945512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746789+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:36:14.746789+0000","last_peered":"2024-06-06T02:36:14.746789+0000","last_clean":"2024-06-06T02:36:14.746789+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:36:14.746789+0000","last_undegraded":"2024-06-06T02:36:14.746789+0000","last_fullsized":"2024-06-06T02:36:14.746789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:56.371461+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:35:56.371461+0000","last_peered":"2024-06-06T02:35:56.371461+0000","last_clean":"2024-06-06T02:35:56.371461+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:35:56.371461+0000","last_undegraded":"2024-06-06T02:35:56.371461+0000","last_fullsized":"2024-06-06T02:35:56.371461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763060+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:36:14.763060+0000","last_peered":"2024-06-06T02:36:14.763060+0000","last_clean":"2024-06-06T02:36:14.763060+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:36:14.763060+0000","last_undegraded":"2024-06-06T02:36:14.763060+0000","last_fullsized":"2024-06-06T02:36:14.763060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.440906+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:37:59.440906+0000","last_peered":"2024-06-06T02:37:59.440906+0000","last_clean":"2024-06-06T02:37:59.440906+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:37:59.440906+0000","last_undegraded":"2024-06-06T02:37:59.440906+0000","last_fullsized":"2024-06-06T02:37:59.440906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725995+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:36:14.725995+0000","last_peered":"2024-06-06T02:36:14.725995+0000","last_clean":"2024-06-06T02:36:14.725995+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:36:14.725995+0000","last_undegraded":"2024-06-06T02:36:14.725995+0000","last_fullsized":"2024-06-06T02:36:14.725995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924916+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:21.924916+0000","last_peered":"2024-06-06T02:34:21.924916+0000","last_clean":"2024-06-06T02:34:21.924916+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:21.924916+0000","last_undegraded":"2024-06-06T02:34:21.924916+0000","last_fullsized":"2024-06-06T02:34:21.924916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761273+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:36:14.761273+0000","last_peered":"2024-06-06T02:36:14.761273+0000","last_clean":"2024-06-06T02:36:14.761273+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:36:14.761273+0000","last_undegraded":"2024-06-06T02:36:14.761273+0000","last_fullsized":"2024-06-06T02:36:14.761273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855684+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855684+0000","last_peered":"2024-06-06T02:34:15.855684+0000","last_clean":"2024-06-06T02:34:15.855684+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855684+0000","last_undegraded":"2024-06-06T02:34:15.855684+0000","last_fullsized":"2024-06-06T02:34:15.855684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763995+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:36:14.763995+0000","last_peered":"2024-06-06T02:36:14.763995+0000","last_clean":"2024-06-06T02:36:14.763995+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:36:14.763995+0000","last_undegraded":"2024-06-06T02:36:14.763995+0000","last_fullsized":"2024-06-06T02:36:14.763995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945270+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:24.945270+0000","last_peered":"2024-06-06T02:34:24.945270+0000","last_clean":"2024-06-06T02:34:24.945270+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:24.945270+0000","last_undegraded":"2024-06-06T02:34:24.945270+0000","last_fullsized":"2024-06-06T02:34:24.945270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767660+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:36:14.767660+0000","last_peered":"2024-06-06T02:36:14.767660+0000","last_clean":"2024-06-06T02:36:14.767660+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:36:14.767660+0000","last_undegraded":"2024-06-06T02:36:14.767660+0000","last_fullsized":"2024-06-06T02:36:14.767660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:55.676087+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:37:55.676087+0000","last_peered":"2024-06-06T02:37:55.676087+0000","last_clean":"2024-06-06T02:37:55.676087+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:37:55.676087+0000","last_undegraded":"2024-06-06T02:37:55.676087+0000","last_fullsized":"2024-06-06T02:37:55.676087+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752248+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:36:14.752248+0000","last_peered":"2024-06-06T02:36:14.752248+0000","last_clean":"2024-06-06T02:36:14.752248+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:36:14.752248+0000","last_undegraded":"2024-06-06T02:36:14.752248+0000","last_fullsized":"2024-06-06T02:36:14.752248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.909733+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.909733+0000","last_peered":"2024-06-06T02:34:20.909733+0000","last_clean":"2024-06-06T02:34:20.909733+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.909733+0000","last_undegraded":"2024-06-06T02:34:20.909733+0000","last_fullsized":"2024-06-06T02:34:20.909733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760152+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:36:14.760152+0000","last_peered":"2024-06-06T02:36:14.760152+0000","last_clean":"2024-06-06T02:36:14.760152+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:36:14.760152+0000","last_undegraded":"2024-06-06T02:36:14.760152+0000","last_fullsized":"2024-06-06T02:36:14.760152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.912238+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.912238+0000","last_peered":"2024-06-06T02:34:20.912238+0000","last_clean":"2024-06-06T02:34:20.912238+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.912238+0000","last_undegraded":"2024-06-06T02:34:20.912238+0000","last_fullsized":"2024-06-06T02:34:20.912238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.685646+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:36:14.685646+0000","last_peered":"2024-06-06T02:36:14.685646+0000","last_clean":"2024-06-06T02:36:14.685646+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:36:14.685646+0000","last_undegraded":"2024-06-06T02:36:14.685646+0000","last_fullsized":"2024-06-06T02:36:14.685646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.914245+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.914245+0000","last_peered":"2024-06-06T02:34:20.914245+0000","last_clean":"2024-06-06T02:34:20.914245+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.914245+0000","last_undegraded":"2024-06-06T02:34:20.914245+0000","last_fullsized":"2024-06-06T02:34:20.914245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760442+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:36:14.760442+0000","last_peered":"2024-06-06T02:36:14.760442+0000","last_clean":"2024-06-06T02:36:14.760442+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:36:14.760442+0000","last_undegraded":"2024-06-06T02:36:14.760442+0000","last_fullsized":"2024-06-06T02:36:14.760442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.901156+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:21.901156+0000","last_peered":"2024-06-06T02:34:21.901156+0000","last_clean":"2024-06-06T02:34:21.901156+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:21.901156+0000","last_undegraded":"2024-06-06T02:34:21.901156+0000","last_fullsized":"2024-06-06T02:34:21.901156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763061+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:36:14.763061+0000","last_peered":"2024-06-06T02:36:14.763061+0000","last_clean":"2024-06-06T02:36:14.763061+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:36:14.763061+0000","last_undegraded":"2024-06-06T02:36:14.763061+0000","last_fullsized":"2024-06-06T02:36:14.763061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944083+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:24.944083+0000","last_peered":"2024-06-06T02:34:24.944083+0000","last_clean":"2024-06-06T02:34:24.944083+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944083+0000","last_undegraded":"2024-06-06T02:34:24.944083+0000","last_fullsized":"2024-06-06T02:34:24.944083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763467+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:36:14.763467+0000","last_peered":"2024-06-06T02:36:14.763467+0000","last_clean":"2024-06-06T02:36:14.763467+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:36:14.763467+0000","last_undegraded":"2024-06-06T02:36:14.763467+0000","last_fullsized":"2024-06-06T02:36:14.763467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731984+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:36:14.731984+0000","last_peered":"2024-06-06T02:36:14.731984+0000","last_clean":"2024-06-06T02:36:14.731984+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:36:14.731984+0000","last_undegraded":"2024-06-06T02:36:14.731984+0000","last_fullsized":"2024-06-06T02:36:14.731984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847090+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.847090+0000","last_peered":"2024-06-06T02:34:15.847090+0000","last_clean":"2024-06-06T02:34:15.847090+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.847090+0000","last_undegraded":"2024-06-06T02:34:15.847090+0000","last_fullsized":"2024-06-06T02:34:15.847090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767647+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:36:14.767647+0000","last_peered":"2024-06-06T02:36:14.767647+0000","last_clean":"2024-06-06T02:36:14.767647+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:36:14.767647+0000","last_undegraded":"2024-06-06T02:36:14.767647+0000","last_fullsized":"2024-06-06T02:36:14.767647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.917042+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.917042+0000","last_peered":"2024-06-06T02:34:21.917042+0000","last_clean":"2024-06-06T02:34:21.917042+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.917042+0000","last_undegraded":"2024-06-06T02:34:21.917042+0000","last_fullsized":"2024-06-06T02:34:21.917042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767683+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:36:14.767683+0000","last_peered":"2024-06-06T02:36:14.767683+0000","last_clean":"2024-06-06T02:36:14.767683+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:36:14.767683+0000","last_undegraded":"2024-06-06T02:36:14.767683+0000","last_fullsized":"2024-06-06T02:36:14.767683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:58.879625+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:35:58.879625+0000","last_peered":"2024-06-06T02:35:58.879625+0000","last_clean":"2024-06-06T02:35:58.879625+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:35:58.879625+0000","last_undegraded":"2024-06-06T02:35:58.879625+0000","last_fullsized":"2024-06-06T02:35:58.879625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.745961+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:36:14.745961+0000","last_peered":"2024-06-06T02:36:14.745961+0000","last_clean":"2024-06-06T02:36:14.745961+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:36:14.745961+0000","last_undegraded":"2024-06-06T02:36:14.745961+0000","last_fullsized":"2024-06-06T02:36:14.745961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948074+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:24.948074+0000","last_peered":"2024-06-06T02:34:24.948074+0000","last_clean":"2024-06-06T02:34:24.948074+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:24.948074+0000","last_undegraded":"2024-06-06T02:34:24.948074+0000","last_fullsized":"2024-06-06T02:34:24.948074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77050,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1327,"num_read_kb":744,"num_write":181,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":231150,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710783,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1090130,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070538,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266768,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1017295,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986277,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":950272,"data_stored":498711,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411442,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":497676,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":73049,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":74084,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":75018,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:38:04.108 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-06-06T02:38:04.108 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-06T02:38:04.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 -- 172.21.15.82:0/3985338460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410a0f0 msgr2=0x7f3dc410a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 --2- 172.21.15.82:0/3985338460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410a0f0 0x7f3dc410a500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009900 tx=0x7f3db402a410 comp rx=0 tx=0).stop 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 -- 172.21.15.82:0/3985338460 shutdown_connections 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 --2- 172.21.15.82:0/3985338460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc410aa40 0x7f3dc4111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 --2- 172.21.15.82:0/3985338460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410a0f0 0x7f3dc410a500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 --2- 172.21.15.82:0/3985338460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc4108fd0 0x7f3dc41093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 -- 172.21.15.82:0/3985338460 >> 172.21.15.82:0/3985338460 conn(0x7f3dc4078200 msgr2=0x7f3dc407a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 -- 172.21.15.82:0/3985338460 shutdown_connections 2024-06-06T02:38:04.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.422+0000 7f3dcb200640 1 -- 172.21.15.82:0/3985338460 wait complete. 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.423+0000 7f3dcb200640 1 Processor -- start 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.423+0000 7f3dcb200640 1 -- start start 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc410a0f0 0x7f3dc419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 0x7f3dc41a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4114b00 con 0x7f3dc410aa40 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4114980 con 0x7f3dc4108fd0 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dcb200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4114c80 con 0x7f3dc410a0f0 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:44802/0 (socket says 172.21.15.82:44802) 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dca800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 0x7f3dc41a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:04.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9e00640 1 -- 172.21.15.82:0/763645009 learned_addr learned my addr 172.21.15.82:0/763645009 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9400640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc410a0f0 0x7f3dc419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9e00640 1 -- 172.21.15.82:0/763645009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc410a0f0 msgr2=0x7f3dc419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.424+0000 7f3dc9e00640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc410a0f0 0x7f3dc419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dc9e00640 1 -- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 msgr2=0x7f3dc41a6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dc9e00640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 0x7f3dc41a6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dc9e00640 1 -- 172.21.15.82:0/763645009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc41a7200 con 0x7f3dc4108fd0 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dca800640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 0x7f3dc41a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:04.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dc9e00640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e9c0 tx=0x7f3db800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db800ccc0 con 0x7f3dc4108fd0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db80054d0 con 0x7f3dc4108fd0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc41a74f0 con 0x7f3dc4108fd0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8010430 con 0x7f3dc4108fd0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.425+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41a7a40 con 0x7f3dc4108fd0 2024-06-06T02:38:04.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.426+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc41101c0 con 0x7f3dc4108fd0 2024-06-06T02:38:04.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.429+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f3db8004f20 con 0x7f3dc4108fd0 2024-06-06T02:38:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.430+0000 7f3dbea00640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 0x7f3dac0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.430+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3db80e29c0 con 0x7f3dc4108fd0 2024-06-06T02:38:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.430+0000 7f3dc9400640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 0x7f3dac0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:04.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.431+0000 7f3dc9400640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 0x7f3dac0b4d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009230 tx=0x7f3db4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:04.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.432+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3db80aa540 con 0x7f3dc4108fd0 2024-06-06T02:38:04.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.637+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 --> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dc4062ba0 con 0x7f3dac0b2870 2024-06-06T02:38:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.644+0000 7f3dbea00640 1 -- 172.21.15.82:0/763645009 <== mgr.14150 v2:172.21.15.82:6800/664220961 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259124 (secure 0 0 0) 0x7f3dc4062ba0 con 0x7f3dac0b2870 2024-06-06T02:38:04.647 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:04.649 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-06-06T02:38:04.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:04 smithi184 ceph-mon[36922]: pgmap v454: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:04.651 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:04 smithi184 ceph-mon[36922]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 msgr2=0x7f3dac0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 0x7f3dac0b4d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009230 tx=0x7f3db4031400 comp rx=0 tx=0).stop 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 msgr2=0x7f3dc419f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3db800e9c0 tx=0x7f3db800edc0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 shutdown_connections 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3dc410aa40 0x7f3dc41a6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3dac0b2870 0x7f3dac0b4d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dc410a0f0 0x7f3dc419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 --2- 172.21.15.82:0/763645009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc4108fd0 0x7f3dc419f6c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 >> 172.21.15.82:0/763645009 conn(0x7f3dc4078200 msgr2=0x7f3dc410d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 shutdown_connections 2024-06-06T02:38:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:04.649+0000 7f3dcb200640 1 -- 172.21.15.82:0/763645009 wait complete. 2024-06-06T02:38:04.669 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:04 smithi103 ceph-mon[36349]: pgmap v454: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:04.670 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:04 smithi103 ceph-mon[36349]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:04.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:04 smithi082 ceph-mon[31579]: pgmap v454: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:04.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:04 smithi082 ceph-mon[31579]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:04.677 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-06-06T02:38:02.869199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667652,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1403,"num_read_kb":808,"num_write":306,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2953452,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":747,"ondisk_log_size":747,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359832,"kb_used_data":10680,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581992,"statfs":{"total":1151940427776,"available":1151571959808,"internally_reserved":0,"allocated":10936320,"data_stored":7098480,"data_compressed":182139,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8981,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":45,"num_write":10,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005575"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763442+0000","last_change":"2024-06-06T02:34:00.625577+0000","last_active":"2024-06-06T02:36:14.763442+0000","last_peered":"2024-06-06T02:36:14.763442+0000","last_clean":"2024-06-06T02:36:14.763442+0000","last_became_active":"2024-06-06T02:34:00.625129+0000","last_became_peered":"2024-06-06T02:34:00.625129+0000","last_unstale":"2024-06-06T02:36:14.763442+0000","last_undegraded":"2024-06-06T02:36:14.763442+0000","last_fullsized":"2024-06-06T02:36:14.763442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:09:54.952063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759693+0000","last_change":"2024-06-06T02:34:00.625659+0000","last_active":"2024-06-06T02:36:14.759693+0000","last_peered":"2024-06-06T02:36:14.759693+0000","last_clean":"2024-06-06T02:36:14.759693+0000","last_became_active":"2024-06-06T02:34:00.622514+0000","last_became_peered":"2024-06-06T02:34:00.622514+0000","last_unstale":"2024-06-06T02:36:14.759693+0000","last_undegraded":"2024-06-06T02:36:14.759693+0000","last_fullsized":"2024-06-06T02:36:14.759693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:12:04.866443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761379+0000","last_change":"2024-06-06T02:34:00.626132+0000","last_active":"2024-06-06T02:36:14.761379+0000","last_peered":"2024-06-06T02:36:14.761379+0000","last_clean":"2024-06-06T02:36:14.761379+0000","last_became_active":"2024-06-06T02:34:00.621079+0000","last_became_peered":"2024-06-06T02:34:00.621079+0000","last_unstale":"2024-06-06T02:36:14.761379+0000","last_undegraded":"2024-06-06T02:36:14.761379+0000","last_fullsized":"2024-06-06T02:36:14.761379+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:25:00.762493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.726838+0000","last_change":"2024-06-06T02:34:00.625772+0000","last_active":"2024-06-06T02:36:14.726838+0000","last_peered":"2024-06-06T02:36:14.726838+0000","last_clean":"2024-06-06T02:36:14.726838+0000","last_became_active":"2024-06-06T02:34:00.625379+0000","last_became_peered":"2024-06-06T02:34:00.625379+0000","last_unstale":"2024-06-06T02:36:14.726838+0000","last_undegraded":"2024-06-06T02:36:14.726838+0000","last_fullsized":"2024-06-06T02:36:14.726838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:31:43.060138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758155+0000","last_change":"2024-06-06T02:34:00.636260+0000","last_active":"2024-06-06T02:36:14.758155+0000","last_peered":"2024-06-06T02:36:14.758155+0000","last_clean":"2024-06-06T02:36:14.758155+0000","last_became_active":"2024-06-06T02:34:00.635904+0000","last_became_peered":"2024-06-06T02:34:00.635904+0000","last_unstale":"2024-06-06T02:36:14.758155+0000","last_undegraded":"2024-06-06T02:36:14.758155+0000","last_fullsized":"2024-06-06T02:36:14.758155+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:31:06.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759514+0000","last_change":"2024-06-06T02:34:00.622904+0000","last_active":"2024-06-06T02:36:14.759514+0000","last_peered":"2024-06-06T02:36:14.759514+0000","last_clean":"2024-06-06T02:36:14.759514+0000","last_became_active":"2024-06-06T02:34:00.622536+0000","last_became_peered":"2024-06-06T02:34:00.622536+0000","last_unstale":"2024-06-06T02:36:14.759514+0000","last_undegraded":"2024-06-06T02:36:14.759514+0000","last_fullsized":"2024-06-06T02:36:14.759514+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:00:42.158733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753425+0000","last_change":"2024-06-06T02:34:00.623143+0000","last_active":"2024-06-06T02:36:14.753425+0000","last_peered":"2024-06-06T02:36:14.753425+0000","last_clean":"2024-06-06T02:36:14.753425+0000","last_became_active":"2024-06-06T02:34:00.622228+0000","last_became_peered":"2024-06-06T02:34:00.622228+0000","last_unstale":"2024-06-06T02:36:14.753425+0000","last_undegraded":"2024-06-06T02:36:14.753425+0000","last_fullsized":"2024-06-06T02:36:14.753425+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:29:09.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758966+0000","last_change":"2024-06-06T02:34:15.854759+0000","last_active":"2024-06-06T02:36:14.758966+0000","last_peered":"2024-06-06T02:36:14.758966+0000","last_clean":"2024-06-06T02:36:14.758966+0000","last_became_active":"2024-06-06T02:34:15.853419+0000","last_became_peered":"2024-06-06T02:34:15.853419+0000","last_unstale":"2024-06-06T02:36:14.758966+0000","last_undegraded":"2024-06-06T02:36:14.758966+0000","last_fullsized":"2024-06-06T02:36:14.758966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:53:46.918461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729985+0000","last_change":"2024-06-06T02:34:00.625272+0000","last_active":"2024-06-06T02:36:14.729985+0000","last_peered":"2024-06-06T02:36:14.729985+0000","last_clean":"2024-06-06T02:36:14.729985+0000","last_became_active":"2024-06-06T02:34:00.624866+0000","last_became_peered":"2024-06-06T02:34:00.624866+0000","last_unstale":"2024-06-06T02:36:14.729985+0000","last_undegraded":"2024-06-06T02:36:14.729985+0000","last_fullsized":"2024-06-06T02:36:14.729985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:31:24.252271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733844+0000","last_change":"2024-06-06T02:34:00.618125+0000","last_active":"2024-06-06T02:36:14.733844+0000","last_peered":"2024-06-06T02:36:14.733844+0000","last_clean":"2024-06-06T02:36:14.733844+0000","last_became_active":"2024-06-06T02:34:00.617747+0000","last_became_peered":"2024-06-06T02:34:00.617747+0000","last_unstale":"2024-06-06T02:36:14.733844+0000","last_undegraded":"2024-06-06T02:36:14.733844+0000","last_fullsized":"2024-06-06T02:36:14.733844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:57:19.918225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731157+0000","last_change":"2024-06-06T02:34:00.626526+0000","last_active":"2024-06-06T02:36:14.731157+0000","last_peered":"2024-06-06T02:36:14.731157+0000","last_clean":"2024-06-06T02:36:14.731157+0000","last_became_active":"2024-06-06T02:34:00.626134+0000","last_became_peered":"2024-06-06T02:34:00.626134+0000","last_unstale":"2024-06-06T02:36:14.731157+0000","last_undegraded":"2024-06-06T02:36:14.731157+0000","last_fullsized":"2024-06-06T02:36:14.731157+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:06:47.356819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729515+0000","last_change":"2024-06-06T02:34:00.616406+0000","last_active":"2024-06-06T02:36:14.729515+0000","last_peered":"2024-06-06T02:36:14.729515+0000","last_clean":"2024-06-06T02:36:14.729515+0000","last_became_active":"2024-06-06T02:34:00.616025+0000","last_became_peered":"2024-06-06T02:34:00.616025+0000","last_unstale":"2024-06-06T02:36:14.729515+0000","last_undegraded":"2024-06-06T02:36:14.729515+0000","last_fullsized":"2024-06-06T02:36:14.729515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:24:36.449239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770754+0000","last_change":"2024-06-06T02:34:00.625238+0000","last_active":"2024-06-06T02:36:14.770754+0000","last_peered":"2024-06-06T02:36:14.770754+0000","last_clean":"2024-06-06T02:36:14.770754+0000","last_became_active":"2024-06-06T02:34:00.624883+0000","last_became_peered":"2024-06-06T02:34:00.624883+0000","last_unstale":"2024-06-06T02:36:14.770754+0000","last_undegraded":"2024-06-06T02:36:14.770754+0000","last_fullsized":"2024-06-06T02:36:14.770754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:23:40.593227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764529+0000","last_change":"2024-06-06T02:34:00.625909+0000","last_active":"2024-06-06T02:36:14.764529+0000","last_peered":"2024-06-06T02:36:14.764529+0000","last_clean":"2024-06-06T02:36:14.764529+0000","last_became_active":"2024-06-06T02:34:00.619532+0000","last_became_peered":"2024-06-06T02:34:00.619532+0000","last_unstale":"2024-06-06T02:36:14.764529+0000","last_undegraded":"2024-06-06T02:36:14.764529+0000","last_fullsized":"2024-06-06T02:36:14.764529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:47:23.177295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760237+0000","last_change":"2024-06-06T02:34:15.853106+0000","last_active":"2024-06-06T02:36:14.760237+0000","last_peered":"2024-06-06T02:36:14.760237+0000","last_clean":"2024-06-06T02:36:14.760237+0000","last_became_active":"2024-06-06T02:34:15.851890+0000","last_became_peered":"2024-06-06T02:34:15.851890+0000","last_unstale":"2024-06-06T02:36:14.760237+0000","last_undegraded":"2024-06-06T02:36:14.760237+0000","last_fullsized":"2024-06-06T02:36:14.760237+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:04:38.737883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760967+0000","last_change":"2024-06-06T02:34:00.622010+0000","last_active":"2024-06-06T02:36:14.760967+0000","last_peered":"2024-06-06T02:36:14.760967+0000","last_clean":"2024-06-06T02:36:14.760967+0000","last_became_active":"2024-06-06T02:34:00.621626+0000","last_became_peered":"2024-06-06T02:34:00.621626+0000","last_unstale":"2024-06-06T02:36:14.760967+0000","last_undegraded":"2024-06-06T02:36:14.760967+0000","last_fullsized":"2024-06-06T02:36:14.760967+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:46:10.618100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763688+0000","last_change":"2024-06-06T02:34:00.625624+0000","last_active":"2024-06-06T02:36:14.763688+0000","last_peered":"2024-06-06T02:36:14.763688+0000","last_clean":"2024-06-06T02:36:14.763688+0000","last_became_active":"2024-06-06T02:34:00.625148+0000","last_became_peered":"2024-06-06T02:34:00.625148+0000","last_unstale":"2024-06-06T02:36:14.763688+0000","last_undegraded":"2024-06-06T02:36:14.763688+0000","last_fullsized":"2024-06-06T02:36:14.763688+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:50:41.357869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.758949+0000","last_change":"2024-06-06T02:34:00.628585+0000","last_active":"2024-06-06T02:36:14.758949+0000","last_peered":"2024-06-06T02:36:14.758949+0000","last_clean":"2024-06-06T02:36:14.758949+0000","last_became_active":"2024-06-06T02:34:00.628179+0000","last_became_peered":"2024-06-06T02:34:00.628179+0000","last_unstale":"2024-06-06T02:36:14.758949+0000","last_undegraded":"2024-06-06T02:36:14.758949+0000","last_fullsized":"2024-06-06T02:36:14.758949+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:48:45.010062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768309+0000","last_change":"2024-06-06T02:34:00.635519+0000","last_active":"2024-06-06T02:36:14.768309+0000","last_peered":"2024-06-06T02:36:14.768309+0000","last_clean":"2024-06-06T02:36:14.768309+0000","last_became_active":"2024-06-06T02:34:00.635191+0000","last_became_peered":"2024-06-06T02:34:00.635191+0000","last_unstale":"2024-06-06T02:36:14.768309+0000","last_undegraded":"2024-06-06T02:36:14.768309+0000","last_fullsized":"2024-06-06T02:36:14.768309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:45.405957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.757382+0000","last_change":"2024-06-06T02:34:15.857234+0000","last_active":"2024-06-06T02:36:14.757382+0000","last_peered":"2024-06-06T02:36:14.757382+0000","last_clean":"2024-06-06T02:36:14.757382+0000","last_became_active":"2024-06-06T02:34:15.856777+0000","last_became_peered":"2024-06-06T02:34:15.856777+0000","last_unstale":"2024-06-06T02:36:14.757382+0000","last_undegraded":"2024-06-06T02:36:14.757382+0000","last_fullsized":"2024-06-06T02:36:14.757382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:37:28.683602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.770574+0000","last_change":"2024-06-06T02:34:00.629918+0000","last_active":"2024-06-06T02:36:14.770574+0000","last_peered":"2024-06-06T02:36:14.770574+0000","last_clean":"2024-06-06T02:36:14.770574+0000","last_became_active":"2024-06-06T02:34:00.628732+0000","last_became_peered":"2024-06-06T02:34:00.628732+0000","last_unstale":"2024-06-06T02:36:14.770574+0000","last_undegraded":"2024-06-06T02:36:14.770574+0000","last_fullsized":"2024-06-06T02:36:14.770574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:10:44.781061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.749670+0000","last_change":"2024-06-06T02:34:00.637775+0000","last_active":"2024-06-06T02:36:14.749670+0000","last_peered":"2024-06-06T02:36:14.749670+0000","last_clean":"2024-06-06T02:36:14.749670+0000","last_became_active":"2024-06-06T02:34:00.637389+0000","last_became_peered":"2024-06-06T02:34:00.637389+0000","last_unstale":"2024-06-06T02:36:14.749670+0000","last_undegraded":"2024-06-06T02:36:14.749670+0000","last_fullsized":"2024-06-06T02:36:14.749670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.934127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.750612+0000","last_change":"2024-06-06T02:34:00.627937+0000","last_active":"2024-06-06T02:36:14.750612+0000","last_peered":"2024-06-06T02:36:14.750612+0000","last_clean":"2024-06-06T02:36:14.750612+0000","last_became_active":"2024-06-06T02:34:00.627567+0000","last_became_peered":"2024-06-06T02:34:00.627567+0000","last_unstale":"2024-06-06T02:36:14.750612+0000","last_undegraded":"2024-06-06T02:36:14.750612+0000","last_fullsized":"2024-06-06T02:36:14.750612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:11:59.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.741918+0000","last_change":"2024-06-06T02:34:00.622650+0000","last_active":"2024-06-06T02:36:14.741918+0000","last_peered":"2024-06-06T02:36:14.741918+0000","last_clean":"2024-06-06T02:36:14.741918+0000","last_became_active":"2024-06-06T02:34:00.622171+0000","last_became_peered":"2024-06-06T02:34:00.622171+0000","last_unstale":"2024-06-06T02:36:14.741918+0000","last_undegraded":"2024-06-06T02:36:14.741918+0000","last_fullsized":"2024-06-06T02:36:14.741918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:07:57.057780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748548+0000","last_change":"2024-06-06T02:34:00.626418+0000","last_active":"2024-06-06T02:36:14.748548+0000","last_peered":"2024-06-06T02:36:14.748548+0000","last_clean":"2024-06-06T02:36:14.748548+0000","last_became_active":"2024-06-06T02:34:00.623821+0000","last_became_peered":"2024-06-06T02:34:00.623821+0000","last_unstale":"2024-06-06T02:36:14.748548+0000","last_undegraded":"2024-06-06T02:36:14.748548+0000","last_fullsized":"2024-06-06T02:36:14.748548+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:43:04.693022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.733052+0000","last_change":"2024-06-06T02:34:00.625935+0000","last_active":"2024-06-06T02:36:14.733052+0000","last_peered":"2024-06-06T02:36:14.733052+0000","last_clean":"2024-06-06T02:36:14.733052+0000","last_became_active":"2024-06-06T02:34:00.625147+0000","last_became_peered":"2024-06-06T02:34:00.625147+0000","last_unstale":"2024-06-06T02:36:14.733052+0000","last_undegraded":"2024-06-06T02:36:14.733052+0000","last_fullsized":"2024-06-06T02:36:14.733052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:28:26.248448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.756951+0000","last_change":"2024-06-06T02:34:15.855601+0000","last_active":"2024-06-06T02:36:14.756951+0000","last_peered":"2024-06-06T02:36:14.756951+0000","last_clean":"2024-06-06T02:36:14.756951+0000","last_became_active":"2024-06-06T02:34:15.855187+0000","last_became_peered":"2024-06-06T02:34:15.855187+0000","last_unstale":"2024-06-06T02:36:14.756951+0000","last_undegraded":"2024-06-06T02:36:14.756951+0000","last_fullsized":"2024-06-06T02:36:14.756951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:07:18.457292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768068+0000","last_change":"2024-06-06T02:34:00.630943+0000","last_active":"2024-06-06T02:36:14.768068+0000","last_peered":"2024-06-06T02:36:14.768068+0000","last_clean":"2024-06-06T02:36:14.768068+0000","last_became_active":"2024-06-06T02:34:00.630575+0000","last_became_peered":"2024-06-06T02:34:00.630575+0000","last_unstale":"2024-06-06T02:36:14.768068+0000","last_undegraded":"2024-06-06T02:36:14.768068+0000","last_fullsized":"2024-06-06T02:36:14.768068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:04:18.525248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.765237+0000","last_change":"2024-06-06T02:34:00.632093+0000","last_active":"2024-06-06T02:36:14.765237+0000","last_peered":"2024-06-06T02:36:14.765237+0000","last_clean":"2024-06-06T02:36:14.765237+0000","last_became_active":"2024-06-06T02:34:00.631205+0000","last_became_peered":"2024-06-06T02:34:00.631205+0000","last_unstale":"2024-06-06T02:36:14.765237+0000","last_undegraded":"2024-06-06T02:36:14.765237+0000","last_fullsized":"2024-06-06T02:36:14.765237+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:50:10.212301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.748846+0000","last_change":"2024-06-06T02:34:00.636672+0000","last_active":"2024-06-06T02:36:14.748846+0000","last_peered":"2024-06-06T02:36:14.748846+0000","last_clean":"2024-06-06T02:36:14.748846+0000","last_became_active":"2024-06-06T02:34:00.636268+0000","last_became_peered":"2024-06-06T02:34:00.636268+0000","last_unstale":"2024-06-06T02:36:14.748846+0000","last_undegraded":"2024-06-06T02:36:14.748846+0000","last_fullsized":"2024-06-06T02:36:14.748846+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:15:50.137715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.768337+0000","last_change":"2024-06-06T02:34:15.850719+0000","last_active":"2024-06-06T02:36:14.768337+0000","last_peered":"2024-06-06T02:36:14.768337+0000","last_clean":"2024-06-06T02:36:14.768337+0000","last_became_active":"2024-06-06T02:34:15.850099+0000","last_became_peered":"2024-06-06T02:34:15.850099+0000","last_unstale":"2024-06-06T02:36:14.768337+0000","last_undegraded":"2024-06-06T02:36:14.768337+0000","last_fullsized":"2024-06-06T02:36:14.768337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:52:48.683245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.729331+0000","last_change":"2024-06-06T02:34:00.616971+0000","last_active":"2024-06-06T02:36:14.729331+0000","last_peered":"2024-06-06T02:36:14.729331+0000","last_clean":"2024-06-06T02:36:14.729331+0000","last_became_active":"2024-06-06T02:34:00.616563+0000","last_became_peered":"2024-06-06T02:34:00.616563+0000","last_unstale":"2024-06-06T02:36:14.729331+0000","last_undegraded":"2024-06-06T02:36:14.729331+0000","last_fullsized":"2024-06-06T02:36:14.729331+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:32:24.236409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759270+0000","last_change":"2024-06-06T02:34:00.621329+0000","last_active":"2024-06-06T02:36:14.759270+0000","last_peered":"2024-06-06T02:36:14.759270+0000","last_clean":"2024-06-06T02:36:14.759270+0000","last_became_active":"2024-06-06T02:34:00.620949+0000","last_became_peered":"2024-06-06T02:34:00.620949+0000","last_unstale":"2024-06-06T02:36:14.759270+0000","last_undegraded":"2024-06-06T02:36:14.759270+0000","last_fullsized":"2024-06-06T02:36:14.759270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:11:14.955908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":251,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:38:00.310584+0000","last_change":"2024-06-06T02:33:56.556109+0000","last_active":"2024-06-06T02:38:00.310584+0000","last_peered":"2024-06-06T02:38:00.310584+0000","last_clean":"2024-06-06T02:38:00.310584+0000","last_became_active":"2024-06-06T02:33:56.555615+0000","last_became_peered":"2024-06-06T02:33:56.555615+0000","last_unstale":"2024-06-06T02:38:00.310584+0000","last_undegraded":"2024-06-06T02:38:00.310584+0000","last_fullsized":"2024-06-06T02:38:00.310584+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:03:11.633683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":219,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746362+0000","last_change":"2024-06-06T02:34:00.610571+0000","last_active":"2024-06-06T02:36:14.746362+0000","last_peered":"2024-06-06T02:36:14.746362+0000","last_clean":"2024-06-06T02:36:14.746362+0000","last_became_active":"2024-06-06T02:34:00.610170+0000","last_became_peered":"2024-06-06T02:34:00.610170+0000","last_unstale":"2024-06-06T02:36:14.746362+0000","last_undegraded":"2024-06-06T02:36:14.746362+0000","last_fullsized":"2024-06-06T02:36:14.746362+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:45:51.354498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.925218+0000","last_change":"2024-06-06T02:34:15.850174+0000","last_active":"2024-06-06T02:34:21.925218+0000","last_peered":"2024-06-06T02:34:21.925218+0000","last_clean":"2024-06-06T02:34:21.925218+0000","last_became_active":"2024-06-06T02:34:15.849661+0000","last_became_peered":"2024-06-06T02:34:15.849661+0000","last_unstale":"2024-06-06T02:34:21.925218+0000","last_undegraded":"2024-06-06T02:34:21.925218+0000","last_fullsized":"2024-06-06T02:34:21.925218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:08.703840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.926067+0000","last_change":"2024-06-06T02:33:56.569308+0000","last_active":"2024-06-06T02:34:21.926067+0000","last_peered":"2024-06-06T02:34:21.926067+0000","last_clean":"2024-06-06T02:34:21.926067+0000","last_became_active":"2024-06-06T02:33:56.568867+0000","last_became_peered":"2024-06-06T02:33:56.568867+0000","last_unstale":"2024-06-06T02:34:21.926067+0000","last_undegraded":"2024-06-06T02:34:21.926067+0000","last_fullsized":"2024-06-06T02:34:21.926067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:28:24.169627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769025+0000","last_change":"2024-06-06T02:34:00.625156+0000","last_active":"2024-06-06T02:36:14.769025+0000","last_peered":"2024-06-06T02:36:14.769025+0000","last_clean":"2024-06-06T02:36:14.769025+0000","last_became_active":"2024-06-06T02:34:00.623443+0000","last_became_peered":"2024-06-06T02:34:00.623443+0000","last_unstale":"2024-06-06T02:36:14.769025+0000","last_undegraded":"2024-06-06T02:36:14.769025+0000","last_fullsized":"2024-06-06T02:36:14.769025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:04:01.342494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.906263+0000","last_change":"2024-06-06T02:33:56.557272+0000","last_active":"2024-06-06T02:34:20.906263+0000","last_peered":"2024-06-06T02:34:20.906263+0000","last_clean":"2024-06-06T02:34:20.906263+0000","last_became_active":"2024-06-06T02:33:56.556399+0000","last_became_peered":"2024-06-06T02:33:56.556399+0000","last_unstale":"2024-06-06T02:34:20.906263+0000","last_undegraded":"2024-06-06T02:34:20.906263+0000","last_fullsized":"2024-06-06T02:34:20.906263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:14.283228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.759728+0000","last_change":"2024-06-06T02:34:00.638511+0000","last_active":"2024-06-06T02:36:14.759728+0000","last_peered":"2024-06-06T02:36:14.759728+0000","last_clean":"2024-06-06T02:36:14.759728+0000","last_became_active":"2024-06-06T02:34:00.636912+0000","last_became_peered":"2024-06-06T02:34:00.636912+0000","last_unstale":"2024-06-06T02:36:14.759728+0000","last_undegraded":"2024-06-06T02:36:14.759728+0000","last_fullsized":"2024-06-06T02:36:14.759728+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:38:00.100146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":245,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:58.306774+0000","last_change":"2024-06-06T02:33:56.568961+0000","last_active":"2024-06-06T02:37:58.306774+0000","last_peered":"2024-06-06T02:37:58.306774+0000","last_clean":"2024-06-06T02:37:58.306774+0000","last_became_active":"2024-06-06T02:33:56.568491+0000","last_became_peered":"2024-06-06T02:33:56.568491+0000","last_unstale":"2024-06-06T02:37:58.306774+0000","last_undegraded":"2024-06-06T02:37:58.306774+0000","last_fullsized":"2024-06-06T02:37:58.306774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:16:35.196295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":215,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.753330+0000","last_change":"2024-06-06T02:34:00.622887+0000","last_active":"2024-06-06T02:36:14.753330+0000","last_peered":"2024-06-06T02:36:14.753330+0000","last_clean":"2024-06-06T02:36:14.753330+0000","last_became_active":"2024-06-06T02:34:00.622326+0000","last_became_peered":"2024-06-06T02:34:00.622326+0000","last_unstale":"2024-06-06T02:36:14.753330+0000","last_undegraded":"2024-06-06T02:36:14.753330+0000","last_fullsized":"2024-06-06T02:36:14.753330+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:23:39.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.905669+0000","last_change":"2024-06-06T02:33:56.556350+0000","last_active":"2024-06-06T02:34:20.905669+0000","last_peered":"2024-06-06T02:34:20.905669+0000","last_clean":"2024-06-06T02:34:20.905669+0000","last_became_active":"2024-06-06T02:33:56.555690+0000","last_became_peered":"2024-06-06T02:33:56.555690+0000","last_unstale":"2024-06-06T02:34:20.905669+0000","last_undegraded":"2024-06-06T02:34:20.905669+0000","last_fullsized":"2024-06-06T02:34:20.905669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:40:33.815023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.766604+0000","last_change":"2024-06-06T02:34:00.625922+0000","last_active":"2024-06-06T02:36:14.766604+0000","last_peered":"2024-06-06T02:36:14.766604+0000","last_clean":"2024-06-06T02:36:14.766604+0000","last_became_active":"2024-06-06T02:34:00.624335+0000","last_became_peered":"2024-06-06T02:34:00.624335+0000","last_unstale":"2024-06-06T02:36:14.766604+0000","last_undegraded":"2024-06-06T02:36:14.766604+0000","last_fullsized":"2024-06-06T02:36:14.766604+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:03:19.808154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.947496+0000","last_change":"2024-06-06T02:33:56.806003+0000","last_active":"2024-06-06T02:34:24.947496+0000","last_peered":"2024-06-06T02:34:24.947496+0000","last_clean":"2024-06-06T02:34:24.947496+0000","last_became_active":"2024-06-06T02:33:56.805560+0000","last_became_peered":"2024-06-06T02:33:56.805560+0000","last_unstale":"2024-06-06T02:34:24.947496+0000","last_undegraded":"2024-06-06T02:34:24.947496+0000","last_fullsized":"2024-06-06T02:34:24.947496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:22:06.091534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.732777+0000","last_change":"2024-06-06T02:34:00.626481+0000","last_active":"2024-06-06T02:36:14.732777+0000","last_peered":"2024-06-06T02:36:14.732777+0000","last_clean":"2024-06-06T02:36:14.732777+0000","last_became_active":"2024-06-06T02:34:00.625789+0000","last_became_peered":"2024-06-06T02:34:00.625789+0000","last_unstale":"2024-06-06T02:36:14.732777+0000","last_undegraded":"2024-06-06T02:36:14.732777+0000","last_fullsized":"2024-06-06T02:36:14.732777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:35:52.318201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'38","reported_seq":527,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.459748+0000","last_change":"2024-06-06T02:34:15.902710+0000","last_active":"2024-06-06T02:37:59.459748+0000","last_peered":"2024-06-06T02:37:59.459748+0000","last_clean":"2024-06-06T02:37:59.459748+0000","last_became_active":"2024-06-06T02:34:15.895104+0000","last_became_peered":"2024-06-06T02:34:15.895104+0000","last_unstale":"2024-06-06T02:37:59.459748+0000","last_undegraded":"2024-06-06T02:37:59.459748+0000","last_fullsized":"2024-06-06T02:37:59.459748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:46.774390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73049,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":294,"num_write":39,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.721075+0000","last_change":"2024-06-06T02:34:00.619369+0000","last_active":"2024-06-06T02:36:14.721075+0000","last_peered":"2024-06-06T02:36:14.721075+0000","last_clean":"2024-06-06T02:36:14.721075+0000","last_became_active":"2024-06-06T02:34:00.618900+0000","last_became_peered":"2024-06-06T02:34:00.618900+0000","last_unstale":"2024-06-06T02:36:14.721075+0000","last_undegraded":"2024-06-06T02:36:14.721075+0000","last_fullsized":"2024-06-06T02:36:14.721075+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:22:09.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944283+0000","last_change":"2024-06-06T02:33:56.564178+0000","last_active":"2024-06-06T02:34:24.944283+0000","last_peered":"2024-06-06T02:34:24.944283+0000","last_clean":"2024-06-06T02:34:24.944283+0000","last_became_active":"2024-06-06T02:33:56.563722+0000","last_became_peered":"2024-06-06T02:33:56.563722+0000","last_unstale":"2024-06-06T02:34:24.944283+0000","last_undegraded":"2024-06-06T02:34:24.944283+0000","last_fullsized":"2024-06-06T02:34:24.944283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:31:17.436444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.769779+0000","last_change":"2024-06-06T02:34:00.639305+0000","last_active":"2024-06-06T02:36:14.769779+0000","last_peered":"2024-06-06T02:36:14.769779+0000","last_clean":"2024-06-06T02:36:14.769779+0000","last_became_active":"2024-06-06T02:34:00.638847+0000","last_became_peered":"2024-06-06T02:34:00.638847+0000","last_unstale":"2024-06-06T02:36:14.769779+0000","last_undegraded":"2024-06-06T02:36:14.769779+0000","last_fullsized":"2024-06-06T02:36:14.769779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:12:29.434113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.911833+0000","last_change":"2024-06-06T02:33:56.558184+0000","last_active":"2024-06-06T02:34:20.911833+0000","last_peered":"2024-06-06T02:34:20.911833+0000","last_clean":"2024-06-06T02:34:20.911833+0000","last_became_active":"2024-06-06T02:33:56.557769+0000","last_became_peered":"2024-06-06T02:33:56.557769+0000","last_unstale":"2024-06-06T02:34:20.911833+0000","last_undegraded":"2024-06-06T02:34:20.911833+0000","last_fullsized":"2024-06-06T02:34:20.911833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:44:10.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.764292+0000","last_change":"2024-06-06T02:34:00.617677+0000","last_active":"2024-06-06T02:36:14.764292+0000","last_peered":"2024-06-06T02:36:14.764292+0000","last_clean":"2024-06-06T02:36:14.764292+0000","last_became_active":"2024-06-06T02:34:00.617294+0000","last_became_peered":"2024-06-06T02:34:00.617294+0000","last_unstale":"2024-06-06T02:36:14.764292+0000","last_undegraded":"2024-06-06T02:36:14.764292+0000","last_fullsized":"2024-06-06T02:36:14.764292+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:41:46.519846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:57.437112+0000","last_change":"2024-06-06T02:33:56.557168+0000","last_active":"2024-06-06T02:37:57.437112+0000","last_peered":"2024-06-06T02:37:57.437112+0000","last_clean":"2024-06-06T02:37:57.437112+0000","last_became_active":"2024-06-06T02:33:56.556760+0000","last_became_peered":"2024-06-06T02:33:56.556760+0000","last_unstale":"2024-06-06T02:37:57.437112+0000","last_undegraded":"2024-06-06T02:37:57.437112+0000","last_fullsized":"2024-06-06T02:37:57.437112+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:00:00.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":218,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.704921+0000","last_change":"2024-06-06T02:34:00.609306+0000","last_active":"2024-06-06T02:36:14.704921+0000","last_peered":"2024-06-06T02:36:14.704921+0000","last_clean":"2024-06-06T02:36:14.704921+0000","last_became_active":"2024-06-06T02:34:00.608928+0000","last_became_peered":"2024-06-06T02:34:00.608928+0000","last_unstale":"2024-06-06T02:36:14.704921+0000","last_undegraded":"2024-06-06T02:36:14.704921+0000","last_fullsized":"2024-06-06T02:36:14.704921+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:51:30.633527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945265+0000","last_change":"2024-06-06T02:33:56.805150+0000","last_active":"2024-06-06T02:34:24.945265+0000","last_peered":"2024-06-06T02:34:24.945265+0000","last_clean":"2024-06-06T02:34:24.945265+0000","last_became_active":"2024-06-06T02:33:56.804489+0000","last_became_peered":"2024-06-06T02:33:56.804489+0000","last_unstale":"2024-06-06T02:34:24.945265+0000","last_undegraded":"2024-06-06T02:34:24.945265+0000","last_fullsized":"2024-06-06T02:34:24.945265+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:30:28.488233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.730992+0000","last_change":"2024-06-06T02:34:00.618831+0000","last_active":"2024-06-06T02:36:14.730992+0000","last_peered":"2024-06-06T02:36:14.730992+0000","last_clean":"2024-06-06T02:36:14.730992+0000","last_became_active":"2024-06-06T02:34:00.618442+0000","last_became_peered":"2024-06-06T02:34:00.618442+0000","last_unstale":"2024-06-06T02:36:14.730992+0000","last_undegraded":"2024-06-06T02:36:14.730992+0000","last_fullsized":"2024-06-06T02:36:14.730992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:44:11.143801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944016+0000","last_change":"2024-06-06T02:33:56.555935+0000","last_active":"2024-06-06T02:34:24.944016+0000","last_peered":"2024-06-06T02:34:24.944016+0000","last_clean":"2024-06-06T02:34:24.944016+0000","last_became_active":"2024-06-06T02:33:56.555506+0000","last_became_peered":"2024-06-06T02:33:56.555506+0000","last_unstale":"2024-06-06T02:34:24.944016+0000","last_undegraded":"2024-06-06T02:34:24.944016+0000","last_fullsized":"2024-06-06T02:34:24.944016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:01:59.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725464+0000","last_change":"2024-06-06T02:34:00.613762+0000","last_active":"2024-06-06T02:36:14.725464+0000","last_peered":"2024-06-06T02:36:14.725464+0000","last_clean":"2024-06-06T02:36:14.725464+0000","last_became_active":"2024-06-06T02:34:00.612850+0000","last_became_peered":"2024-06-06T02:34:00.612850+0000","last_unstale":"2024-06-06T02:36:14.725464+0000","last_undegraded":"2024-06-06T02:36:14.725464+0000","last_fullsized":"2024-06-06T02:36:14.725464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:55:59.220458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.841147+0000","last_change":"2024-06-06T02:33:56.566326+0000","last_active":"2024-06-06T02:34:15.841147+0000","last_peered":"2024-06-06T02:34:15.841147+0000","last_clean":"2024-06-06T02:34:15.841147+0000","last_became_active":"2024-06-06T02:33:56.565889+0000","last_became_peered":"2024-06-06T02:33:56.565889+0000","last_unstale":"2024-06-06T02:34:15.841147+0000","last_undegraded":"2024-06-06T02:34:15.841147+0000","last_fullsized":"2024-06-06T02:34:15.841147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:59:14.516269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.724592+0000","last_change":"2024-06-06T02:34:00.618015+0000","last_active":"2024-06-06T02:36:14.724592+0000","last_peered":"2024-06-06T02:36:14.724592+0000","last_clean":"2024-06-06T02:36:14.724592+0000","last_became_active":"2024-06-06T02:34:00.614915+0000","last_became_peered":"2024-06-06T02:34:00.614915+0000","last_unstale":"2024-06-06T02:36:14.724592+0000","last_undegraded":"2024-06-06T02:36:14.724592+0000","last_fullsized":"2024-06-06T02:36:14.724592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:02:52.983778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944251+0000","last_change":"2024-06-06T02:33:56.556531+0000","last_active":"2024-06-06T02:34:24.944251+0000","last_peered":"2024-06-06T02:34:24.944251+0000","last_clean":"2024-06-06T02:34:24.944251+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944251+0000","last_undegraded":"2024-06-06T02:34:24.944251+0000","last_fullsized":"2024-06-06T02:34:24.944251+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:56:43.550746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752315+0000","last_change":"2024-06-06T02:34:00.628693+0000","last_active":"2024-06-06T02:36:14.752315+0000","last_peered":"2024-06-06T02:36:14.752315+0000","last_clean":"2024-06-06T02:36:14.752315+0000","last_became_active":"2024-06-06T02:34:00.628309+0000","last_became_peered":"2024-06-06T02:34:00.628309+0000","last_unstale":"2024-06-06T02:36:14.752315+0000","last_undegraded":"2024-06-06T02:36:14.752315+0000","last_fullsized":"2024-06-06T02:36:14.752315+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:08:32.105414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948916+0000","last_change":"2024-06-06T02:33:56.807088+0000","last_active":"2024-06-06T02:34:24.948916+0000","last_peered":"2024-06-06T02:34:24.948916+0000","last_clean":"2024-06-06T02:34:24.948916+0000","last_became_active":"2024-06-06T02:33:56.806682+0000","last_became_peered":"2024-06-06T02:33:56.806682+0000","last_unstale":"2024-06-06T02:34:24.948916+0000","last_undegraded":"2024-06-06T02:34:24.948916+0000","last_fullsized":"2024-06-06T02:34:24.948916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:02:47.919415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731854+0000","last_change":"2024-06-06T02:34:00.625533+0000","last_active":"2024-06-06T02:36:14.731854+0000","last_peered":"2024-06-06T02:36:14.731854+0000","last_clean":"2024-06-06T02:36:14.731854+0000","last_became_active":"2024-06-06T02:34:00.625128+0000","last_became_peered":"2024-06-06T02:34:00.625128+0000","last_unstale":"2024-06-06T02:36:14.731854+0000","last_undegraded":"2024-06-06T02:36:14.731854+0000","last_fullsized":"2024-06-06T02:36:14.731854+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:56:21.722304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:11.366061+0000","last_change":"2024-06-06T02:32:30.645030+0000","last_active":"2024-06-06T02:35:11.366061+0000","last_peered":"2024-06-06T02:35:11.366061+0000","last_clean":"2024-06-06T02:35:11.366061+0000","last_became_active":"2024-06-06T02:32:30.640418+0000","last_became_peered":"2024-06-06T02:32:30.640418+0000","last_unstale":"2024-06-06T02:35:11.366061+0000","last_undegraded":"2024-06-06T02:35:11.366061+0000","last_fullsized":"2024-06-06T02:35:11.366061+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:28:46.845487+0000","last_clean_scrub_stamp":"2024-06-06T02:28:46.845487+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:52:39.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945512+0000","last_change":"2024-06-06T02:33:56.569703+0000","last_active":"2024-06-06T02:34:24.945512+0000","last_peered":"2024-06-06T02:34:24.945512+0000","last_clean":"2024-06-06T02:34:24.945512+0000","last_became_active":"2024-06-06T02:33:56.569264+0000","last_became_peered":"2024-06-06T02:33:56.569264+0000","last_unstale":"2024-06-06T02:34:24.945512+0000","last_undegraded":"2024-06-06T02:34:24.945512+0000","last_fullsized":"2024-06-06T02:34:24.945512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:55:35.945009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.746789+0000","last_change":"2024-06-06T02:34:00.634587+0000","last_active":"2024-06-06T02:36:14.746789+0000","last_peered":"2024-06-06T02:36:14.746789+0000","last_clean":"2024-06-06T02:36:14.746789+0000","last_became_active":"2024-06-06T02:34:00.634085+0000","last_became_peered":"2024-06-06T02:34:00.634085+0000","last_unstale":"2024-06-06T02:36:14.746789+0000","last_undegraded":"2024-06-06T02:36:14.746789+0000","last_fullsized":"2024-06-06T02:36:14.746789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:46:25.009645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:56.371461+0000","last_change":"2024-06-06T02:33:56.556063+0000","last_active":"2024-06-06T02:35:56.371461+0000","last_peered":"2024-06-06T02:35:56.371461+0000","last_clean":"2024-06-06T02:35:56.371461+0000","last_became_active":"2024-06-06T02:33:56.555659+0000","last_became_peered":"2024-06-06T02:33:56.555659+0000","last_unstale":"2024-06-06T02:35:56.371461+0000","last_undegraded":"2024-06-06T02:35:56.371461+0000","last_fullsized":"2024-06-06T02:35:56.371461+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T05:41:50.236312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763060+0000","last_change":"2024-06-06T02:34:00.622001+0000","last_active":"2024-06-06T02:36:14.763060+0000","last_peered":"2024-06-06T02:36:14.763060+0000","last_clean":"2024-06-06T02:36:14.763060+0000","last_became_active":"2024-06-06T02:34:00.620526+0000","last_became_peered":"2024-06-06T02:34:00.620526+0000","last_unstale":"2024-06-06T02:36:14.763060+0000","last_undegraded":"2024-06-06T02:36:14.763060+0000","last_fullsized":"2024-06-06T02:36:14.763060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:11:43.496005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":248,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:59.440906+0000","last_change":"2024-06-06T02:33:56.807957+0000","last_active":"2024-06-06T02:37:59.440906+0000","last_peered":"2024-06-06T02:37:59.440906+0000","last_clean":"2024-06-06T02:37:59.440906+0000","last_became_active":"2024-06-06T02:33:56.806568+0000","last_became_peered":"2024-06-06T02:33:56.806568+0000","last_unstale":"2024-06-06T02:37:59.440906+0000","last_undegraded":"2024-06-06T02:37:59.440906+0000","last_fullsized":"2024-06-06T02:37:59.440906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T10:49:20.179156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":216,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.725995+0000","last_change":"2024-06-06T02:34:00.620143+0000","last_active":"2024-06-06T02:36:14.725995+0000","last_peered":"2024-06-06T02:36:14.725995+0000","last_clean":"2024-06-06T02:36:14.725995+0000","last_became_active":"2024-06-06T02:34:00.619778+0000","last_became_peered":"2024-06-06T02:34:00.619778+0000","last_unstale":"2024-06-06T02:36:14.725995+0000","last_undegraded":"2024-06-06T02:36:14.725995+0000","last_fullsized":"2024-06-06T02:36:14.725995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:25:17.583497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.924916+0000","last_change":"2024-06-06T02:33:56.559636+0000","last_active":"2024-06-06T02:34:21.924916+0000","last_peered":"2024-06-06T02:34:21.924916+0000","last_clean":"2024-06-06T02:34:21.924916+0000","last_became_active":"2024-06-06T02:33:56.559114+0000","last_became_peered":"2024-06-06T02:33:56.559114+0000","last_unstale":"2024-06-06T02:34:21.924916+0000","last_undegraded":"2024-06-06T02:34:21.924916+0000","last_fullsized":"2024-06-06T02:34:21.924916+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:44:42.489965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.761273+0000","last_change":"2024-06-06T02:34:00.613271+0000","last_active":"2024-06-06T02:36:14.761273+0000","last_peered":"2024-06-06T02:36:14.761273+0000","last_clean":"2024-06-06T02:36:14.761273+0000","last_became_active":"2024-06-06T02:34:00.612891+0000","last_became_peered":"2024-06-06T02:34:00.612891+0000","last_unstale":"2024-06-06T02:36:14.761273+0000","last_undegraded":"2024-06-06T02:36:14.761273+0000","last_fullsized":"2024-06-06T02:36:14.761273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T12:20:36.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.855684+0000","last_change":"2024-06-06T02:33:56.810221+0000","last_active":"2024-06-06T02:34:15.855684+0000","last_peered":"2024-06-06T02:34:15.855684+0000","last_clean":"2024-06-06T02:34:15.855684+0000","last_became_active":"2024-06-06T02:33:56.809831+0000","last_became_peered":"2024-06-06T02:33:56.809831+0000","last_unstale":"2024-06-06T02:34:15.855684+0000","last_undegraded":"2024-06-06T02:34:15.855684+0000","last_fullsized":"2024-06-06T02:34:15.855684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T14:14:40.380170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763995+0000","last_change":"2024-06-06T02:34:00.621581+0000","last_active":"2024-06-06T02:36:14.763995+0000","last_peered":"2024-06-06T02:36:14.763995+0000","last_clean":"2024-06-06T02:36:14.763995+0000","last_became_active":"2024-06-06T02:34:00.621197+0000","last_became_peered":"2024-06-06T02:34:00.621197+0000","last_unstale":"2024-06-06T02:36:14.763995+0000","last_undegraded":"2024-06-06T02:36:14.763995+0000","last_fullsized":"2024-06-06T02:36:14.763995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:51:34.763832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.945270+0000","last_change":"2024-06-06T02:33:56.806115+0000","last_active":"2024-06-06T02:34:24.945270+0000","last_peered":"2024-06-06T02:34:24.945270+0000","last_clean":"2024-06-06T02:34:24.945270+0000","last_became_active":"2024-06-06T02:33:56.805488+0000","last_became_peered":"2024-06-06T02:33:56.805488+0000","last_unstale":"2024-06-06T02:34:24.945270+0000","last_undegraded":"2024-06-06T02:34:24.945270+0000","last_fullsized":"2024-06-06T02:34:24.945270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:37:09.477581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767660+0000","last_change":"2024-06-06T02:34:00.625556+0000","last_active":"2024-06-06T02:36:14.767660+0000","last_peered":"2024-06-06T02:36:14.767660+0000","last_clean":"2024-06-06T02:36:14.767660+0000","last_became_active":"2024-06-06T02:34:00.622022+0000","last_became_peered":"2024-06-06T02:34:00.622022+0000","last_unstale":"2024-06-06T02:36:14.767660+0000","last_undegraded":"2024-06-06T02:36:14.767660+0000","last_fullsized":"2024-06-06T02:36:14.767660+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:32:47.709037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":42,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:37:55.676087+0000","last_change":"2024-06-06T02:33:56.569907+0000","last_active":"2024-06-06T02:37:55.676087+0000","last_peered":"2024-06-06T02:37:55.676087+0000","last_clean":"2024-06-06T02:37:55.676087+0000","last_became_active":"2024-06-06T02:33:56.568268+0000","last_became_peered":"2024-06-06T02:33:56.568268+0000","last_unstale":"2024-06-06T02:37:55.676087+0000","last_undegraded":"2024-06-06T02:37:55.676087+0000","last_fullsized":"2024-06-06T02:37:55.676087+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:26.127740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.752248+0000","last_change":"2024-06-06T02:34:00.611133+0000","last_active":"2024-06-06T02:36:14.752248+0000","last_peered":"2024-06-06T02:36:14.752248+0000","last_clean":"2024-06-06T02:36:14.752248+0000","last_became_active":"2024-06-06T02:34:00.610618+0000","last_became_peered":"2024-06-06T02:34:00.610618+0000","last_unstale":"2024-06-06T02:36:14.752248+0000","last_undegraded":"2024-06-06T02:36:14.752248+0000","last_fullsized":"2024-06-06T02:36:14.752248+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:58:48.821432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.909733+0000","last_change":"2024-06-06T02:33:56.804540+0000","last_active":"2024-06-06T02:34:20.909733+0000","last_peered":"2024-06-06T02:34:20.909733+0000","last_clean":"2024-06-06T02:34:20.909733+0000","last_became_active":"2024-06-06T02:33:56.804104+0000","last_became_peered":"2024-06-06T02:33:56.804104+0000","last_unstale":"2024-06-06T02:34:20.909733+0000","last_undegraded":"2024-06-06T02:34:20.909733+0000","last_fullsized":"2024-06-06T02:34:20.909733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:08:37.572661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760152+0000","last_change":"2024-06-06T02:34:00.629956+0000","last_active":"2024-06-06T02:36:14.760152+0000","last_peered":"2024-06-06T02:36:14.760152+0000","last_clean":"2024-06-06T02:36:14.760152+0000","last_became_active":"2024-06-06T02:34:00.629604+0000","last_became_peered":"2024-06-06T02:34:00.629604+0000","last_unstale":"2024-06-06T02:36:14.760152+0000","last_undegraded":"2024-06-06T02:36:14.760152+0000","last_fullsized":"2024-06-06T02:36:14.760152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:51:41.129160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.912238+0000","last_change":"2024-06-06T02:33:56.804907+0000","last_active":"2024-06-06T02:34:20.912238+0000","last_peered":"2024-06-06T02:34:20.912238+0000","last_clean":"2024-06-06T02:34:20.912238+0000","last_became_active":"2024-06-06T02:33:56.804374+0000","last_became_peered":"2024-06-06T02:33:56.804374+0000","last_unstale":"2024-06-06T02:34:20.912238+0000","last_undegraded":"2024-06-06T02:34:20.912238+0000","last_fullsized":"2024-06-06T02:34:20.912238+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:07:43.561724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.685646+0000","last_change":"2024-06-06T02:34:00.613340+0000","last_active":"2024-06-06T02:36:14.685646+0000","last_peered":"2024-06-06T02:36:14.685646+0000","last_clean":"2024-06-06T02:36:14.685646+0000","last_became_active":"2024-06-06T02:34:00.612985+0000","last_became_peered":"2024-06-06T02:34:00.612985+0000","last_unstale":"2024-06-06T02:36:14.685646+0000","last_undegraded":"2024-06-06T02:36:14.685646+0000","last_fullsized":"2024-06-06T02:36:14.685646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:11:58.330456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:20.914245+0000","last_change":"2024-06-06T02:33:56.570152+0000","last_active":"2024-06-06T02:34:20.914245+0000","last_peered":"2024-06-06T02:34:20.914245+0000","last_clean":"2024-06-06T02:34:20.914245+0000","last_became_active":"2024-06-06T02:33:56.569768+0000","last_became_peered":"2024-06-06T02:33:56.569768+0000","last_unstale":"2024-06-06T02:34:20.914245+0000","last_undegraded":"2024-06-06T02:34:20.914245+0000","last_fullsized":"2024-06-06T02:34:20.914245+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:05:29.134977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.760442+0000","last_change":"2024-06-06T02:34:00.615976+0000","last_active":"2024-06-06T02:36:14.760442+0000","last_peered":"2024-06-06T02:36:14.760442+0000","last_clean":"2024-06-06T02:36:14.760442+0000","last_became_active":"2024-06-06T02:34:00.615591+0000","last_became_peered":"2024-06-06T02:34:00.615591+0000","last_unstale":"2024-06-06T02:36:14.760442+0000","last_undegraded":"2024-06-06T02:36:14.760442+0000","last_fullsized":"2024-06-06T02:36:14.760442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T04:02:51.277200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.901156+0000","last_change":"2024-06-06T02:34:15.898844+0000","last_active":"2024-06-06T02:34:21.901156+0000","last_peered":"2024-06-06T02:34:21.901156+0000","last_clean":"2024-06-06T02:34:21.901156+0000","last_became_active":"2024-06-06T02:34:15.898405+0000","last_became_peered":"2024-06-06T02:34:15.898405+0000","last_unstale":"2024-06-06T02:34:21.901156+0000","last_undegraded":"2024-06-06T02:34:21.901156+0000","last_fullsized":"2024-06-06T02:34:21.901156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:21:09.424612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763061+0000","last_change":"2024-06-06T02:34:00.617039+0000","last_active":"2024-06-06T02:36:14.763061+0000","last_peered":"2024-06-06T02:36:14.763061+0000","last_clean":"2024-06-06T02:36:14.763061+0000","last_became_active":"2024-06-06T02:34:00.616475+0000","last_became_peered":"2024-06-06T02:34:00.616475+0000","last_unstale":"2024-06-06T02:36:14.763061+0000","last_undegraded":"2024-06-06T02:36:14.763061+0000","last_fullsized":"2024-06-06T02:36:14.763061+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:23:48.030914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.944083+0000","last_change":"2024-06-06T02:33:56.556475+0000","last_active":"2024-06-06T02:34:24.944083+0000","last_peered":"2024-06-06T02:34:24.944083+0000","last_clean":"2024-06-06T02:34:24.944083+0000","last_became_active":"2024-06-06T02:33:56.556108+0000","last_became_peered":"2024-06-06T02:33:56.556108+0000","last_unstale":"2024-06-06T02:34:24.944083+0000","last_undegraded":"2024-06-06T02:34:24.944083+0000","last_fullsized":"2024-06-06T02:34:24.944083+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T06:35:11.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.763467+0000","last_change":"2024-06-06T02:34:00.626729+0000","last_active":"2024-06-06T02:36:14.763467+0000","last_peered":"2024-06-06T02:36:14.763467+0000","last_clean":"2024-06-06T02:36:14.763467+0000","last_became_active":"2024-06-06T02:34:00.626143+0000","last_became_peered":"2024-06-06T02:34:00.626143+0000","last_unstale":"2024-06-06T02:36:14.763467+0000","last_undegraded":"2024-06-06T02:36:14.763467+0000","last_fullsized":"2024-06-06T02:36:14.763467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T11:01:51.893252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.731984+0000","last_change":"2024-06-06T02:34:00.625311+0000","last_active":"2024-06-06T02:36:14.731984+0000","last_peered":"2024-06-06T02:36:14.731984+0000","last_clean":"2024-06-06T02:36:14.731984+0000","last_became_active":"2024-06-06T02:34:00.624935+0000","last_became_peered":"2024-06-06T02:34:00.624935+0000","last_unstale":"2024-06-06T02:36:14.731984+0000","last_undegraded":"2024-06-06T02:36:14.731984+0000","last_fullsized":"2024-06-06T02:36:14.731984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:55:30.984929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:15.847090+0000","last_change":"2024-06-06T02:33:56.554745+0000","last_active":"2024-06-06T02:34:15.847090+0000","last_peered":"2024-06-06T02:34:15.847090+0000","last_clean":"2024-06-06T02:34:15.847090+0000","last_became_active":"2024-06-06T02:33:56.554302+0000","last_became_peered":"2024-06-06T02:33:56.554302+0000","last_unstale":"2024-06-06T02:34:15.847090+0000","last_undegraded":"2024-06-06T02:34:15.847090+0000","last_fullsized":"2024-06-06T02:34:15.847090+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T08:40:39.906021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767647+0000","last_change":"2024-06-06T02:34:00.621383+0000","last_active":"2024-06-06T02:36:14.767647+0000","last_peered":"2024-06-06T02:36:14.767647+0000","last_clean":"2024-06-06T02:36:14.767647+0000","last_became_active":"2024-06-06T02:34:00.620745+0000","last_became_peered":"2024-06-06T02:34:00.620745+0000","last_unstale":"2024-06-06T02:36:14.767647+0000","last_undegraded":"2024-06-06T02:36:14.767647+0000","last_fullsized":"2024-06-06T02:36:14.767647+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T03:20:03.567530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:21.917042+0000","last_change":"2024-06-06T02:34:15.851433+0000","last_active":"2024-06-06T02:34:21.917042+0000","last_peered":"2024-06-06T02:34:21.917042+0000","last_clean":"2024-06-06T02:34:21.917042+0000","last_became_active":"2024-06-06T02:34:15.847994+0000","last_became_peered":"2024-06-06T02:34:15.847994+0000","last_unstale":"2024-06-06T02:34:21.917042+0000","last_undegraded":"2024-06-06T02:34:21.917042+0000","last_fullsized":"2024-06-06T02:34:21.917042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T13:33:03.053642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.767683+0000","last_change":"2024-06-06T02:34:00.629502+0000","last_active":"2024-06-06T02:36:14.767683+0000","last_peered":"2024-06-06T02:36:14.767683+0000","last_clean":"2024-06-06T02:36:14.767683+0000","last_became_active":"2024-06-06T02:34:00.623719+0000","last_became_peered":"2024-06-06T02:34:00.623719+0000","last_unstale":"2024-06-06T02:36:14.767683+0000","last_undegraded":"2024-06-06T02:36:14.767683+0000","last_fullsized":"2024-06-06T02:36:14.767683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T02:59:23.273412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:35:58.879625+0000","last_change":"2024-06-06T02:33:56.804842+0000","last_active":"2024-06-06T02:35:58.879625+0000","last_peered":"2024-06-06T02:35:58.879625+0000","last_clean":"2024-06-06T02:35:58.879625+0000","last_became_active":"2024-06-06T02:33:56.804472+0000","last_became_peered":"2024-06-06T02:33:56.804472+0000","last_unstale":"2024-06-06T02:35:58.879625+0000","last_undegraded":"2024-06-06T02:35:58.879625+0000","last_fullsized":"2024-06-06T02:35:58.879625+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:51:15.658348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:36:14.745961+0000","last_change":"2024-06-06T02:34:00.624817+0000","last_active":"2024-06-06T02:36:14.745961+0000","last_peered":"2024-06-06T02:36:14.745961+0000","last_clean":"2024-06-06T02:36:14.745961+0000","last_became_active":"2024-06-06T02:34:00.624412+0000","last_became_peered":"2024-06-06T02:34:00.624412+0000","last_unstale":"2024-06-06T02:36:14.745961+0000","last_undegraded":"2024-06-06T02:36:14.745961+0000","last_fullsized":"2024-06-06T02:36:14.745961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:59.573407+0000","last_clean_scrub_stamp":"2024-06-06T02:33:59.573407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T09:50:06.833237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-06-06T02:34:24.948074+0000","last_change":"2024-06-06T02:33:56.567972+0000","last_active":"2024-06-06T02:34:24.948074+0000","last_peered":"2024-06-06T02:34:24.948074+0000","last_clean":"2024-06-06T02:34:24.948074+0000","last_became_active":"2024-06-06T02:33:56.567514+0000","last_became_peered":"2024-06-06T02:33:56.567514+0000","last_unstale":"2024-06-06T02:34:24.948074+0000","last_undegraded":"2024-06-06T02:34:24.948074+0000","last_fullsized":"2024-06-06T02:34:24.948074+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-06T02:33:55.522527+0000","last_clean_scrub_stamp":"2024-06-06T02:33:55.522527+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-07T07:56:08.478265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":77050,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1327,"num_read_kb":744,"num_write":181,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":231150,"data_compressed":5424,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":281370,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710783,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":425209,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907012,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1090130,"data_compressed":43370,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070538,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425445,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266768,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":880640,"data_stored":425365,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462999,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":929792,"data_stored":1017295,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":868352,"data_stored":424834,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822753,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1016588,"data_compressed":41562,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986277,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36264,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708888,"statfs":{"total":95995035648,"available":95957901312,"internally_reserved":0,"allocated":950272,"data_stored":498711,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425145,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411442,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":425977,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":937984,"data_stored":497676,"data_compressed":7589,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":888832,"data_stored":426105,"data_compressed":5781,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34155,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35781,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":73049,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":74084,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":75018,"data_compressed":1808,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-06T02:38:04.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:38:05.153 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:05.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:05 smithi082 ceph-mon[31579]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:05.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:05 smithi184 ceph-mon[36922]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:05.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:05 smithi103 ceph-mon[36349]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:06.527 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:06 smithi082 ceph-mon[31579]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:06.527 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:06 smithi082 ceph-mon[31579]: pgmap v455: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:06 smithi184 ceph-mon[36922]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:06 smithi184 ceph-mon[36922]: pgmap v455: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:06 smithi103 ceph-mon[36349]: from='client.25241 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-06T02:38:06.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:06 smithi103 ceph-mon[36349]: pgmap v455: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 -- 172.21.15.82:0/537477316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 msgr2=0x7fb91010efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 --2- 172.21.15.82:0/537477316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb91010efb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009ca0 tx=0x7fb8fc02a950 comp rx=0 tx=0).stop 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 -- 172.21.15.82:0/537477316 shutdown_connections 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 --2- 172.21.15.82:0/537477316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb910111910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 --2- 172.21.15.82:0/537477316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb91010efb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 --2- 172.21.15.82:0/537477316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb910074eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 -- 172.21.15.82:0/537477316 >> 172.21.15.82:0/537477316 conn(0x7fb910079cb0 msgr2=0x7fb91007a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 -- 172.21.15.82:0/537477316 shutdown_connections 2024-06-06T02:38:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.409+0000 7fb917e00640 1 -- 172.21.15.82:0/537477316 wait complete. 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.410+0000 7fb917e00640 1 Processor -- start 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.410+0000 7fb917e00640 1 -- start start 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb9101a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb9101a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb91019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb910115050 con 0x7fb9100753f0 2024-06-06T02:38:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb910114ed0 con 0x7fb91010f4f0 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb917e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101151d0 con 0x7fb910074aa0 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb915e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb91019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb914a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb9101a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb915400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb9101a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb915e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb91019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:44820/0 (socket says 172.21.15.82:44820) 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.411+0000 7fb915e00640 1 -- 172.21.15.82:0/2040597329 learned_addr learned my addr 172.21.15.82:0/2040597329 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 -- 172.21.15.82:0/2040597329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 msgr2=0x7fb91019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb91019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 -- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 msgr2=0x7fb9101a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb9101a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 -- 172.21.15.82:0/2040597329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91019bf30 con 0x7fb910074aa0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb915400640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb9101a16a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e9f0 tx=0x7fb90000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90000ccc0 con 0x7fb910074aa0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91019c220 con 0x7fb910074aa0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb900005020 con 0x7fb910074aa0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900004a00 con 0x7fb910074aa0 2024-06-06T02:38:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.412+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91019c6e0 con 0x7fb910074aa0 2024-06-06T02:38:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.414+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb910074eb0 con 0x7fb910074aa0 2024-06-06T02:38:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.416+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fb900004ba0 con 0x7fb910074aa0 2024-06-06T02:38:07.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.417+0000 7fb90e000640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 0x7fb8f40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.417+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb9000e2340 con 0x7fb910074aa0 2024-06-06T02:38:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.418+0000 7fb914a00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 0x7fb8f40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.418+0000 7fb914a00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 0x7fb8f40b4d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000f80 tx=0x7fb8fc004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:07.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.421+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb9000a9ec0 con 0x7fb910074aa0 2024-06-06T02:38:07.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.668+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb91019cdf0 con 0x7fb910074aa0 2024-06-06T02:38:07.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.669+0000 7fb90e000640 1 -- 172.21.15.82:0/2040597329 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11869 (secure 0 0 0) 0x7fb9000a97c0 con 0x7fb910074aa0 2024-06-06T02:38:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:07.670 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:37:56.246245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24659,24664,24676]},"id":1}]} 2024-06-06T02:38:07.670 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-06-06T02:38:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 msgr2=0x7fb8f40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 0x7fb8f40b4d90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc000f80 tx=0x7fb8fc004a60 comp rx=0 tx=0).stop 2024-06-06T02:38:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 msgr2=0x7fb9101a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:07.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb9101a16a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb90000e9f0 tx=0x7fb90000eeb0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 shutdown_connections 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb91010f4f0 0x7fb91019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9100753f0 0x7fb9101a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb8f40b2880 0x7fb8f40b4d90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 --2- 172.21.15.82:0/2040597329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb910074aa0 0x7fb9101a16a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 >> 172.21.15.82:0/2040597329 conn(0x7fb910079cb0 msgr2=0x7fb9100ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 shutdown_connections 2024-06-06T02:38:07.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:07.673+0000 7fb917e00640 1 -- 172.21.15.82:0/2040597329 wait complete. 2024-06-06T02:38:08.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:38:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:08 smithi184 ceph-mon[36922]: pgmap v456: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:08 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2040597329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:08.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:08 smithi082 ceph-mon[31579]: pgmap v456: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:08.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:08 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2040597329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:08 smithi103 ceph-mon[36349]: pgmap v456: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:08 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2040597329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:09.030 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:10.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:10 smithi082 ceph-mon[31579]: pgmap v457: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:10 smithi103 ceph-mon[36349]: pgmap v457: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:10.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:10 smithi184 ceph-mon[36922]: pgmap v457: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-06-06T02:38:11.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 -- 172.21.15.82:0/4092867931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10102490 msgr2=0x7f2e1010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 --2- 172.21.15.82:0/4092867931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10102490 0x7f2e1010e920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009ca0 tx=0x7f2e0802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 -- 172.21.15.82:0/4092867931 shutdown_connections 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 --2- 172.21.15.82:0/4092867931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10102490 0x7f2e1010e920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 --2- 172.21.15.82:0/4092867931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10101b40 0x7f2e10101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 --2- 172.21.15.82:0/4092867931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 0x7f2e10107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 -- 172.21.15.82:0/4092867931 >> 172.21.15.82:0/4092867931 conn(0x7f2e10078a80 msgr2=0x7f2e10078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 -- 172.21.15.82:0/4092867931 shutdown_connections 2024-06-06T02:38:11.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.244+0000 7f2e15e00640 1 -- 172.21.15.82:0/4092867931 wait complete. 2024-06-06T02:38:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.245+0000 7f2e15e00640 1 Processor -- start 2024-06-06T02:38:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.245+0000 7f2e15e00640 1 -- start start 2024-06-06T02:38:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 0x7f2e101a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:11.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 0x7f2e1019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e10111d60 con 0x7f2e10101b40 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e10111be0 con 0x7f2e10102490 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e15e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e10111ee0 con 0x7f2e10107b80 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e0ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e0ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45212/0 (socket says 172.21.15.82:45212) 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e0ea00640 1 -- 172.21.15.82:0/940937263 learned_addr learned my addr 172.21.15.82:0/940937263 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e07e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 0x7f2e101a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:11.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.246+0000 7f2e0f400640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 0x7f2e1019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 -- 172.21.15.82:0/940937263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 msgr2=0x7f2e1019b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 0x7f2e1019b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 -- 172.21.15.82:0/940937263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 msgr2=0x7f2e101a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 0x7f2e101a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 -- 172.21.15.82:0/940937263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1019bf60 con 0x7f2e10101b40 2024-06-06T02:38:11.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e07e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 0x7f2e101a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e0ea00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9c0 tx=0x7f2e0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0000cd80 con 0x7f2e10101b40 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e000035f0 con 0x7f2e10101b40 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.247+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00010690 con 0x7f2e10101b40 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.248+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1019c1f0 con 0x7f2e10101b40 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.248+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e101a8450 con 0x7f2e10101b40 2024-06-06T02:38:11.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.249+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e101031f0 con 0x7f2e10101b40 2024-06-06T02:38:11.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.251+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f2e000037a0 con 0x7f2e10101b40 2024-06-06T02:38:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.253+0000 7f2e14a00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 0x7f2df40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.253+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2e000e26e0 con 0x7f2e10101b40 2024-06-06T02:38:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.253+0000 7f2e07e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 0x7f2df40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:11.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.254+0000 7f2e07e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 0x7f2df40b4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e10106f40 tx=0x7f2df8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.257+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e000aa260 con 0x7f2e10101b40 2024-06-06T02:38:11.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.468+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e10101f50 con 0x7f2e10101b40 2024-06-06T02:38:11.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.472+0000 7f2e14a00640 1 -- 172.21.15.82:0/940937263 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7f2e000a9b60 con 0x7f2e10101b40 2024-06-06T02:38:11.473 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:11.473 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:38:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 msgr2=0x7f2df40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:11.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 0x7f2df40b4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e10106f40 tx=0x7f2df8005f90 comp rx=0 tx=0).stop 2024-06-06T02:38:11.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 msgr2=0x7f2e101a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:11.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000e9c0 tx=0x7f2e0000ee80 comp rx=0 tx=0).stop 2024-06-06T02:38:11.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 shutdown_connections 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2df40b2900 0x7f2df40b4e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e10107b80 0x7f2e1019b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e10102490 0x7f2e101a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 --2- 172.21.15.82:0/940937263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e10101b40 0x7f2e101a15f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.475+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 >> 172.21.15.82:0/940937263 conn(0x7f2e10078a80 msgr2=0x7f2e10100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.476+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 shutdown_connections 2024-06-06T02:38:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:11.476+0000 7f2e15e00640 1 -- 172.21.15.82:0/940937263 wait complete. 2024-06-06T02:38:12.396 DEBUG:tasks.fwd_scrub:Yielding 2024-06-06T02:38:12.397 INFO:teuthology.run_tasks:Running task background_exec... 2024-06-06T02:38:12.408 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:38:12.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-06-06T02:38:12.409 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-06-06T02:38:12.409 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T02:38:12.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T02:38:12.417 INFO:teuthology.run_tasks:Running task workunit... 2024-06-06T02:38:12.457 INFO:tasks.workunit:Pulling workunits from ref 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:38:12.457 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-06-06T02:38:12.457 INFO:tasks.workunit:timeout=3h 2024-06-06T02:38:12.457 INFO:tasks.workunit:cleanup=True 2024-06-06T02:38:12.458 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-06-06T02:38:12.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:12 smithi082 ceph-mon[31579]: pgmap v458: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:12.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:12 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/940937263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:38:12.499 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-06-06T02:38:12.499 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-06-06T02:38:12.499 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-06-06T02:38:12.499 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-06T02:38:12.499 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-06-06T02:38:12.500 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-06-06 02:34:43.982283275 +0000 2024-06-06T02:38:12.500 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-06-06 02:34:43.982283275 +0000 2024-06-06T02:38:12.500 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-06-06 02:37:55.086072487 +0000 2024-06-06T02:38:12.500 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-06-06 02:34:43.982283275 +0000 2024-06-06T02:38:12.500 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-06-06T02:38:12.500 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-06-06T02:38:12.620 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 2024-06-06T02:38:12.668 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-06-06T02:38:12.831 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:12 smithi103 ceph-mon[36349]: pgmap v458: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:12 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/940937263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:38:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:12 smithi184 ceph-mon[36922]: pgmap v458: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-06-06T02:38:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:12 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/940937263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:38:14.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:14 smithi082 ceph-mon[31579]: pgmap v459: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T02:38:14.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:14 smithi103 ceph-mon[36349]: pgmap v459: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T02:38:14.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:14 smithi184 ceph-mon[36922]: pgmap v459: 97 pgs: 97 active+clean; 652 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 -- 172.21.15.82:0/2718684887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf7010a1b0 msgr2=0x7faf70111b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 --2- 172.21.15.82:0/2718684887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf7010a1b0 0x7faf70111b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf68009d00 tx=0x7faf6802a910 comp rx=0 tx=0).stop 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 -- 172.21.15.82:0/2718684887 shutdown_connections 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 --2- 172.21.15.82:0/2718684887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf7010a1b0 0x7faf70111b10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 --2- 172.21.15.82:0/2718684887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf70109860 0x7faf70109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 --2- 172.21.15.82:0/2718684887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 0x7faf70105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 -- 172.21.15.82:0/2718684887 >> 172.21.15.82:0/2718684887 conn(0x7faf701009b0 msgr2=0x7faf70102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 -- 172.21.15.82:0/2718684887 shutdown_connections 2024-06-06T02:38:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.234+0000 7faf75e00640 1 -- 172.21.15.82:0/2718684887 wait complete. 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.235+0000 7faf75e00640 1 Processor -- start 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.235+0000 7faf75e00640 1 -- start start 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 0x7faf701a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 0x7faf7019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf70114ec0 con 0x7faf70109860 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf70114d40 con 0x7faf7010a1b0 2024-06-06T02:38:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faf70115040 con 0x7faf70104f30 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf67e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf67e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57438/0 (socket says 172.21.15.82:57438) 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 0x7faf701a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf67e00640 1 -- 172.21.15.82:0/928463012 learned_addr learned my addr 172.21.15.82:0/928463012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.236+0000 7faf75400640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 0x7faf7019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 -- 172.21.15.82:0/928463012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 msgr2=0x7faf701a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 0x7faf701a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 -- 172.21.15.82:0/928463012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 msgr2=0x7faf7019b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 0x7faf7019b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 -- 172.21.15.82:0/928463012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7019be60 con 0x7faf70109860 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf75400640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 0x7faf7019b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf67e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e970 tx=0x7faf5800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf6e000640 1 -- 172.21.15.82:0/928463012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5800cd80 con 0x7faf70109860 2024-06-06T02:38:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7019c150 con 0x7faf70109860 2024-06-06T02:38:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf6e000640 1 -- 172.21.15.82:0/928463012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf580035f0 con 0x7faf70109860 2024-06-06T02:38:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf6e000640 1 -- 172.21.15.82:0/928463012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58010690 con 0x7faf70109860 2024-06-06T02:38:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.237+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf701a8350 con 0x7faf70109860 2024-06-06T02:38:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.241+0000 7faf7da67740 1 Processor -- start 2024-06-06T02:38:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.241+0000 7faf7da67740 1 -- start start 2024-06-06T02:38:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.241+0000 7faf6e000640 1 -- 172.21.15.82:0/928463012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7faf58003aa0 con 0x7faf70109860 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0eff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0effaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5580c0e73c60 con 0x5580c0b59350 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5580c0e63200 con 0x5580c0b30490 2024-06-06T02:38:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf7da67740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5580c0e67240 con 0x5580c0b38670 2024-06-06T02:38:15.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42838/0 (socket says 172.21.15.82:42838) 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf74a00640 1 -- 172.21.15.82:0/793898933 learned_addr learned my addr 172.21.15.82:0/793898933 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf75400640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0eff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.242+0000 7faf67e00640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0effaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 -- 172.21.15.82:0/793898933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 msgr2=0x5580c0effaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0effaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 -- 172.21.15.82:0/793898933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 msgr2=0x5580c0eff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0eff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 -- 172.21.15.82:0/793898933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c0bc4930 con 0x5580c0b30490 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf67e00640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0effaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:15.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf75400640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0eff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:15.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.243+0000 7faf74a00640 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf60009cf0 tx=0x7faf60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e49e7bbb32c12c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf6e000640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 0x7faf540b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf66000640 1 -- 172.21.15.82:0/793898933 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60004230 con 0x5580c0b30490 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf66000640 1 -- 172.21.15.82:0/793898933 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf600043d0 con 0x5580c0b30490 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf66000640 1 -- 172.21.15.82:0/793898933 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60019820 con 0x5580c0b30490 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf6e000640 1 -- 172.21.15.82:0/928463012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7faf580e25f0 con 0x7faf70109860 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.244+0000 7faf75400640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 0x7faf540b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 -- 172.21.15.82:0/793898933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 msgr2=0x5580c0eff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf60009cf0 tx=0x7faf60011810 comp rx=0 tx=0).stop 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf75400640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 0x7faf540b4e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf68005e30 tx=0x7faf6802f3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 -- 172.21.15.82:0/793898933 shutdown_connections 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0effaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0eff5b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 --2- 172.21.15.82:0/793898933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0eff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 -- 172.21.15.82:0/793898933 >> 172.21.15.82:0/793898933 conn(0x5580c0b4d740 msgr2=0x5580c0efb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 -- 172.21.15.82:0/793898933 shutdown_connections 2024-06-06T02:38:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.245+0000 7faf7da67740 1 -- 172.21.15.82:0/793898933 wait complete. 2024-06-06T02:38:15.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.246+0000 7faf7da67740 1 -- start start 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.246+0000 7faf7da67740 1 Processor -- start 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f0f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5580c0cc7890 con 0x5580c0b59350 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5580c0e002c0 con 0x5580c0b30490 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5580c0f0c1e0 con 0x5580c0b38670 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf7da67740 10 client.0 _ll_register_callbacks cb 0x5580c0e05430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf75400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f0f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf67e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf74a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42840/0 (socket says 172.21.15.82:42840) 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf74a00640 1 -- 172.21.15.82:0/2752497413 learned_addr learned my addr 172.21.15.82:0/2752497413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.247+0000 7faf67e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50426/0 (socket says 172.21.15.82:50426) 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 -- 172.21.15.82:0/2752497413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 msgr2=0x5580c0f097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 -- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 msgr2=0x5580c0f0f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f0f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 -- 172.21.15.82:0/2752497413 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c0f0fad0 con 0x5580c0b38670 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf74a00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf67e00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf580dff60 tx=0x7faf580a59f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c73d2025df457d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf580a91e0 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7faf580b2440 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf600043d0 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.248+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf580a9580 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 10 client.25297 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5580c0f18590 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf600043d0 con 0x5580c0b38670 2024-06-06T02:38:15.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7faf580cc0d0 con 0x5580c0b38670 2024-06-06T02:38:15.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 10 client.25297 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 10 client.25297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 20 client.25297 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0b17cd0 0x5580c0f1ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 4 client.25297 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.249+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580c0e75bb0 con 0x5580c0b17cd0 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.250+0000 7faf74a00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0b17cd0 0x5580c0f1ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.250+0000 7faf74a00640 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0b17cd0 0x5580c0f1ba60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172a0ed137bdd679 server_cookie=a4c177d1203f4b9a in_seq=0 out_seq=0 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.250+0000 7faf5ea00640 10 client.25297 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf5ea00640 1 -- 172.21.15.82:0/2752497413 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5580c0e75bb0 con 0x5580c0b17cd0 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf5ea00640 10 client.25297 handle_command_reply: tid=0 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 client.25297 shutdown 2024-06-06T02:38:15.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 msgr2=0x5580c0f09d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf580dff60 tx=0x7faf580a59f0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 shutdown_connections 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0b17cd0 0x5580c0f1ba60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f0f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b38670 0x5580c0f09d20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf5ea00640 0 client.25297 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 --2- 172.21.15.82:0/2752497413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b30490 0x5580c0f097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.251+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 >> 172.21.15.82:0/2752497413 conn(0x5580c0b4d740 msgr2=0x5580c0f00df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.252+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 shutdown_connections 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.252+0000 7faf7da67740 1 -- 172.21.15.82:0/2752497413 wait complete. 2024-06-06T02:38:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.252+0000 7faf7da67740 20 client.25297 trim_cache size 0 max 16384 2024-06-06T02:38:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 Processor -- start 2024-06-06T02:38:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 -- start start 2024-06-06T02:38:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 0x5580c0f0f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf701b3280 con 0x5580c0b59350 2024-06-06T02:38:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf701b0b50 con 0x5580c0b38670 2024-06-06T02:38:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.272+0000 7faf7da67740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faf701ae980 con 0x5580c0b30490 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50432/0 (socket says 172.21.15.82:50432) 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf74a00640 1 -- 172.21.15.82:0/4249401852 learned_addr learned my addr 172.21.15.82:0/4249401852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57476/0 (socket says 172.21.15.82:57476) 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf67e00640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 0x5580c0f0f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 -- 172.21.15.82:0/4249401852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 msgr2=0x5580c0f04de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 -- 172.21.15.82:0/4249401852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 msgr2=0x5580c0f0f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 0x5580c0f0f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf75400640 1 -- 172.21.15.82:0/4249401852 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c0f08590 con 0x5580c0b59350 2024-06-06T02:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf67e00640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 0x5580c0f0f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.273+0000 7faf74a00640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.274+0000 7faf75400640 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5580c0efc290 tx=0x7faf68041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8684e43ae373c99 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.274+0000 7faf65600640 1 -- 172.21.15.82:0/4249401852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68003970 con 0x5580c0b59350 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.274+0000 7faf65600640 1 -- 172.21.15.82:0/4249401852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf68036040 con 0x5580c0b59350 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.274+0000 7faf65600640 1 -- 172.21.15.82:0/4249401852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6802f880 con 0x5580c0b59350 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 -- 172.21.15.82:0/4249401852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 msgr2=0x5580c0f16400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x5580c0efc290 tx=0x7faf68041000 comp rx=0 tx=0).stop 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 -- 172.21.15.82:0/4249401852 shutdown_connections 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b59350 0x5580c0f16400 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b38670 0x5580c0f0f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 --2- 172.21.15.82:0/4249401852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f04de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.275+0000 7faf7da67740 1 -- 172.21.15.82:0/4249401852 >> 172.21.15.82:0/4249401852 conn(0x5580c0b4d740 msgr2=0x5580c0f01660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.276+0000 7faf7da67740 1 -- 172.21.15.82:0/4249401852 shutdown_connections 2024-06-06T02:38:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.276+0000 7faf7da67740 1 -- 172.21.15.82:0/4249401852 wait complete. 2024-06-06T02:38:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.276+0000 7faf7da67740 1 -- start start 2024-06-06T02:38:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.276+0000 7faf7da67740 1 Processor -- start 2024-06-06T02:38:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b38670 0x5580c0f10a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 0x5580c0f14720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf701af010 con 0x5580c0b38670 2024-06-06T02:38:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf701b0480 con 0x5580c0b59350 2024-06-06T02:38:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7faf701af6e0 con 0x5580c0b30490 2024-06-06T02:38:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf7da67740 10 client.0 _ll_register_callbacks cb 0x7faf58009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf67e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b38670 0x5580c0f10a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf74a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50440/0 (socket says 172.21.15.82:50440) 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.277+0000 7faf74a00640 1 -- 172.21.15.82:0/440174793 learned_addr learned my addr 172.21.15.82:0/440174793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf75400640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 0x5580c0f14720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 -- 172.21.15.82:0/440174793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 msgr2=0x5580c0f14720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 0x5580c0f14720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 -- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b38670 msgr2=0x5580c0f10a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b38670 0x5580c0f10a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 -- 172.21.15.82:0/440174793 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c0f14c90 con 0x5580c0b30490 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf75400640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 0x5580c0f14720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf74a00640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5580c0f08e70 tx=0x7faf60003800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab3ad30e991e945 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.278+0000 7faf5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60005240 con 0x5580c0b30490 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf68036040 con 0x5580c0b30490 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7faf600053e0 con 0x5580c0b30490 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf6003b050 con 0x5580c0b30490 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf7da67740 10 client.25303 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.279+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5580c0f84a40 con 0x5580c0b30490 2024-06-06T02:38:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf68036040 con 0x5580c0b30490 2024-06-06T02:38:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7faf60019a00 con 0x5580c0b30490 2024-06-06T02:38:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 10 client.25303 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 20 client.25303 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0aed080 0x5580c0f87040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 4 client.25303 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5580c0e71650 con 0x5580c0aed080 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.280+0000 7faf67e00640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0aed080 0x5580c0f87040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.281+0000 7faf67e00640 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0aed080 0x5580c0f87040 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1d9654867aec833 server_cookie=2a4234811801deef in_seq=0 out_seq=0 2024-06-06T02:38:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.281+0000 7faf5ea00640 10 client.25303 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.282+0000 7faf5ea00640 1 -- 172.21.15.82:0/440174793 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5580c0e71650 con 0x5580c0aed080 2024-06-06T02:38:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.282+0000 7faf5ea00640 10 client.25303 handle_command_reply: tid=0 2024-06-06T02:38:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.282+0000 7faf7da67740 1 client.25303 shutdown 2024-06-06T02:38:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 msgr2=0x5580c0f10510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5580c0f08e70 tx=0x7faf60003800 comp rx=0 tx=0).stop 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 shutdown_connections 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5580c0b59350 0x5580c0f14720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5580c0aed080 0x5580c0f87040 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5580c0b38670 0x5580c0f10a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 --2- 172.21.15.82:0/440174793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5580c0b30490 0x5580c0f10510 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 >> 172.21.15.82:0/440174793 conn(0x5580c0b4d740 msgr2=0x5580c0f0acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf5ea00640 0 client.25303 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 shutdown_connections 2024-06-06T02:38:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.283+0000 7faf7da67740 1 -- 172.21.15.82:0/440174793 wait complete. 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.284+0000 7faf7da67740 20 client.25303 trim_cache size 0 max 16384 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "11ec6d79-888d-4665-8bee-8f8a527b6a9d", 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-06-06T02:38:15.285 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 msgr2=0x7faf540b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 0x7faf540b4e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faf68005e30 tx=0x7faf6802f3c0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 msgr2=0x7faf701a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf5800e970 tx=0x7faf5800ee30 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 shutdown_connections 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf7010a1b0 0x7faf7019b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf70109860 0x7faf701a1ae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7faf540b2900 0x7faf540b4e10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 --2- 172.21.15.82:0/928463012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf70104f30 0x7faf701a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.285+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 >> 172.21.15.82:0/928463012 conn(0x7faf701009b0 msgr2=0x7faf70102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.286+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 shutdown_connections 2024-06-06T02:38:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:15.286+0000 7faf75e00640 1 -- 172.21.15.82:0/928463012 wait complete. 2024-06-06T02:38:16.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:38:16.582 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:16.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:16 smithi082 ceph-mon[31579]: pgmap v460: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:38:16.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:16 smithi082 ceph-mon[31579]: scrub queued for path: / 2024-06-06T02:38:16.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:16 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:16.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:16 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:38:16.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:16 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:16 smithi103 ceph-mon[36349]: pgmap v460: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:38:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:16 smithi103 ceph-mon[36349]: scrub queued for path: / 2024-06-06T02:38:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:16.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:16 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:38:16.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:16 smithi184 ceph-mon[36922]: pgmap v460: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:38:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:16 smithi184 ceph-mon[36922]: scrub queued for path: / 2024-06-06T02:38:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:16 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:16 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:38:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:16 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:38:18.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:18 smithi082 ceph-mon[31579]: pgmap v461: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:18 smithi103 ceph-mon[36349]: pgmap v461: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:18.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:18 smithi184 ceph-mon[36922]: pgmap v461: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 -- 172.21.15.82:0/1903070211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635810a1a0 msgr2=0x7f6358111b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 --2- 172.21.15.82:0/1903070211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635810a1a0 0x7f6358111b00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6350009cd0 tx=0x7f635002a8f0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 -- 172.21.15.82:0/1903070211 shutdown_connections 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 --2- 172.21.15.82:0/1903070211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635810a1a0 0x7f6358111b00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 --2- 172.21.15.82:0/1903070211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6358109850 0x7f6358109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 --2- 172.21.15.82:0/1903070211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358104f20 0x7f6358105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 -- 172.21.15.82:0/1903070211 >> 172.21.15.82:0/1903070211 conn(0x7f6358100a00 msgr2=0x7f6358102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 -- 172.21.15.82:0/1903070211 shutdown_connections 2024-06-06T02:38:18.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.922+0000 7f635de00640 1 -- 172.21.15.82:0/1903070211 wait complete. 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.923+0000 7f635de00640 1 Processor -- start 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 -- start start 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358109850 0x7f63581a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635810a1a0 0x7f635819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6358114eb0 con 0x7f6358109850 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6358114d30 con 0x7f635810a1a0 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635de00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6358115030 con 0x7f6358104f20 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f6357e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358109850 0x7f63581a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.924+0000 7f635ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50462/0 (socket says 172.21.15.82:50462) 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 -- 172.21.15.82:0/926025505 learned_addr learned my addr 172.21.15.82:0/926025505 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635d400640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635810a1a0 0x7f635819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 -- 172.21.15.82:0/926025505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635810a1a0 msgr2=0x7f635819b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635810a1a0 0x7f635819b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 -- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358109850 msgr2=0x7f63581a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358109850 0x7f63581a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 -- 172.21.15.82:0/926025505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635819be10 con 0x7f6358104f20 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.925+0000 7f635ca00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c00ea60 tx=0x7f634c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.926+0000 7f6355600640 1 -- 172.21.15.82:0/926025505 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c00cde0 con 0x7f6358104f20 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.926+0000 7f6355600640 1 -- 172.21.15.82:0/926025505 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f634c0035f0 con 0x7f6358104f20 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.926+0000 7f6355600640 1 -- 172.21.15.82:0/926025505 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c010690 con 0x7f6358104f20 2024-06-06T02:38:18.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.926+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635819c100 con 0x7f6358104f20 2024-06-06T02:38:18.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.926+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63581a8300 con 0x7f6358104f20 2024-06-06T02:38:18.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.929+0000 7f6365a04740 1 Processor -- start 2024-06-06T02:38:18.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.929+0000 7f6365a04740 1 -- start start 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b902f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c601b0 0x5591b902fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5591b8fa3e00 con 0x5591b8c601b0 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5591b8f933a0 con 0x5591b8c68390 2024-06-06T02:38:18.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6365a04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5591b8f973e0 con 0x5591b8c89070 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6357e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f635d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b902f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6357e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42878/0 (socket says 172.21.15.82:42878) 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f635d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b902f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50476/0 (socket says 172.21.15.82:50476) 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6357e00640 1 -- 172.21.15.82:0/2624338105 learned_addr learned my addr 172.21.15.82:0/2624338105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.930+0000 7f6355600640 1 -- 172.21.15.82:0/926025505 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f634c0037a0 con 0x7f6358104f20 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 -- 172.21.15.82:0/2624338105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 msgr2=0x5591b902f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b902f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 -- 172.21.15.82:0/2624338105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c601b0 msgr2=0x5591b902fa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c601b0 0x5591b902fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 -- 172.21.15.82:0/2624338105 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b8cf4650 con 0x5591b8c68390 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.931+0000 7f6357e00640 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6344009c20 tx=0x7f6344011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47502564a085aec server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.932+0000 7f634a000640 1 -- 172.21.15.82:0/2624338105 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344004050 con 0x5591b8c68390 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.932+0000 7f634a000640 1 -- 172.21.15.82:0/2624338105 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63440054d0 con 0x5591b8c68390 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.932+0000 7f634a000640 1 -- 172.21.15.82:0/2624338105 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344004ca0 con 0x5591b8c68390 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.932+0000 7f6355600640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 0x7f63400b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6355600640 1 -- 172.21.15.82:0/926025505 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f634c0e2690 con 0x7f6358104f20 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f635d400640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 0x7f63400b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 -- 172.21.15.82:0/2624338105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 msgr2=0x5591b902ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6344009c20 tx=0x7f6344011810 comp rx=0 tx=0).stop 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 -- 172.21.15.82:0/2624338105 shutdown_connections 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c68390 0x5591b902ffc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c601b0 0x5591b902fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 --2- 172.21.15.82:0/2624338105 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b902f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.933+0000 7f6365a04740 1 -- 172.21.15.82:0/2624338105 >> 172.21.15.82:0/2624338105 conn(0x5591b8c7d460 msgr2=0x5591b902bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.934+0000 7f6365a04740 1 -- 172.21.15.82:0/2624338105 shutdown_connections 2024-06-06T02:38:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.934+0000 7f6365a04740 1 -- 172.21.15.82:0/2624338105 wait complete. 2024-06-06T02:38:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.934+0000 7f635d400640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 0x7f63400b4e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5591b902c760 tx=0x7f6350005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.934+0000 7f6365a04740 1 -- start start 2024-06-06T02:38:18.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 Processor -- start 2024-06-06T02:38:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b903a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c89070 0x5591b903fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5591b8df7700 con 0x5591b8c68390 2024-06-06T02:38:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5591b8f30700 con 0x5591b8c89070 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5591b903c6b0 con 0x5591b8c601b0 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6365a04740 10 client.0 _ll_register_callbacks cb 0x5591b8f3cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.935+0000 7f6357e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b903a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c89070 0x5591b903fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50492/0 (socket says 172.21.15.82:50492) 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 -- 172.21.15.82:0/3959092288 learned_addr learned my addr 172.21.15.82:0/3959092288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 -- 172.21.15.82:0/3959092288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c89070 msgr2=0x5591b903fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c89070 0x5591b903fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 -- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 msgr2=0x5591b903a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b903a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 -- 172.21.15.82:0/3959092288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b8f5bfb0 con 0x5591b8c601b0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f6357e00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b903a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f635ca00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f634c0a6dc0 tx=0x7f634c003cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdbcdbc31d3085f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.936+0000 7f633ea00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c0aa250 con 0x5591b8c601b0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f634c0a6140 con 0x5591b8c601b0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63440054d0 con 0x5591b8c601b0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f634c0a9b50 con 0x5591b8c601b0 2024-06-06T02:38:18.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f6365a04740 10 client.25315 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5591b90487e0 con 0x5591b8c601b0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63440054d0 con 0x5591b8c601b0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.937+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f634c0a5de0 con 0x5591b8c601b0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 10 client.25315 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 10 client.25315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 20 client.25315 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c479f0 0x5591b904bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 4 client.25315 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591b8fa5d50 con 0x5591b8c479f0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.938+0000 7f6357e00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c479f0 0x5591b904bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.939+0000 7f6357e00640 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c479f0 0x5591b904bcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b599816a0d016c server_cookie=764225480834605c in_seq=0 out_seq=0 2024-06-06T02:38:18.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.939+0000 7f633ea00640 10 client.25315 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f633ea00640 1 -- 172.21.15.82:0/3959092288 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5591b8fa5d50 con 0x5591b8c479f0 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f633ea00640 10 client.25315 handle_command_reply: tid=0 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 client.25315 shutdown 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 msgr2=0x5591b9039c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f634c0a6dc0 tx=0x7f634c003cf0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 shutdown_connections 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c89070 0x5591b903fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c479f0 0x5591b904bcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b903a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 --2- 172.21.15.82:0/3959092288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c601b0 0x5591b9039c40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f633ea00640 0 client.25315 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.940+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 >> 172.21.15.82:0/3959092288 conn(0x5591b8c7d460 msgr2=0x5591b90312c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.941+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 shutdown_connections 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.941+0000 7f6365a04740 1 -- 172.21.15.82:0/3959092288 wait complete. 2024-06-06T02:38:18.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.941+0000 7f6365a04740 20 client.25315 trim_cache size 0 max 16384 2024-06-06T02:38:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.973+0000 7f6365a04740 1 Processor -- start 2024-06-06T02:38:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.973+0000 7f6365a04740 1 -- start start 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b9033890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c89070 0x5591b9051430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63581b3140 con 0x5591b8c89070 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63581b0a10 con 0x5591b8c601b0 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6365a04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63581ae840 con 0x5591b8c68390 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6357e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f635d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c89070 0x5591b9051430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6357e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50500/0 (socket says 172.21.15.82:50500) 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f6357e00640 1 -- 172.21.15.82:0/3880175284 learned_addr learned my addr 172.21.15.82:0/3880175284 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.974+0000 7f635ca00640 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b9033890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 -- 172.21.15.82:0/3880175284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 msgr2=0x5591b9033890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b9033890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 -- 172.21.15.82:0/3880175284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c89070 msgr2=0x5591b9051430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c89070 0x5591b9051430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 -- 172.21.15.82:0/3880175284 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b9030940 con 0x5591b8c68390 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6357e00640 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6344004650 tx=0x7f63440096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b7069c234b6fb9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6349600640 1 -- 172.21.15.82:0/3880175284 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344033070 con 0x5591b8c68390 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.975+0000 7f6349600640 1 -- 172.21.15.82:0/3880175284 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63440043d0 con 0x5591b8c68390 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.976+0000 7f6349600640 1 -- 172.21.15.82:0/3880175284 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634402d740 con 0x5591b8c68390 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.976+0000 7f6365a04740 1 -- 172.21.15.82:0/3880175284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 msgr2=0x5591b903f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.976+0000 7f6365a04740 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6344004650 tx=0x7f63440096a0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 -- 172.21.15.82:0/3880175284 shutdown_connections 2024-06-06T02:38:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c89070 0x5591b9051430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c68390 0x5591b903f920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 --2- 172.21.15.82:0/3880175284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b9033890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 -- 172.21.15.82:0/3880175284 >> 172.21.15.82:0/3880175284 conn(0x5591b8c7d460 msgr2=0x5591b9033180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 -- 172.21.15.82:0/3880175284 shutdown_connections 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.977+0000 7f6365a04740 1 -- 172.21.15.82:0/3880175284 wait complete. 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.978+0000 7f6365a04740 1 -- start start 2024-06-06T02:38:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.978+0000 7f6365a04740 1 Processor -- start 2024-06-06T02:38:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b90460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b9041530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63581aeed0 con 0x5591b8c68390 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63581b0340 con 0x5591b8c601b0 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63581af5a0 con 0x5591b8c89070 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6365a04740 10 client.0 _ll_register_callbacks cb 0x7f634c004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6357e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6357e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57530/0 (socket says 172.21.15.82:57530) 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f6357e00640 1 -- 172.21.15.82:0/2900793642 learned_addr learned my addr 172.21.15.82:0/2900793642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f635ca00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b90460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.979+0000 7f635d400640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b9041530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 -- 172.21.15.82:0/2900793642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 msgr2=0x5591b9041530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b9041530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 -- 172.21.15.82:0/2900793642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 msgr2=0x5591b90460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b90460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 -- 172.21.15.82:0/2900793642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b9041ca0 con 0x5591b8c68390 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f6357e00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6344003f90 tx=0x7f6344003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770cbc1d6df33b63 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f633ea00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344033040 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.980+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6344003910 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.981+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63440043d0 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.981+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6344005b90 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.981+0000 7f6365a04740 10 client.15153 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.981+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5591b90b3f30 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.981+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63440043d0 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f6344019430 con 0x5591b8c68390 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 10 client.15153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 20 client.15153 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c1cda0 0x5591b90b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 4 client.15153 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:38:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591b8fa17f0 con 0x5591b8c1cda0 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.982+0000 7f635ca00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c1cda0 0x5591b90b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.983+0000 7f633ea00640 10 client.15153 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.983+0000 7f635ca00640 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c1cda0 0x5591b90b6340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0a5e025f1a8ff5f server_cookie=7783862659ac3d77 in_seq=0 out_seq=0 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.983+0000 7f633ea00640 1 -- 172.21.15.82:0/2900793642 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5591b8fa17f0 con 0x5591b8c1cda0 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.983+0000 7f633ea00640 10 client.15153 handle_command_reply: tid=0 2024-06-06T02:38:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.983+0000 7f6365a04740 1 client.15153 shutdown 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 msgr2=0x5591b9046620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6344003f90 tx=0x7f6344003820 comp rx=0 tx=0).stop 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 shutdown_connections 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5591b8c89070 0x5591b9041530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5591b8c1cda0 0x5591b90b6340 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591b8c68390 0x5591b9046620 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 --2- 172.21.15.82:0/2900793642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5591b8c601b0 0x5591b90460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 >> 172.21.15.82:0/2900793642 conn(0x5591b8c7d460 msgr2=0x5591b903aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f633ea00640 0 client.15153 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 shutdown_connections 2024-06-06T02:38:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 1 -- 172.21.15.82:0/2900793642 wait complete. 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.984+0000 7f6365a04740 20 client.15153 trim_cache size 0 max 16384 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "11ec6d79-888d-4665-8bee-8f8a527b6a9d": { 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "11ec6d79-888d-4665-8bee-8f8a527b6a9d", 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-06-06T02:38:18.987 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 msgr2=0x7f63400b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 0x7f63400b4e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5591b902c760 tx=0x7f6350005c30 comp rx=0 tx=0).stop 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 msgr2=0x7f63581a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c00ea60 tx=0x7f634c00ef20 comp rx=0 tx=0).stop 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 shutdown_connections 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f635810a1a0 0x7f635819b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6358109850 0x7f63581a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f63400b2900 0x7f63400b4e10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 --2- 172.21.15.82:0/926025505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6358104f20 0x7f63581a1550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.985+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 >> 172.21.15.82:0/926025505 conn(0x7f6358100a00 msgr2=0x7f6358102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.986+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 shutdown_connections 2024-06-06T02:38:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:18.986+0000 7f635de00640 1 -- 172.21.15.82:0/926025505 wait complete. 2024-06-06T02:38:19.801 INFO:tasks.cephfs.filesystem:scrub status for tag:11ec6d79-888d-4665-8bee-8f8a527b6a9d - {'path': '/', 'tag': '11ec6d79-888d-4665-8bee-8f8a527b6a9d', 'options': 'recursive,force'} 2024-06-06T02:38:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:20 smithi103 ceph-mon[36349]: pgmap v462: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:20 smithi082 ceph-mon[31579]: pgmap v462: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:20.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:20 smithi184 ceph-mon[36922]: pgmap v462: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:22 smithi103 ceph-mon[36349]: pgmap v463: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T02:38:22.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:22 smithi082 ceph-mon[31579]: pgmap v463: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T02:38:22.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:22 smithi184 ceph-mon[36922]: pgmap v463: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 853 B/s wr, 7 op/s 2024-06-06T02:38:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:24 smithi103 ceph-mon[36349]: pgmap v464: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:24.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:24 smithi082 ceph-mon[31579]: pgmap v464: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:24.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:24 smithi184 ceph-mon[36922]: pgmap v464: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 852 B/s wr, 6 op/s 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 -- 172.21.15.82:0/2439391873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8103af0 msgr2=0x7f8ff8103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 --2- 172.21.15.82:0/2439391873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8103af0 0x7f8ff8103f00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009900 tx=0x7f8fe402a3f0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 -- 172.21.15.82:0/2439391873 shutdown_connections 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 --2- 172.21.15.82:0/2439391873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8104440 0x7f8ff810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 --2- 172.21.15.82:0/2439391873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8103af0 0x7f8ff8103f00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 --2- 172.21.15.82:0/2439391873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff8102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 -- 172.21.15.82:0/2439391873 >> 172.21.15.82:0/2439391873 conn(0x7f8ff80fe1d0 msgr2=0x7f8ff8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.721+0000 7f8ff7200640 1 -- 172.21.15.82:0/2439391873 shutdown_connections 2024-06-06T02:38:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.722+0000 7f8ff7200640 1 -- 172.21.15.82:0/2439391873 wait complete. 2024-06-06T02:38:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 Processor -- start 2024-06-06T02:38:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 -- start start 2024-06-06T02:38:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 0x7f8ff819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8104440 0x7f8ff81a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810e510 con 0x7f8ff8104440 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810e390 con 0x7f8ff8103af0 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.723+0000 7f8ff7200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810e690 con 0x7f8ff81029d0 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53516/0 (socket says 172.21.15.82:53516) 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 -- 172.21.15.82:0/1817741897 learned_addr learned my addr 172.21.15.82:0/1817741897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff6800640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8104440 0x7f8ff81a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5400640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 0x7f8ff819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 -- 172.21.15.82:0/1817741897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 msgr2=0x7f8ff819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 0x7f8ff819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 -- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8104440 msgr2=0x7f8ff81a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8104440 0x7f8ff81a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5e00640 1 -- 172.21.15.82:0/1817741897 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff81a2eb0 con 0x7f8ff81029d0 2024-06-06T02:38:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.724+0000 7f8ff5400640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 0x7f8ff819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9f0 tx=0x7f8fe800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8feea00640 1 -- 172.21.15.82:0/1817741897 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800ccc0 con 0x7f8ff81029d0 2024-06-06T02:38:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8feea00640 1 -- 172.21.15.82:0/1817741897 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe80054d0 con 0x7f8ff81029d0 2024-06-06T02:38:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81a31a0 con 0x7f8ff81029d0 2024-06-06T02:38:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8feea00640 1 -- 172.21.15.82:0/1817741897 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8010430 con 0x7f8ff81029d0 2024-06-06T02:38:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.725+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81a36a0 con 0x7f8ff81029d0 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.728+0000 7f9003994740 1 Processor -- start 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.728+0000 7f9003994740 1 -- start start 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x56193216e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5619320e0480 con 0x561931da84d0 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5619320cfa20 con 0x561931dc91b0 2024-06-06T02:38:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f9003994740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5619320d3a60 con 0x561931da02f0 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f8ff5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f8ff6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f8ff6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60794/0 (socket says 172.21.15.82:60794) 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f8ff6800640 1 -- 172.21.15.82:0/3411309068 learned_addr learned my addr 172.21.15.82:0/3411309068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.729+0000 7f8ff5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44764/0 (socket says 172.21.15.82:44764) 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 -- 172.21.15.82:0/3411309068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 msgr2=0x56193216e480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:38:25.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x56193216e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 -- 172.21.15.82:0/3411309068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 msgr2=0x56193216df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 -- 172.21.15.82:0/3411309068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619320cc8d0 con 0x561931da84d0 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff6800640 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8ff5400640 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ff819c410 tx=0x7f8fe4031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d79bb6dd019d7af server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.730+0000 7f8fe3000640 1 -- 172.21.15.82:0/3411309068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4035030 con 0x561931da84d0 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.731+0000 7f8fe3000640 1 -- 172.21.15.82:0/3411309068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe4031cd0 con 0x561931da84d0 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.731+0000 7f8fe3000640 1 -- 172.21.15.82:0/3411309068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40046c0 con 0x561931da84d0 2024-06-06T02:38:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.731+0000 7f8feea00640 1 -- 172.21.15.82:0/1817741897 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f8fe80105d0 con 0x7f8ff81029d0 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 -- 172.21.15.82:0/3411309068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 msgr2=0x561932175340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ff819c410 tx=0x7f8fe4031640 comp rx=0 tx=0).stop 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 -- 172.21.15.82:0/3411309068 shutdown_connections 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x561932175340 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x56193216e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 --2- 172.21.15.82:0/3411309068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931dc91b0 0x56193216df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.732+0000 7f9003994740 1 -- 172.21.15.82:0/3411309068 >> 172.21.15.82:0/3411309068 conn(0x561931dbd300 msgr2=0x5619321698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.733+0000 7f9003994740 1 -- 172.21.15.82:0/3411309068 shutdown_connections 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.733+0000 7f9003994740 1 -- 172.21.15.82:0/3411309068 wait complete. 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.733+0000 7f9003994740 1 -- start start 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.733+0000 7f8feea00640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 0x7f8fdc0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 Processor -- start 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f8feea00640 1 -- 172.21.15.82:0/1817741897 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8fe80e2780 con 0x7f8ff81029d0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f8ff6800640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 0x7f8fdc0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x561932177c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 0x56193217eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56193200aab0 con 0x561931dc91b0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56193206d630 con 0x561931da84d0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561932175cb0 con 0x561931da02f0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.734+0000 7f9003994740 10 client.0 _ll_register_callbacks cb 0x561932073610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x561932177c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53524/0 (socket says 172.21.15.82:53524) 2024-06-06T02:38:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 -- 172.21.15.82:0/737216878 learned_addr learned my addr 172.21.15.82:0/737216878 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 -- 172.21.15.82:0/737216878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 msgr2=0x561932177c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x561932177c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff5e00640 1 -- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 msgr2=0x56193217eab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:38:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.735+0000 7f8ff6800640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 0x56193217eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 0x56193217eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8ff5e00640 1 -- 172.21.15.82:0/737216878 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193209a170 con 0x561931da02f0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8ff6800640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 0x56193217eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9c0 tx=0x7f8fe80a54c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a042b615767812a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8091040 con 0x561931da02f0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8fe80c4290 con 0x561931da02f0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe4031cd0 con 0x561931da02f0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.736+0000 7f8ff6800640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 0x7f8fdc0b4d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005f40 tx=0x7f8ff0013bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8fe80aa300 con 0x561931da02f0 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 10 client.25330 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561931e34790 con 0x561931da02f0 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe4031cd0 con 0x561931da02f0 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8fe80a8e60 con 0x561931da02f0 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 10 client.25330 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 10 client.25330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 20 client.25330 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d87d80 0x561932184de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 4 client.25330 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.737+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619320e23d0 con 0x561931d87d80 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.738+0000 7f8ff5400640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d87d80 0x561932184de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.738+0000 7f8fd7400640 10 client.25330 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.739+0000 7f8ff5400640 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d87d80 0x561932184de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c1bc69056ae7b0 server_cookie=4e3d68cb0a618288 in_seq=0 out_seq=0 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.740+0000 7f8fd7400640 1 -- 172.21.15.82:0/737216878 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5619320e23d0 con 0x561931d87d80 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.740+0000 7f8fd7400640 10 client.25330 handle_command_reply: tid=0 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.740+0000 7f9003994740 1 client.25330 shutdown 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 msgr2=0x5619321776d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9c0 tx=0x7f8fe80a54c0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 shutdown_connections 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d87d80 0x561932184de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931dc91b0 0x56193217eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x561932177c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f8fd7400640 0 client.25330 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 --2- 172.21.15.82:0/737216878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931da02f0 0x5619321776d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 >> 172.21.15.82:0/737216878 conn(0x561931dbd300 msgr2=0x56193216a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 shutdown_connections 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 1 -- 172.21.15.82:0/737216878 wait complete. 2024-06-06T02:38:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.741+0000 7f9003994740 20 client.25330 trim_cache size 0 max 16384 2024-06-06T02:38:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 Processor -- start 2024-06-06T02:38:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 -- start start 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x56193217ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x56193216a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8010d60 con 0x561931da84d0 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800e630 con 0x561931da02f0 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.757+0000 7f9003994740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800c460 con 0x561931dc91b0 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60802/0 (socket says 172.21.15.82:60802) 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 -- 172.21.15.82:0/729219413 learned_addr learned my addr 172.21.15.82:0/729219413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5400640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x56193217ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff6800640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x56193216a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 -- 172.21.15.82:0/729219413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 msgr2=0x56193216a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x56193216a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 -- 172.21.15.82:0/729219413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 msgr2=0x56193217ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x56193217ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 -- 172.21.15.82:0/729219413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561931ead620 con 0x561931da02f0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff6800640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x56193216a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.758+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80a9900 tx=0x7f8fe8009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6dcba652f32488b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.759+0000 7f8fe2600640 1 -- 172.21.15.82:0/729219413 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8091040 con 0x561931da02f0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.759+0000 7f8fe2600640 1 -- 172.21.15.82:0/729219413 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe80adfb0 con 0x561931da02f0 2024-06-06T02:38:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.759+0000 7f8fe2600640 1 -- 172.21.15.82:0/729219413 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80aa070 con 0x561931da02f0 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- 172.21.15.82:0/729219413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 msgr2=0x561932169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80a9900 tx=0x7f8fe8009330 comp rx=0 tx=0).stop 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- 172.21.15.82:0/729219413 shutdown_connections 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x56193216a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da84d0 0x56193217ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 --2- 172.21.15.82:0/729219413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da02f0 0x561932169a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- 172.21.15.82:0/729219413 >> 172.21.15.82:0/729219413 conn(0x561931dbd300 msgr2=0x561932169350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- 172.21.15.82:0/729219413 shutdown_connections 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- 172.21.15.82:0/729219413 wait complete. 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.760+0000 7f9003994740 1 -- start start 2024-06-06T02:38:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 Processor -- start 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x56193217bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x5619321eb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800caf0 con 0x561931da02f0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800df60 con 0x561931da84d0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd800d1c0 con 0x561931dc91b0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f9003994740 10 client.0 _ll_register_callbacks cb 0x7f8fe800ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f8ff5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44794/0 (socket says 172.21.15.82:44794) 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f8ff5e00640 1 -- 172.21.15.82:0/196334868 learned_addr learned my addr 172.21.15.82:0/196334868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.761+0000 7f8ff5400640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x56193217bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff6800640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x5619321eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 -- 172.21.15.82:0/196334868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 msgr2=0x5619321eb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x5619321eb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 -- 172.21.15.82:0/196334868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 msgr2=0x56193217bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x56193217bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 -- 172.21.15.82:0/196334868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193217ebe0 con 0x561931da02f0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8ff5e00640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b29d0 tx=0x7f8fe80a9470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22e4455ee5b2af1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8fd7400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8091040 con 0x561931da02f0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f8fe80e0030 con 0x561931da02f0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.762+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe80adfb0 con 0x561931da02f0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8fe80b25d0 con 0x561931da02f0 2024-06-06T02:38:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 10 client.15168 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56193217ebe0 con 0x561931da02f0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fe80adfb0 con 0x561931da02f0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f8fe80af140 con 0x561931da02f0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 10 client.15168 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 10 client.15168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 20 client.15168 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d5d1c0 0x5619321eef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 4 client.15168 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.763+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5619320dde70 con 0x561931d5d1c0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.764+0000 7f8ff5400640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d5d1c0 0x5619321eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.764+0000 7f8ff5400640 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d5d1c0 0x5619321eef40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e117c1a738fa284c server_cookie=1a20e5d1631cff83 in_seq=0 out_seq=0 2024-06-06T02:38:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.764+0000 7f8fd7400640 10 client.15168 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.777+0000 7f8fd7400640 1 -- 172.21.15.82:0/196334868 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5619320dde70 con 0x561931d5d1c0 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.777+0000 7f8fd7400640 10 client.15168 handle_command_reply: tid=0 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 client.15168 shutdown 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 msgr2=0x56193217b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80b29d0 tx=0x7f8fe80a9470 comp rx=0 tx=0).stop 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 shutdown_connections 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561931dc91b0 0x5619321eb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561931da84d0 0x56193217bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561931d5d1c0 0x5619321eef40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 --2- 172.21.15.82:0/196334868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561931da02f0 0x56193217b700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f8fd7400640 0 client.15168 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 >> 172.21.15.82:0/196334868 conn(0x561931dbd300 msgr2=0x561932170fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 shutdown_connections 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 1 -- 172.21.15.82:0/196334868 wait complete. 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.778+0000 7f9003994740 20 client.15168 trim_cache size 0 max 16384 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:38:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:38:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:38:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 msgr2=0x7f8fdc0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 0x7f8fdc0b4d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005f40 tx=0x7f8ff0013bf0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 msgr2=0x7f8ff819b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800e9f0 tx=0x7f8fe800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 shutdown_connections 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ff8104440 0x7f8ff81a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ff8103af0 0x7f8ff819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f8fdc0b2800 0x7f8fdc0b4d10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 --2- 172.21.15.82:0/1817741897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ff81029d0 0x7f8ff819b370 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.779+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 >> 172.21.15.82:0/1817741897 conn(0x7f8ff80fe1d0 msgr2=0x7f8ff8074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.780+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 shutdown_connections 2024-06-06T02:38:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:25.780+0000 7f8ff7200640 1 -- 172.21.15.82:0/1817741897 wait complete. 2024-06-06T02:38:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:26 smithi082 ceph-mon[31579]: pgmap v465: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:38:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:26 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:38:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:26 smithi103 ceph-mon[36349]: pgmap v465: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:38:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:26 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:38:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:26 smithi184 ceph-mon[36922]: pgmap v465: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 852 B/s wr, 7 op/s 2024-06-06T02:38:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:26 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:38:27.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:38:27.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:38:27.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:27 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:38:27.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:38:27.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:38:27.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:27 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:38:27.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:38:27.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:38:27.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:27 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:38:28.799 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:28 smithi184 ceph-mon[36922]: pgmap v466: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:28.799 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:28 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:38:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:28 smithi103 ceph-mon[36349]: pgmap v466: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:28 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:38:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:28 smithi082 ceph-mon[31579]: pgmap v466: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:28 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:38:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:30 smithi103 ceph-mon[36349]: pgmap v467: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:30 smithi082 ceph-mon[31579]: pgmap v467: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:30 smithi184 ceph-mon[36922]: pgmap v467: 97 pgs: 97 active+clean; 658 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:38:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:32 smithi103 ceph-mon[36349]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:32 smithi082 ceph-mon[31579]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:32.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:32 smithi184 ceph-mon[36922]: pgmap v468: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:34 smithi103 ceph-mon[36349]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T02:38:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:34 smithi082 ceph-mon[31579]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T02:38:34.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:34 smithi184 ceph-mon[36922]: pgmap v469: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-06-06T02:38:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:36 smithi103 ceph-mon[36349]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:36 smithi082 ceph-mon[31579]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:36 smithi184 ceph-mon[36922]: pgmap v470: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-06-06T02:38:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:38 smithi103 ceph-mon[36349]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-06T02:38:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:38 smithi082 ceph-mon[31579]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-06T02:38:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:38 smithi184 ceph-mon[36922]: pgmap v471: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-06-06T02:38:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 -- 172.21.15.82:0/1008889531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 msgr2=0x7f420c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 --2- 172.21.15.82:0/1008889531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c074ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f420002a3f0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 -- 172.21.15.82:0/1008889531 shutdown_connections 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 --2- 172.21.15.82:0/1008889531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c10cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 --2- 172.21.15.82:0/1008889531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c075420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 --2- 172.21.15.82:0/1008889531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c074ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 -- 172.21.15.82:0/1008889531 >> 172.21.15.82:0/1008889531 conn(0x7f420c0fe1d0 msgr2=0x7f420c100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 -- 172.21.15.82:0/1008889531 shutdown_connections 2024-06-06T02:38:39.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.094+0000 7f4212200640 1 -- 172.21.15.82:0/1008889531 wait complete. 2024-06-06T02:38:39.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.096+0000 7f4212200640 1 Processor -- start 2024-06-06T02:38:39.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.096+0000 7f4212200640 1 -- start start 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c1a2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f420c110710 con 0x7f420c10a8a0 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f420c110590 con 0x7f420c076610 2024-06-06T02:38:39.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4212200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f420c110890 con 0x7f420c075010 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4211800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c1a2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4210e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4210e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57226/0 (socket says 172.21.15.82:57226) 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4210e00640 1 -- 172.21.15.82:0/3622004648 learned_addr learned my addr 172.21.15.82:0/3622004648 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f4211800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c1a2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56484/0 (socket says 172.21.15.82:56484) 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.097+0000 7f420be00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 -- 172.21.15.82:0/3622004648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 msgr2=0x7f420c19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 -- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 msgr2=0x7f420c1a2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c1a2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 -- 172.21.15.82:0/3622004648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420c1a2e70 con 0x7f420c075010 2024-06-06T02:38:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4210e00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4200031440 tx=0x7f4200003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4209600640 1 -- 172.21.15.82:0/3622004648 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420003f070 con 0x7f420c075010 2024-06-06T02:38:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.098+0000 7f4209600640 1 -- 172.21.15.82:0/3622004648 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4200031c50 con 0x7f420c075010 2024-06-06T02:38:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.099+0000 7f4209600640 1 -- 172.21.15.82:0/3622004648 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035030 con 0x7f420c075010 2024-06-06T02:38:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.099+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420c1a3100 con 0x7f420c075010 2024-06-06T02:38:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.099+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f420c1a35a0 con 0x7f420c075010 2024-06-06T02:38:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.103+0000 7f421a7a0740 1 Processor -- start 2024-06-06T02:38:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.103+0000 7f421a7a0740 1 -- start start 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a94d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5874d0 0x55e10a954340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e10a8bf480 con 0x55e10a5a81b0 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e10a8aea20 con 0x55e10a5874d0 2024-06-06T02:38:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f421a7a0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e10a8b2a60 con 0x55e10a57f2f0 2024-06-06T02:38:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.104+0000 7f4211800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56494/0 (socket says 172.21.15.82:56494) 2024-06-06T02:38:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 -- 172.21.15.82:0/3399386901 learned_addr learned my addr 172.21.15.82:0/3399386901 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f420be00640 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5874d0 0x55e10a954340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 -- 172.21.15.82:0/3399386901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 msgr2=0x55e10a94d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a94d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 -- 172.21.15.82:0/3399386901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5874d0 msgr2=0x55e10a954340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5874d0 0x55e10a954340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4211800640 1 -- 172.21.15.82:0/3399386901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10a8ab8d0 con 0x55e10a5a81b0 2024-06-06T02:38:39.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.105+0000 7f4209600640 1 -- 172.21.15.82:0/3622004648 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f4200042070 con 0x7f420c075010 2024-06-06T02:38:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.107+0000 7f4211800640 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f42040039f0 tx=0x7f4204003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4e59aa8491b78 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.107+0000 7f41fe000640 1 -- 172.21.15.82:0/3399386901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420401a470 con 0x55e10a5a81b0 2024-06-06T02:38:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.107+0000 7f41fe000640 1 -- 172.21.15.82:0/3399386901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4204015070 con 0x55e10a5a81b0 2024-06-06T02:38:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.107+0000 7f41fe000640 1 -- 172.21.15.82:0/3399386901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42040107e0 con 0x55e10a5a81b0 2024-06-06T02:38:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.108+0000 7f4209600640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 0x7f41f40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.108+0000 7f4209600640 1 -- 172.21.15.82:0/3622004648 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4200102b90 con 0x7f420c075010 2024-06-06T02:38:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 -- 172.21.15.82:0/3399386901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 msgr2=0x55e10a94cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f4210e00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 0x7f41f40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f42040039f0 tx=0x7f4204003eb0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 -- 172.21.15.82:0/3399386901 shutdown_connections 2024-06-06T02:38:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5874d0 0x55e10a954340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a94d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3399386901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a94cf40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 -- 172.21.15.82:0/3399386901 >> 172.21.15.82:0/3399386901 conn(0x55e10a59c300 msgr2=0x55e10a9488f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.109+0000 7f421a7a0740 1 -- 172.21.15.82:0/3399386901 shutdown_connections 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.110+0000 7f4210e00640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 0x7f41f40b4d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4200100530 tx=0x7f420004b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.110+0000 7f421a7a0740 1 -- 172.21.15.82:0/3399386901 wait complete. 2024-06-06T02:38:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.110+0000 7f421a7a0740 1 -- start start 2024-06-06T02:38:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.111+0000 7f421a7a0740 1 Processor -- start 2024-06-06T02:38:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.111+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a956770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.111+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f421a7a0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e10a7e9ab0 con 0x55e10a5a81b0 2024-06-06T02:38:39.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f421a7a0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e10a84c630 con 0x55e10a57f2f0 2024-06-06T02:38:39.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f421a7a0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55e10a954d10 con 0x55e10a5874d0 2024-06-06T02:38:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f421a7a0740 10 client.0 _ll_register_callbacks cb 0x55e10a852610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f420be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f420be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57232/0 (socket says 172.21.15.82:57232) 2024-06-06T02:38:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f420be00640 1 -- 172.21.15.82:0/3282249772 learned_addr learned my addr 172.21.15.82:0/3282249772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:39.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.112+0000 7f4211800640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 -- 172.21.15.82:0/3282249772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 msgr2=0x55e10a956770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a956770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 -- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 msgr2=0x55e10a95db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 -- 172.21.15.82:0/3282249772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e10a879170 con 0x55e10a5874d0 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f420be00640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41f8012700 tx=0x7f41f8012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b1972f6fb35b29 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f41f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8004050 con 0x55e10a5874d0 2024-06-06T02:38:39.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4204015070 con 0x55e10a5874d0 2024-06-06T02:38:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.113+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f41f80041f0 con 0x55e10a5874d0 2024-06-06T02:38:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.114+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f41f80043f0 con 0x55e10a5874d0 2024-06-06T02:38:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.114+0000 7f421a7a0740 10 client.25345 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.114+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e10a613790 con 0x55e10a5874d0 2024-06-06T02:38:39.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.114+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4204015070 con 0x55e10a5874d0 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f41f8003b60 con 0x55e10a5874d0 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 10 client.25345 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 10 client.25345 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 20 client.25345 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a566d80 0x55e10a96c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 4 client.25345 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e10a8c13d0 con 0x55e10a566d80 2024-06-06T02:38:39.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.115+0000 7f4211800640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a566d80 0x55e10a96c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.116+0000 7f4211800640 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a566d80 0x55e10a96c810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731443e6229c10c5 server_cookie=5d2811adeea28c73 in_seq=0 out_seq=0 2024-06-06T02:38:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.116+0000 7f41f2a00640 10 client.25345 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.117+0000 7f41f2a00640 1 -- 172.21.15.82:0/3282249772 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55e10a8c13d0 con 0x55e10a566d80 2024-06-06T02:38:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.117+0000 7f41f2a00640 10 client.25345 handle_command_reply: tid=0 2024-06-06T02:38:39.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.117+0000 7f421a7a0740 1 client.25345 shutdown 2024-06-06T02:38:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 msgr2=0x55e10a956cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f41f8012700 tx=0x7f41f8012bc0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 shutdown_connections 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a566d80 0x55e10a96c810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a956cb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3282249772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a956770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 >> 172.21.15.82:0/3282249772 conn(0x55e10a59c300 msgr2=0x55e10a9497f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f41f2a00640 0 client.25345 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 shutdown_connections 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.118+0000 7f421a7a0740 1 -- 172.21.15.82:0/3282249772 wait complete. 2024-06-06T02:38:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.119+0000 7f421a7a0740 20 client.25345 trim_cache size 0 max 16384 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 Processor -- start 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 -- start start 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5874d0 0x55e10a95daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5a81b0 0x55e10a95dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1aa8c0 con 0x55e10a5874d0 2024-06-06T02:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a8190 con 0x55e10a5a81b0 2024-06-06T02:38:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.150+0000 7f421a7a0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a5fc0 con 0x55e10a57f2f0 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57234/0 (socket says 172.21.15.82:57234) 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 -- 172.21.15.82:0/2641014872 learned_addr learned my addr 172.21.15.82:0/2641014872 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5a81b0 0x55e10a95dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f420be00640 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5874d0 0x55e10a95daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 -- 172.21.15.82:0/2641014872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5a81b0 msgr2=0x55e10a95dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5a81b0 0x55e10a95dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 -- 172.21.15.82:0/2641014872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5874d0 msgr2=0x55e10a95daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5874d0 0x55e10a95daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.151+0000 7f4211800640 1 -- 172.21.15.82:0/2641014872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e10a68c620 con 0x55e10a57f2f0 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.152+0000 7f4211800640 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4204009df0 tx=0x7f4204003eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35a335ef85c7e00c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.152+0000 7f41fd600640 1 -- 172.21.15.82:0/2641014872 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420402d040 con 0x55e10a57f2f0 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.152+0000 7f41fd600640 1 -- 172.21.15.82:0/2641014872 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4204015070 con 0x55e10a57f2f0 2024-06-06T02:38:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.152+0000 7f41fd600640 1 -- 172.21.15.82:0/2641014872 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204028ad0 con 0x55e10a57f2f0 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.153+0000 7f421a7a0740 1 -- 172.21.15.82:0/2641014872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 msgr2=0x55e10a949cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.153+0000 7f421a7a0740 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4204009df0 tx=0x7f4204003eb0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.153+0000 7f421a7a0740 1 -- 172.21.15.82:0/2641014872 shutdown_connections 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.153+0000 7f421a7a0740 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a5a81b0 0x55e10a95dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.153+0000 7f421a7a0740 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5874d0 0x55e10a95daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.154+0000 7f421a7a0740 1 --2- 172.21.15.82:0/2641014872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a57f2f0 0x55e10a949cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.154+0000 7f421a7a0740 1 -- 172.21.15.82:0/2641014872 >> 172.21.15.82:0/2641014872 conn(0x55e10a59c300 msgr2=0x55e10a9495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.154+0000 7f421a7a0740 1 -- 172.21.15.82:0/2641014872 shutdown_connections 2024-06-06T02:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.154+0000 7f421a7a0740 1 -- 172.21.15.82:0/2641014872 wait complete. 2024-06-06T02:38:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.154+0000 7f421a7a0740 1 -- start start 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 Processor -- start 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a95b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a6650 con 0x55e10a5a81b0 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a7ac0 con 0x55e10a57f2f0 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f420c1a6d20 con 0x55e10a5874d0 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.155+0000 7f421a7a0740 10 client.0 _ll_register_callbacks cb 0x7f41f8009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:55598/0 (socket says 172.21.15.82:55598) 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 -- 172.21.15.82:0/3749082344 learned_addr learned my addr 172.21.15.82:0/3749082344 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f420be00640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a95b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 -- 172.21.15.82:0/3749082344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 msgr2=0x55e10a95b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a95b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 -- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 msgr2=0x55e10a95b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.156+0000 7f4211800640 1 -- 172.21.15.82:0/3749082344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e10a9d2f90 con 0x55e10a57f2f0 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.157+0000 7f4211800640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4204000f80 tx=0x7f4204011e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68fd11895921e089 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.157+0000 7f41f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.157+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204011440 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.157+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f42040115e0 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.157+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4204015070 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f42040117e0 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f421a7a0740 10 client.25322 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e10a9d41c0 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4204015070 con 0x55e10a57f2f0 2024-06-06T02:38:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f420401aac0 con 0x55e10a57f2f0 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f421a7a0740 10 client.25322 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f421a7a0740 10 client.25322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.158+0000 7f421a7a0740 20 client.25322 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.159+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a53c1c0 0x55e10a9d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.159+0000 7f421a7a0740 4 client.25322 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.159+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e10a8bce70 con 0x55e10a53c1c0 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.159+0000 7f420be00640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a53c1c0 0x55e10a9d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.160+0000 7f420be00640 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a53c1c0 0x55e10a9d69f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f700b9ccc57110f server_cookie=8e0cf88532ee42b2 in_seq=0 out_seq=0 2024-06-06T02:38:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.160+0000 7f41f2a00640 10 client.25322 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.167+0000 7f41f2a00640 1 -- 172.21.15.82:0/3749082344 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e10a8bce70 con 0x55e10a53c1c0 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.167+0000 7f41f2a00640 10 client.25322 handle_command_reply: tid=0 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.167+0000 7f421a7a0740 1 client.25322 shutdown 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 msgr2=0x55e10a95e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4204000f80 tx=0x7f4204011e70 comp rx=0 tx=0).stop 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 shutdown_connections 2024-06-06T02:38:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55e10a53c1c0 0x55e10a9d69f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e10a5a81b0 0x55e10a95b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e10a5874d0 0x55e10a95b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 --2- 172.21.15.82:0/3749082344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e10a57f2f0 0x55e10a95e710 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 >> 172.21.15.82:0/3749082344 conn(0x55e10a59c300 msgr2=0x55e10a949d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f41f2a00640 0 client.25322 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 shutdown_connections 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 1 -- 172.21.15.82:0/3749082344 wait complete. 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.168+0000 7f421a7a0740 20 client.25322 trim_cache size 0 max 16384 2024-06-06T02:38:39.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:38:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:38:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:38:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:38:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 msgr2=0x7f41f40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 0x7f41f40b4d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4200100530 tx=0x7f420004b000 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 msgr2=0x7f420c19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4200031440 tx=0x7f4200003c10 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 shutdown_connections 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f420c10a8a0 0x7f420c1a2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f420c076610 0x7f420c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41f40b2870 0x7f41f40b4d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 --2- 172.21.15.82:0/3622004648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f420c075010 0x7f420c19b330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 >> 172.21.15.82:0/3622004648 conn(0x7f420c0fe1d0 msgr2=0x7f420c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 shutdown_connections 2024-06-06T02:38:39.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:39.169+0000 7f4212200640 1 -- 172.21.15.82:0/3622004648 wait complete. 2024-06-06T02:38:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:40 smithi103 ceph-mon[36349]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-06-06T02:38:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:40 smithi082 ceph-mon[31579]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-06-06T02:38:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:40 smithi184 ceph-mon[36922]: pgmap v472: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-06-06T02:38:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:42 smithi103 ceph-mon[36349]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T02:38:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:42 smithi082 ceph-mon[31579]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T02:38:42.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:42 smithi184 ceph-mon[36922]: pgmap v473: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-06-06T02:38:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:44 smithi103 ceph-mon[36349]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:44 smithi082 ceph-mon[31579]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:44.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:44 smithi184 ceph-mon[36922]: pgmap v474: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:46 smithi103 ceph-mon[36349]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T02:38:46.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:46 smithi082 ceph-mon[31579]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T02:38:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:46 smithi184 ceph-mon[36922]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-06-06T02:38:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:48 smithi103 ceph-mon[36349]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:48 smithi082 ceph-mon[31579]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:48.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:48 smithi184 ceph-mon[36922]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:49.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:38:50.224 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:50.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:50 smithi082 ceph-mon[31579]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:50 smithi103 ceph-mon[36349]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:50.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:50 smithi184 ceph-mon[36922]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 -- 172.21.15.82:0/419966085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6744103350 msgr2=0x7f6744109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 --2- 172.21.15.82:0/419966085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6744103350 0x7f6744109c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f673c009ca0 tx=0x7f673c02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 -- 172.21.15.82:0/419966085 shutdown_connections 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 --2- 172.21.15.82:0/419966085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6744103350 0x7f6744109c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 --2- 172.21.15.82:0/419966085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f6744102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 --2- 172.21.15.82:0/419966085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f67441018e0 0x7f6744101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 -- 172.21.15.82:0/419966085 >> 172.21.15.82:0/419966085 conn(0x7f67440fd0c0 msgr2=0x7f67440ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.440+0000 7f6743e00640 1 -- 172.21.15.82:0/419966085 shutdown_connections 2024-06-06T02:38:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.441+0000 7f6743e00640 1 -- 172.21.15.82:0/419966085 wait complete. 2024-06-06T02:38:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 Processor -- start 2024-06-06T02:38:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 -- start start 2024-06-06T02:38:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67441018e0 0x7f674419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f674419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 0x7f67441a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f674410a870 con 0x7f6744102a00 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f674410a6f0 con 0x7f67441018e0 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.442+0000 7f6743e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f674410a9f0 con 0x7f6744103350 2024-06-06T02:38:52.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.443+0000 7f6742000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f674419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.443+0000 7f6742000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f674419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49952/0 (socket says 172.21.15.82:49952) 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.443+0000 7f6742000640 1 -- 172.21.15.82:0/2457886365 learned_addr learned my addr 172.21.15.82:0/2457886365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.443+0000 7f6743400640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 0x7f67441a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.443+0000 7f6742a00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67441018e0 0x7f674419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 -- 172.21.15.82:0/2457886365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67441018e0 msgr2=0x7f674419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67441018e0 0x7f674419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 -- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 msgr2=0x7f674419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f674419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 -- 172.21.15.82:0/2457886365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674406c2b0 con 0x7f6744103350 2024-06-06T02:38:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.444+0000 7f6743400640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 0x7f67441a27a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f673c02aeb0 tx=0x7f673c0316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.445+0000 7f6748a00640 1 -- 172.21.15.82:0/2457886365 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c003b70 con 0x7f6744103350 2024-06-06T02:38:52.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.445+0000 7f6748a00640 1 -- 172.21.15.82:0/2457886365 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f673c003d10 con 0x7f6744103350 2024-06-06T02:38:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.445+0000 7f6748a00640 1 -- 172.21.15.82:0/2457886365 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c02fae0 con 0x7f6744103350 2024-06-06T02:38:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.445+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674406c540 con 0x7f6744103350 2024-06-06T02:38:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.445+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674406ca40 con 0x7f6744103350 2024-06-06T02:38:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.450+0000 7f6750e0f740 1 Processor -- start 2024-06-06T02:38:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.451+0000 7f6748a00640 1 -- 172.21.15.82:0/2457886365 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f673c004610 con 0x7f6744103350 2024-06-06T02:38:52.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.452+0000 7f6750e0f740 1 -- start start 2024-06-06T02:38:52.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6748a00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 0x7f67280b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6742000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6742000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49034/0 (socket says 172.21.15.82:49034) 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b7dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6748a00640 1 -- 172.21.15.82:0/2457886365 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f673c1037c0 con 0x7f6744103350 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b84b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f726ae7480 con 0x55f7267a72f0 2024-06-06T02:38:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f726ad6a20 con 0x55f7267d01b0 2024-06-06T02:38:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6750e0f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f726adaa60 con 0x55f7267af4d0 2024-06-06T02:38:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.453+0000 7f6742000640 1 -- 172.21.15.82:0/2348752922 learned_addr learned my addr 172.21.15.82:0/2348752922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6743400640 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b84b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6742000640 1 -- 172.21.15.82:0/2348752922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 msgr2=0x55f726b84b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6742000640 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b84b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6742000640 1 -- 172.21.15.82:0/2348752922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 msgr2=0x55f726b7dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6742000640 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b7dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.454+0000 7f6742000640 1 -- 172.21.15.82:0/2348752922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f726ad38d0 con 0x55f7267d01b0 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.455+0000 7f6742a00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 0x7f67280b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.455+0000 7f6742000640 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67300095f0 tx=0x7f6730013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4061c23aa6a1af server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.455+0000 7f672fe00640 1 -- 172.21.15.82:0/2348752922 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673001c470 con 0x55f7267d01b0 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.456+0000 7f672fe00640 1 -- 172.21.15.82:0/2348752922 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6730017070 con 0x55f7267d01b0 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.456+0000 7f672fe00640 1 -- 172.21.15.82:0/2348752922 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730010990 con 0x55f7267d01b0 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 -- 172.21.15.82:0/2348752922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 msgr2=0x55f726b7d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6742a00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 0x7f67280b4e00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6744102900 tx=0x7f6734005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f67300095f0 tx=0x7f6730013830 comp rx=0 tx=0).stop 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 -- 172.21.15.82:0/2348752922 shutdown_connections 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b84b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b7dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2348752922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267d01b0 0x55f726b7d750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 -- 172.21.15.82:0/2348752922 >> 172.21.15.82:0/2348752922 conn(0x55f7267c4300 msgr2=0x55f726b79100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 -- 172.21.15.82:0/2348752922 shutdown_connections 2024-06-06T02:38:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.457+0000 7f6750e0f740 1 -- 172.21.15.82:0/2348752922 wait complete. 2024-06-06T02:38:52.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.458+0000 7f6750e0f740 1 -- start start 2024-06-06T02:38:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.458+0000 7f6750e0f740 1 Processor -- start 2024-06-06T02:38:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 0x55f726b87520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267d01b0 0x55f726b8e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f726a11ab0 con 0x55f7267af4d0 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f726a74630 con 0x55f7267a72f0 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f726b85520 con 0x55f7267d01b0 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6750e0f740 10 client.0 _ll_register_callbacks cb 0x55f726a7a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6742a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6742a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49042/0 (socket says 172.21.15.82:49042) 2024-06-06T02:38:52.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.459+0000 7f6742a00640 1 -- 172.21.15.82:0/1875021884 learned_addr learned my addr 172.21.15.82:0/1875021884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6743400640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267d01b0 0x55f726b8e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742a00640 1 -- 172.21.15.82:0/1875021884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267d01b0 msgr2=0x55f726b8e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742a00640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267d01b0 0x55f726b8e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742a00640 1 -- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 msgr2=0x55f726b87520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742000640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 0x55f726b87520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742a00640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 0x55f726b87520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742a00640 1 -- 172.21.15.82:0/1875021884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f726aa1170 con 0x55f7267a72f0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.460+0000 7f6742000640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 0x55f726b87520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.461+0000 7f6742a00640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6734003920 tx=0x7f6734004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316e37ea30799da4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.461+0000 7f672cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.461+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673400ecc0 con 0x55f7267a72f0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.461+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f673401e420 con 0x55f7267a72f0 2024-06-06T02:38:52.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.461+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6730017070 con 0x55f7267a72f0 2024-06-06T02:38:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.462+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f673400ee60 con 0x55f7267a72f0 2024-06-06T02:38:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.462+0000 7f6750e0f740 10 client.25334 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:52.463 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.462+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f72683b790 con 0x55f7267a72f0 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.462+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6730017070 con 0x55f7267a72f0 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.462+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f67340306f0 con 0x55f7267a72f0 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.463+0000 7f6750e0f740 10 client.25334 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.463+0000 7f6750e0f740 10 client.25334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.463+0000 7f6750e0f740 20 client.25334 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.463+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f72678ed80 0x55f726b94680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.464 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.464+0000 7f6750e0f740 4 client.25334 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.464+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f726ae93d0 con 0x55f72678ed80 2024-06-06T02:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.464+0000 7f6742000640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f72678ed80 0x55f726b94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.465+0000 7f6742000640 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f72678ed80 0x55f726b94680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61bd29a00cff66f server_cookie=24e372780d5327d3 in_seq=0 out_seq=0 2024-06-06T02:38:52.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.465+0000 7f672cc00640 10 client.25334 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.466+0000 7f672cc00640 1 -- 172.21.15.82:0/1875021884 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f726ae93d0 con 0x55f72678ed80 2024-06-06T02:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.466+0000 7f672cc00640 10 client.25334 handle_command_reply: tid=0 2024-06-06T02:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 client.25334 shutdown 2024-06-06T02:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 msgr2=0x55f726b86fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6734003920 tx=0x7f6734004730 comp rx=0 tx=0).stop 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 shutdown_connections 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267d01b0 0x55f726b8e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f72678ed80 0x55f726b94680 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f672cc00640 0 client.25334 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267af4d0 0x55f726b87520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1875021884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b86fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 >> 172.21.15.82:0/1875021884 conn(0x55f7267c4300 msgr2=0x55f726b7a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.467+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 shutdown_connections 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.468+0000 7f6750e0f740 1 -- 172.21.15.82:0/1875021884 wait complete. 2024-06-06T02:38:52.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.468+0000 7f6750e0f740 20 client.25334 trim_cache size 0 max 16384 2024-06-06T02:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 Processor -- start 2024-06-06T02:38:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 -- start start 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b8e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b80ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6744073d90 con 0x55f72678ed80 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6744071660 con 0x55f7267a72f0 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.484+0000 7f6750e0f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f674406f4b0 con 0x55f7267af4d0 2024-06-06T02:38:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b8e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49994/0 (socket says 172.21.15.82:49994) 2024-06-06T02:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742a00640 1 -- 172.21.15.82:0/2682048782 learned_addr learned my addr 172.21.15.82:0/2682048782 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6743400640 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b80ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742000640 1 -- 172.21.15.82:0/2682048782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 msgr2=0x55f726b80ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.485+0000 7f6742000640 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b80ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f6742000640 1 -- 172.21.15.82:0/2682048782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 msgr2=0x55f726b7a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f6742000640 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f6742000640 1 -- 172.21.15.82:0/2682048782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7268b4620 con 0x55f7267a72f0 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f6742000640 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b8e330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f726b94dd0 tx=0x7f67300133b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e09837fed0ce03d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f6742a00640 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f672f400640 1 -- 172.21.15.82:0/2682048782 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6730005240 con 0x55f7267a72f0 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f672f400640 1 -- 172.21.15.82:0/2682048782 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6730017070 con 0x55f7267a72f0 2024-06-06T02:38:52.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.486+0000 7f672f400640 1 -- 172.21.15.82:0/2682048782 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67300035f0 con 0x55f7267a72f0 2024-06-06T02:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 -- 172.21.15.82:0/2682048782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 msgr2=0x55f726b8e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b8e330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f726b94dd0 tx=0x7f67300133b0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 -- 172.21.15.82:0/2682048782 shutdown_connections 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f7267af4d0 0x55f726b80ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267a72f0 0x55f726b8e330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 --2- 172.21.15.82:0/2682048782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f72678ed80 0x55f726b7a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.487+0000 7f6750e0f740 1 -- 172.21.15.82:0/2682048782 >> 172.21.15.82:0/2682048782 conn(0x55f7267c4300 msgr2=0x55f726b79d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.488+0000 7f6750e0f740 1 -- 172.21.15.82:0/2682048782 shutdown_connections 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.488+0000 7f6750e0f740 1 -- 172.21.15.82:0/2682048782 wait complete. 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.488+0000 7f6750e0f740 1 -- start start 2024-06-06T02:38:52.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.488+0000 7f6750e0f740 1 Processor -- start 2024-06-06T02:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b8ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 0x55f726b8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f674406fb20 con 0x55f7267a72f0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6744070f90 con 0x55f7267af4d0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f67440701f0 con 0x55f72678ed80 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.489+0000 7f6750e0f740 10 client.0 _ll_register_callbacks cb 0x7f6734004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b8ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33914/0 (socket says 172.21.15.82:33914) 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b8ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50008/0 (socket says 172.21.15.82:50008) 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742a00640 1 -- 172.21.15.82:0/1619735017 learned_addr learned my addr 172.21.15.82:0/1619735017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 0x55f726b8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 -- 172.21.15.82:0/1619735017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 msgr2=0x55f726b8b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 -- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 msgr2=0x55f726b8ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b8ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6743400640 1 -- 172.21.15.82:0/1619735017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f726b8cf20 con 0x55f7267af4d0 2024-06-06T02:38:52.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.490+0000 7f6742a00640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.491+0000 7f6743400640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 0x55f726b8c930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f673c101280 tx=0x7f673c02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9584b3ee20a5c3b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.491+0000 7f672cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:38:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.491+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c0cad90 con 0x55f7267af4d0 2024-06-06T02:38:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.491+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f673c0c7020 con 0x55f7267af4d0 2024-06-06T02:38:52.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.491+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6730017070 con 0x55f7267af4d0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f673c0cf140 con 0x55f7267af4d0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f6750e0f740 10 client.25340 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f726b8e280 con 0x55f7267af4d0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6730017070 con 0x55f7267af4d0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f673c0c9ff0 con 0x55f7267af4d0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f6750e0f740 10 client.25340 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.492+0000 7f6750e0f740 10 client.25340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.493+0000 7f6750e0f740 20 client.25340 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.493+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f7267d01b0 0x55f726bff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.493+0000 7f6750e0f740 4 client.25340 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.493+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f726ae4e70 con 0x55f7267d01b0 2024-06-06T02:38:52.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.493+0000 7f6742a00640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f7267d01b0 0x55f726bff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.494+0000 7f6742a00640 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f7267d01b0 0x55f726bff230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c64c89fa7e1b72 server_cookie=2613d968a9fdfc10 in_seq=0 out_seq=0 2024-06-06T02:38:52.495 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.494+0000 7f672cc00640 10 client.25340 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.508+0000 7f672cc00640 1 -- 172.21.15.82:0/1619735017 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f726ae4e70 con 0x55f7267d01b0 2024-06-06T02:38:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.508+0000 7f672cc00640 10 client.25340 handle_command_reply: tid=0 2024-06-06T02:38:52.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.508+0000 7f6750e0f740 1 client.25340 shutdown 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 msgr2=0x55f726b8c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 0x55f726b8c930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f673c101280 tx=0x7f673c02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 shutdown_connections 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f7267af4d0 0x55f726b8c930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f7267d01b0 0x55f726bff230 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7267a72f0 0x55f726b8ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 --2- 172.21.15.82:0/1619735017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f72678ed80 0x55f726b8b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 >> 172.21.15.82:0/1619735017 conn(0x55f7267c4300 msgr2=0x55f726b6ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.509+0000 7f672cc00640 0 client.25340 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.510+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 shutdown_connections 2024-06-06T02:38:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.510+0000 7f6750e0f740 1 -- 172.21.15.82:0/1619735017 wait complete. 2024-06-06T02:38:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.510+0000 7f6750e0f740 20 client.25340 trim_cache size 0 max 16384 2024-06-06T02:38:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:38:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:38:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:38:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.511+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 msgr2=0x7f67280b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.511+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 0x7f67280b4e00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6744102900 tx=0x7f6734005f90 comp rx=0 tx=0).stop 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.511+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 msgr2=0x7f67441a27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.511+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 0x7f67441a27a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f673c02aeb0 tx=0x7f673c0316f0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 shutdown_connections 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f67280b28f0 0x7f67280b4e00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6744103350 0x7f67441a27a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6744102a00 0x7f674419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 --2- 172.21.15.82:0/2457886365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67441018e0 0x7f674419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 >> 172.21.15.82:0/2457886365 conn(0x7f67440fd0c0 msgr2=0x7f67440fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.512+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 shutdown_connections 2024-06-06T02:38:52.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:38:52.513+0000 7f6743e00640 1 -- 172.21.15.82:0/2457886365 wait complete. 2024-06-06T02:38:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.514+0000 7f5bea000640 1 -- 172.21.15.82:0/715866521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4074b00 msgr2=0x7f5be4074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.514+0000 7f5bea000640 1 --2- 172.21.15.82:0/715866521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4074b00 0x7f5be4074f10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009860 tx=0x7f5bd402a3d0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.515+0000 7f5bea000640 1 -- 172.21.15.82:0/715866521 shutdown_connections 2024-06-06T02:38:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.515+0000 7f5bea000640 1 --2- 172.21.15.82:0/715866521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 0x7f5be4116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.515+0000 7f5bea000640 1 --2- 172.21.15.82:0/715866521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4075450 0x7f5be4113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.515+0000 7f5bea000640 1 --2- 172.21.15.82:0/715866521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4074b00 0x7f5be4074f10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.515+0000 7f5bea000640 1 -- 172.21.15.82:0/715866521 >> 172.21.15.82:0/715866521 conn(0x7f5be4079cb0 msgr2=0x7f5be407a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.516+0000 7f5bea000640 1 -- 172.21.15.82:0/715866521 shutdown_connections 2024-06-06T02:38:52.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.516+0000 7f5bea000640 1 -- 172.21.15.82:0/715866521 wait complete. 2024-06-06T02:38:52.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.519+0000 7f5bea000640 1 Processor -- start 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.519+0000 7f5bea000640 1 -- start start 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 0x7f5be419ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 0x7f5be41a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 0x7f5be41a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4119480 con 0x7f5be4113c40 2024-06-06T02:38:52.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4119300 con 0x7f5be4075450 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5bea000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4119600 con 0x7f5be4074b00 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.520+0000 7f5be3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 0x7f5be419ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 0x7f5be419ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33934/0 (socket says 172.21.15.82:33934) 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be3400640 1 -- 172.21.15.82:0/581534730 learned_addr learned my addr 172.21.15.82:0/581534730 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 0x7f5be41a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be3e00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 0x7f5be41a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 -- 172.21.15.82:0/581534730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 msgr2=0x7f5be419ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 0x7f5be419ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 -- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 msgr2=0x7f5be41a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 0x7f5be41a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.521+0000 7f5be2a00640 1 -- 172.21.15.82:0/581534730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be41a4dd0 con 0x7f5be4075450 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.522+0000 7f5be2a00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 0x7f5be41a04c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e790 tx=0x7f5bd000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.523+0000 7f5bdbe00640 1 -- 172.21.15.82:0/581534730 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000eea0 con 0x7f5be4075450 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.523+0000 7f5bdbe00640 1 -- 172.21.15.82:0/581534730 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd000ccc0 con 0x7f5be4075450 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.523+0000 7f5bdbe00640 1 -- 172.21.15.82:0/581534730 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0018660 con 0x7f5be4075450 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.523+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be41a50c0 con 0x7f5be4075450 2024-06-06T02:38:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.523+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be41aca40 con 0x7f5be4075450 2024-06-06T02:38:52.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.528+0000 7f5bf06de740 1 Processor -- start 2024-06-06T02:38:52.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.529+0000 7f5bf06de740 1 -- start start 2024-06-06T02:38:52.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.529+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 0x557070dba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070dba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dbade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bf06de740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557070d2ee00 con 0x5570709f3390 2024-06-06T02:38:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bf06de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557070d1e3a0 con 0x557070a14070 2024-06-06T02:38:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bf06de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557070d223e0 con 0x5570709eb1b0 2024-06-06T02:38:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5bdbe00640 1 -- 172.21.15.82:0/581534730 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f5bd00188c0 con 0x7f5be4075450 2024-06-06T02:38:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5be3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 0x557070dba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5be3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 0x557070dba360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49092/0 (socket says 172.21.15.82:49092) 2024-06-06T02:38:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5be3e00640 1 -- 172.21.15.82:0/151506453 learned_addr learned my addr 172.21.15.82:0/151506453 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.530+0000 7f5be2a00640 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dbade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be3400640 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070dba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be2a00640 1 -- 172.21.15.82:0/151506453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 msgr2=0x557070dba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be2a00640 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070dba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be2a00640 1 -- 172.21.15.82:0/151506453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 msgr2=0x557070dba360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be2a00640 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 0x557070dba360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.531+0000 7f5be2a00640 1 -- 172.21.15.82:0/151506453 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557070a7f650 con 0x5570709f3390 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.532+0000 7f5be2a00640 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dbade0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00dfe90 tx=0x7f5bd00e8b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc613a74b52303a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.532+0000 7f5bdbe00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 0x7f5bc80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.534+0000 7f5bd8c00640 1 -- 172.21.15.82:0/151506453 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00f5070 con 0x5570709f3390 2024-06-06T02:38:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.534+0000 7f5bd8c00640 1 -- 172.21.15.82:0/151506453 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd0079600 con 0x5570709f3390 2024-06-06T02:38:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.534+0000 7f5bd8c00640 1 -- 172.21.15.82:0/151506453 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0081f40 con 0x5570709f3390 2024-06-06T02:38:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.535+0000 7f5bf06de740 1 -- 172.21.15.82:0/151506453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 msgr2=0x557070dbade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.535+0000 7f5bf06de740 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dbade0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00dfe90 tx=0x7f5bd00e8b30 comp rx=0 tx=0).stop 2024-06-06T02:38:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.536+0000 7f5be3e00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 0x7f5bc80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.536+0000 7f5bdbe00640 1 -- 172.21.15.82:0/581534730 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5bd00e24e0 con 0x7f5be4075450 2024-06-06T02:38:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.537+0000 7f5bf06de740 1 -- 172.21.15.82:0/151506453 shutdown_connections 2024-06-06T02:38:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.537+0000 7f5bf06de740 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dbade0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.537+0000 7f5bf06de740 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070dba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.537+0000 7f5bf06de740 1 --2- 172.21.15.82:0/151506453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557070a14070 0x557070dba360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.537+0000 7f5bf06de740 1 -- 172.21.15.82:0/151506453 >> 172.21.15.82:0/151506453 conn(0x557070a08460 msgr2=0x557070db6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.538+0000 7f5bf06de740 1 -- 172.21.15.82:0/151506453 shutdown_connections 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.538+0000 7f5bf06de740 1 -- 172.21.15.82:0/151506453 wait complete. 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.539+0000 7f5bf06de740 1 -- start start 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.539+0000 7f5bf06de740 1 Processor -- start 2024-06-06T02:38:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.541+0000 7f5be3e00640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 0x7f5bc80b4e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x557070db7580 tx=0x7f5bdc0096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.542+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 0x557070dc6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.542+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dc6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.542+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070dc4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5be2a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dc6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5be3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070dc4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5be3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070dc4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33966/0 (socket says 172.21.15.82:33966) 2024-06-06T02:38:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5be3e00640 1 -- 172.21.15.82:0/1551516168 learned_addr learned my addr 172.21.15.82:0/1551516168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5bf06de740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557070b82700 con 0x5570709f3390 2024-06-06T02:38:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557070cbb700 con 0x5570709eb1b0 2024-06-06T02:38:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.544+0000 7f5be3400640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 0x557070dc6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.545+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x557070dc74d0 con 0x557070a14070 2024-06-06T02:38:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.545+0000 7f5bf06de740 10 client.0 _ll_register_callbacks cb 0x557070cc7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.546+0000 7f5be3400640 1 -- 172.21.15.82:0/1551516168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 msgr2=0x557070dc4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.546+0000 7f5be3400640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070dc4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.546+0000 7f5be3400640 1 -- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 msgr2=0x557070dc6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.546+0000 7f5be3400640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dc6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.546+0000 7f5be3400640 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557070ce6fb0 con 0x5570709eb1b0 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.547+0000 7f5be3400640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 0x557070dc6510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x557070db7e70 tx=0x7f5bd4030bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6b528da246f30a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.547+0000 7f5bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.549+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4004220 con 0x5570709eb1b0 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.549+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5bd40043c0 con 0x5570709eb1b0 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.550+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd0079600 con 0x5570709eb1b0 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.550+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5bd404b050 con 0x5570709eb1b0 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.550+0000 7f5bf06de740 10 client.25352 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:52.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.550+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557070dd36c0 con 0x5570709eb1b0 2024-06-06T02:38:52.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.551+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd0079600 con 0x5570709eb1b0 2024-06-06T02:38:52.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.551+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f5bd4044070 con 0x5570709eb1b0 2024-06-06T02:38:52.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.551+0000 7f5bf06de740 10 client.25352 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:52.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.552+0000 7f5bf06de740 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:52.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.552+0000 7f5bf06de740 20 client.25352 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:52.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.552+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709d29f0 0x557070dd6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.552+0000 7f5bf06de740 4 client.25352 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:38:52.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.552+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557070d30d50 con 0x5570709d29f0 2024-06-06T02:38:52.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.553+0000 7f5be2a00640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709d29f0 0x557070dd6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.554+0000 7f5be2a00640 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709d29f0 0x557070dd6bb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9744cc3feea3e42 server_cookie=f41633416aa921f1 in_seq=0 out_seq=0 2024-06-06T02:38:52.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.554+0000 7f5bcd600640 10 client.25352 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.555+0000 7f5bcd600640 1 -- 172.21.15.82:0/1551516168 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557070d30d50 con 0x5570709d29f0 2024-06-06T02:38:52.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.555+0000 7f5bcd600640 10 client.25352 handle_command_reply: tid=0 2024-06-06T02:38:52.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.555+0000 7f5bf06de740 1 client.25352 shutdown 2024-06-06T02:38:52.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 msgr2=0x557070dc6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 0x557070dc6510 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x557070db7e70 tx=0x7f5bd4030bb0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 shutdown_connections 2024-06-06T02:38:52.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070dc4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709d29f0 0x557070dd6bb0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709f3390 0x557070dc6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 --2- 172.21.15.82:0/1551516168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709eb1b0 0x557070dc6510 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 >> 172.21.15.82:0/1551516168 conn(0x557070a08460 msgr2=0x557070dbc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bcd600640 0 client.25352 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.556+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 shutdown_connections 2024-06-06T02:38:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.557+0000 7f5bf06de740 1 -- 172.21.15.82:0/1551516168 wait complete. 2024-06-06T02:38:52.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.557+0000 7f5bf06de740 20 client.25352 trim_cache size 0 max 16384 2024-06-06T02:38:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.576+0000 7f5bf06de740 1 Processor -- start 2024-06-06T02:38:52.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.577+0000 7f5bf06de740 1 -- start start 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.577+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070db6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.577+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.577+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557070a14070 0x557070ddc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49102/0 (socket says 172.21.15.82:49102) 2024-06-06T02:38:52.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5be3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070db6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5be2a00640 1 -- 172.21.15.82:0/2650889663 learned_addr learned my addr 172.21.15.82:0/2650889663 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b78e0 con 0x557070a14070 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b51b0 con 0x5570709f3390 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b2fe0 con 0x5570709eb1b0 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.578+0000 7f5be3e00640 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557070a14070 0x557070ddc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 -- 172.21.15.82:0/2650889663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 msgr2=0x557070db6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070db6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 -- 172.21.15.82:0/2650889663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557070a14070 msgr2=0x557070ddc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557070a14070 0x557070ddc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 -- 172.21.15.82:0/2650889663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557070dc6110 con 0x5570709f3390 2024-06-06T02:38:52.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be3400640 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070db6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:38:52.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.579+0000 7f5be2a00640 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00e0410 tx=0x7f5bd00e8b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61685ad28ed349f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.580+0000 7f5bcfe00640 1 -- 172.21.15.82:0/2650889663 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a5040 con 0x5570709f3390 2024-06-06T02:38:52.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.580+0000 7f5bcfe00640 1 -- 172.21.15.82:0/2650889663 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd00e5de0 con 0x5570709f3390 2024-06-06T02:38:52.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 msgr2=0x557070ddc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00e0410 tx=0x7f5bd00e8b30 comp rx=0 tx=0).stop 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bcfe00640 1 -- 172.21.15.82:0/2650889663 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00b2140 con 0x5570709f3390 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 shutdown_connections 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557070a14070 0x557070ddc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070ddc340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 --2- 172.21.15.82:0/2650889663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5570709eb1b0 0x557070db6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 >> 172.21.15.82:0/2650889663 conn(0x557070a08460 msgr2=0x557070db6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 shutdown_connections 2024-06-06T02:38:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.581+0000 7f5bf06de740 1 -- 172.21.15.82:0/2650889663 wait complete. 2024-06-06T02:38:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.582+0000 7f5bf06de740 1 -- start start 2024-06-06T02:38:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.582+0000 7f5bf06de740 1 Processor -- start 2024-06-06T02:38:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709eb1b0 0x557070dc9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070e37350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b3670 con 0x5570709eb1b0 2024-06-06T02:38:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b4ae0 con 0x5570709f3390 2024-06-06T02:38:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5be41b3d40 con 0x557070a14070 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.583+0000 7f5bf06de740 10 client.0 _ll_register_callbacks cb 0x7f5bd40096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.584+0000 7f5be3400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709eb1b0 0x557070dc9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.584+0000 7f5be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.584+0000 7f5be3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070e37350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.584+0000 7f5be2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49118/0 (socket says 172.21.15.82:49118) 2024-06-06T02:38:52.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.584+0000 7f5be2a00640 1 -- 172.21.15.82:0/3490435746 learned_addr learned my addr 172.21.15.82:0/3490435746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:52.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 -- 172.21.15.82:0/3490435746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 msgr2=0x557070e37350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070e37350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 -- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709eb1b0 msgr2=0x557070dc9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709eb1b0 0x557070dc9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 -- 172.21.15.82:0/3490435746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557070e37890 con 0x5570709f3390 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5be2a00640 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0000c00 tx=0x7f5bd0010c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71453fa62d98146a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.585+0000 7f5bcd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a5040 con 0x5570709f3390 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5bd00a5ce0 con 0x5570709f3390 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd00e5de0 con 0x5570709f3390 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5bd00a9820 con 0x5570709f3390 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bf06de740 10 client.25358 fetch_fsmap learned FSMap version 26 2024-06-06T02:38:52.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.586+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557070e3ebd0 con 0x5570709f3390 2024-06-06T02:38:52.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bd00e5de0 con 0x5570709f3390 2024-06-06T02:38:52.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f5bd00cc0d0 con 0x5570709f3390 2024-06-06T02:38:52.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 10 client.25358 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 20 client.25358 populate_metadata read hostname 'smithi082' 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709a7da0 0x557070e40be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 4 client.25358 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.587+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557070d2c7f0 con 0x5570709a7da0 2024-06-06T02:38:52.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.588+0000 7f5be3400640 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709a7da0 0x557070e40be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.589+0000 7f5be3400640 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709a7da0 0x557070e40be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9d1b8a68843464 server_cookie=808f64b789ff52f5 in_seq=0 out_seq=0 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.589+0000 7f5bcd600640 10 client.25358 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.589+0000 7f5bcd600640 1 -- 172.21.15.82:0/3490435746 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557070d2c7f0 con 0x5570709a7da0 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.589+0000 7f5bcd600640 10 client.25358 handle_command_reply: tid=0 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.589+0000 7f5bf06de740 1 client.25358 shutdown 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 msgr2=0x557070dca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0000c00 tx=0x7f5bd0010c20 comp rx=0 tx=0).stop 2024-06-06T02:38:52.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 shutdown_connections 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557070a14070 0x557070e37350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5570709f3390 0x557070dca350 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5570709a7da0 0x557070e40be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 --2- 172.21.15.82:0/3490435746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5570709eb1b0 0x557070dc9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 >> 172.21.15.82:0/3490435746 conn(0x557070a08460 msgr2=0x557070db5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bcd600640 0 client.25358 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 shutdown_connections 2024-06-06T02:38:52.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.590+0000 7f5bf06de740 1 -- 172.21.15.82:0/3490435746 wait complete. 2024-06-06T02:38:52.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.591+0000 7f5bf06de740 20 client.25358 trim_cache size 0 max 16384 2024-06-06T02:38:52.593 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:38:52.593 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-06-06T02:38:52.593 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-06-06T02:38:52.593 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:38:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 msgr2=0x7f5bc80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 0x7f5bc80b4e10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x557070db7580 tx=0x7f5bdc0096a0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 msgr2=0x7f5be41a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 0x7f5be41a04c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000e790 tx=0x7f5bd000ec50 comp rx=0 tx=0).stop 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 shutdown_connections 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be4113c40 0x7f5be41a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5be4075450 0x7f5be41a04c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5bc80b2900 0x7f5bc80b4e10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 --2- 172.21.15.82:0/581534730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5be4074b00 0x7f5be419ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 >> 172.21.15.82:0/581534730 conn(0x7f5be4079cb0 msgr2=0x7f5be4110ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.592+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 shutdown_connections 2024-06-06T02:38:52.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:52.593+0000 7f5bea000640 1 -- 172.21.15.82:0/581534730 wait complete. 2024-06-06T02:38:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:52 smithi082 ceph-mon[31579]: pgmap v478: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-06-06T02:38:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:52 smithi103 ceph-mon[36349]: pgmap v478: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-06-06T02:38:52.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:52 smithi184 ceph-mon[36922]: pgmap v478: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-06-06T02:38:53.528 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T02:38:53.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:38:53.938 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:54.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:54 smithi103 ceph-mon[36349]: pgmap v479: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-06-06T02:38:54.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:54 smithi082 ceph-mon[31579]: pgmap v479: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-06-06T02:38:54.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:54 smithi184 ceph-mon[36922]: pgmap v479: 97 pgs: 97 active+clean; 671 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-06-06T02:38:56.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 -- 172.21.15.82:0/535618544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9508103b90 msgr2=0x7f9508103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 --2- 172.21.15.82:0/535618544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9508103b90 0x7f9508103fa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009860 tx=0x7f94fc02a340 comp rx=0 tx=0).stop 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 -- 172.21.15.82:0/535618544 shutdown_connections 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 --2- 172.21.15.82:0/535618544 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950810cff0 0x7f950810f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 --2- 172.21.15.82:0/535618544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f950810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 --2- 172.21.15.82:0/535618544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9508103b90 0x7f9508103fa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 -- 172.21.15.82:0/535618544 >> 172.21.15.82:0/535618544 conn(0x7f95080fd6f0 msgr2=0x7f95080ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 -- 172.21.15.82:0/535618544 shutdown_connections 2024-06-06T02:38:56.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.405+0000 7f950de00640 1 -- 172.21.15.82:0/535618544 wait complete. 2024-06-06T02:38:56.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.407+0000 7f950de00640 1 Processor -- start 2024-06-06T02:38:56.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.407+0000 7f950de00640 1 -- start start 2024-06-06T02:38:56.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 0x7f95081a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:56.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f95081a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:56.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950810cff0 0x7f950819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:56.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9508112c50 con 0x7f95081044e0 2024-06-06T02:38:56.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9508112ad0 con 0x7f950810cff0 2024-06-06T02:38:56.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950de00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9508112dd0 con 0x7f9508103b90 2024-06-06T02:38:56.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 0x7f95081a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 0x7f95081a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33998/0 (socket says 172.21.15.82:33998) 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950ca00640 1 -- 172.21.15.82:0/1529666955 learned_addr learned my addr 172.21.15.82:0/1529666955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f9507e00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f95081a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.408+0000 7f950d400640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950810cff0 0x7f950819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.409+0000 7f9507e00640 1 -- 172.21.15.82:0/1529666955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 msgr2=0x7f95081a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.409+0000 7f9507e00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 0x7f95081a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.409+0000 7f9507e00640 1 -- 172.21.15.82:0/1529666955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950810cff0 msgr2=0x7f950819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.409+0000 7f9507e00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950810cff0 0x7f950819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.409+0000 7f9507e00640 1 -- 172.21.15.82:0/1529666955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950819be60 con 0x7f95081044e0 2024-06-06T02:38:56.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f9507e00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f95081a1b20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f950806a330 tx=0x7f94f400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f400ccd0 con 0x7f95081044e0 2024-06-06T02:38:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94f40035f0 con 0x7f95081044e0 2024-06-06T02:38:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950819c150 con 0x7f95081044e0 2024-06-06T02:38:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f4010690 con 0x7f95081044e0 2024-06-06T02:38:56.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.410+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95081a83e0 con 0x7f95081044e0 2024-06-06T02:38:56.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.412+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9508103fa0 con 0x7f95081044e0 2024-06-06T02:38:56.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.416+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f94f4003a80 con 0x7f95081044e0 2024-06-06T02:38:56.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.420+0000 7f9505600640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 0x7f94f00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:38:56.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.420+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f94f40e26e0 con 0x7f95081044e0 2024-06-06T02:38:56.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.421+0000 7f950ca00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 0x7f94f00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:38:56.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.421+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f94f4009510 con 0x7f95081044e0 2024-06-06T02:38:56.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.422+0000 7f950ca00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 0x7f94f00b4e90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94fc005940 tx=0x7f94fc0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:38:56.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.728+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f950819ccd0 con 0x7f95081044e0 2024-06-06T02:38:56.729 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:56 smithi082 ceph-mon[31579]: pgmap v480: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-06T02:38:56.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.730+0000 7f9505600640 1 -- 172.21.15.82:0/1529666955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11869 (secure 0 0 0) 0x7f94f40aa260 con 0x7f95081044e0 2024-06-06T02:38:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:38:56.731 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:37:56.246245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24659,24664,24676]},"id":1}]} 2024-06-06T02:38:56.731 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 msgr2=0x7f94f00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 0x7f94f00b4e90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94fc005940 tx=0x7f94fc0058b0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 msgr2=0x7f95081a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f95081a1b20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f950806a330 tx=0x7f94f400ee50 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 shutdown_connections 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950810cff0 0x7f950819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95081044e0 0x7f95081a1b20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f94f00b2980 0x7f94f00b4e90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.733+0000 7f950de00640 1 --2- 172.21.15.82:0/1529666955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9508103b90 0x7f95081a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.734+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 >> 172.21.15.82:0/1529666955 conn(0x7f95080fd6f0 msgr2=0x7f9508101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:38:56.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.734+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 shutdown_connections 2024-06-06T02:38:56.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:38:56.734+0000 7f950de00640 1 -- 172.21.15.82:0/1529666955 wait complete. 2024-06-06T02:38:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:56 smithi103 ceph-mon[36349]: pgmap v480: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-06T02:38:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:56 smithi184 ceph-mon[36922]: pgmap v480: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-06-06T02:38:57.667 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T02:38:57.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:57 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1529666955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:57.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:57 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1529666955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:57.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:57 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1529666955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:38:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:38:58.562 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:38:58 smithi082 ceph-mon[31579]: pgmap v481: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:38:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:38:58 smithi103 ceph-mon[36349]: pgmap v481: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:38:58.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:38:58 smithi184 ceph-mon[36922]: pgmap v481: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:39:00.819 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:00 smithi082 ceph-mon[31579]: pgmap v482: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:39:00.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:00 smithi103 ceph-mon[36349]: pgmap v482: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:39:00.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:00 smithi184 ceph-mon[36922]: pgmap v482: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-06-06T02:39:01.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 -- 172.21.15.82:0/3973028632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4102aa0 msgr2=0x7f21d4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 --2- 172.21.15.82:0/3973028632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4102aa0 0x7f21d4102eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009930 tx=0x7f21c002a420 comp rx=0 tx=0).stop 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 -- 172.21.15.82:0/3973028632 shutdown_connections 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 --2- 172.21.15.82:0/3973028632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 0x7f21d410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 --2- 172.21.15.82:0/3973028632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4102aa0 0x7f21d4102eb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 --2- 172.21.15.82:0/3973028632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4108ad0 0x7f21d4108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.487+0000 7f21da000640 1 -- 172.21.15.82:0/3973028632 >> 172.21.15.82:0/3973028632 conn(0x7f21d40fe790 msgr2=0x7f21d4100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.488+0000 7f21da000640 1 -- 172.21.15.82:0/3973028632 shutdown_connections 2024-06-06T02:39:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.488+0000 7f21da000640 1 -- 172.21.15.82:0/3973028632 wait complete. 2024-06-06T02:39:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.489+0000 7f21da000640 1 Processor -- start 2024-06-06T02:39:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 -- start start 2024-06-06T02:39:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 0x7f21d4199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4108ad0 0x7f21d419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4112ce0 con 0x7f21d4102aa0 2024-06-06T02:39:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4112b60 con 0x7f21d41033f0 2024-06-06T02:39:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.490+0000 7f21da000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4112e60 con 0x7f21d4108ad0 2024-06-06T02:39:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.491+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.491+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50094/0 (socket says 172.21.15.82:50094) 2024-06-06T02:39:01.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.491+0000 7f21d8c00640 1 -- 172.21.15.82:0/2803832255 learned_addr learned my addr 172.21.15.82:0/2803832255 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.491+0000 7f21d9600640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4108ad0 0x7f21d419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.491+0000 7f21d3e00640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 0x7f21d4199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 -- 172.21.15.82:0/2803832255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4108ad0 msgr2=0x7f21d419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4108ad0 0x7f21d419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 -- 172.21.15.82:0/2803832255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 msgr2=0x7f21d4199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 0x7f21d4199cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 -- 172.21.15.82:0/2803832255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d419e5d0 con 0x7f21d4102aa0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.492+0000 7f21d8c00640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e9c0 tx=0x7f21c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.493+0000 7f21d1600640 1 -- 172.21.15.82:0/2803832255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c800cd80 con 0x7f21d4102aa0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.493+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d419e8c0 con 0x7f21d4102aa0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.493+0000 7f21d1600640 1 -- 172.21.15.82:0/2803832255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c80035f0 con 0x7f21d4102aa0 2024-06-06T02:39:01.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.493+0000 7f21d1600640 1 -- 172.21.15.82:0/2803832255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8010690 con 0x7f21d4102aa0 2024-06-06T02:39:01.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.493+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d4074990 con 0x7f21d4102aa0 2024-06-06T02:39:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.498+0000 7f21e1b25740 1 Processor -- start 2024-06-06T02:39:01.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.498+0000 7f21e1b25740 1 -- start start 2024-06-06T02:39:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e86d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645b0df2e10 con 0x5645b0aaf1b0 2024-06-06T02:39:01.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5645b0de23b0 con 0x5645b0ab7390 2024-06-06T02:39:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21e1b25740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5645b0de63f0 con 0x5645b0ad8070 2024-06-06T02:39:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:49178/0 (socket says 172.21.15.82:49178) 2024-06-06T02:39:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21d3e00640 1 -- 172.21.15.82:0/4230645515 learned_addr learned my addr 172.21.15.82:0/4230645515 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:01.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.499+0000 7f21d9600640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e86d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d1600640 1 -- 172.21.15.82:0/2803832255 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f21c80108f0 con 0x7f21d4102aa0 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d3e00640 1 -- 172.21.15.82:0/4230645515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 msgr2=0x5645b0e86d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d3e00640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e86d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d3e00640 1 -- 172.21.15.82:0/4230645515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 msgr2=0x5645b0e872a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d8c00640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d3e00640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e872a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.500+0000 7f21d3e00640 1 -- 172.21.15.82:0/4230645515 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b0b43650 con 0x5645b0ab7390 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.501+0000 7f21d9600640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e86d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.501+0000 7f21d8c00640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.501+0000 7f21d3e00640 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21c002a940 tx=0x7f21c0032b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f4182056e8a693 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.502+0000 7f21c6000640 1 -- 172.21.15.82:0/4230645515 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c003f070 con 0x5645b0ab7390 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.502+0000 7f21c6000640 1 -- 172.21.15.82:0/4230645515 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c0004030 con 0x5645b0ab7390 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.502+0000 7f21c6000640 1 -- 172.21.15.82:0/4230645515 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0035070 con 0x5645b0ab7390 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.502+0000 7f21d1600640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 0x7f21bc0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21d1600640 1 -- 172.21.15.82:0/2803832255 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f21c8010430 con 0x7f21d4102aa0 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21d9600640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 0x7f21bc0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 -- 172.21.15.82:0/4230645515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 msgr2=0x5645b0e877e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f21c002a940 tx=0x7f21c0032b90 comp rx=0 tx=0).stop 2024-06-06T02:39:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 -- 172.21.15.82:0/4230645515 shutdown_connections 2024-06-06T02:39:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e877e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e872a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.503+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4230645515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e86d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.504+0000 7f21e1b25740 1 -- 172.21.15.82:0/4230645515 >> 172.21.15.82:0/4230645515 conn(0x5645b0acc460 msgr2=0x5645b0e835d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.504+0000 7f21e1b25740 1 -- 172.21.15.82:0/4230645515 shutdown_connections 2024-06-06T02:39:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.504+0000 7f21e1b25740 1 -- 172.21.15.82:0/4230645515 wait complete. 2024-06-06T02:39:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.505+0000 7f21d9600640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 0x7f21bc0b5010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5645b0e83f80 tx=0x7f21cc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.505+0000 7f21e1b25740 1 -- start start 2024-06-06T02:39:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.505+0000 7f21e1b25740 1 Processor -- start 2024-06-06T02:39:01.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e91970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5645b0c46700 con 0x5645b0aaf1b0 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5645b0d7f710 con 0x5645b0ab7390 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5645b0e93e70 con 0x5645b0ad8070 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21e1b25740 10 client.0 _ll_register_callbacks cb 0x5645b0d8bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e91970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21d9600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50110/0 (socket says 172.21.15.82:50110) 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.506+0000 7f21d8c00640 1 -- 172.21.15.82:0/831684794 learned_addr learned my addr 172.21.15.82:0/831684794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d8c00640 1 -- 172.21.15.82:0/831684794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 msgr2=0x5645b0e971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d8c00640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d8c00640 1 -- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 msgr2=0x5645b0e91970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d8c00640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e91970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d9600640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.507+0000 7f21d8c00640 1 -- 172.21.15.82:0/831684794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b0daafc0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.508+0000 7f21d8c00640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f21c80058c0 tx=0x7f21c80e03f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae32fb38f14d895a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.508+0000 7f21baa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.508+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80a9590 con 0x5645b0aaf1b0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.508+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c0004030 con 0x5645b0aaf1b0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.508+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f21c80037a0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.509+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21c80aa180 con 0x5645b0aaf1b0 2024-06-06T02:39:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.509+0000 7f21e1b25740 10 client.15231 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.509+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5645b0e9ff30 con 0x5645b0aaf1b0 2024-06-06T02:39:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.509+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c0004030 con 0x5645b0aaf1b0 2024-06-06T02:39:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f21c80b2520 con 0x5645b0aaf1b0 2024-06-06T02:39:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 10 client.15231 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 10 client.15231 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 20 client.15231 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a969f0 0x5645b0ea36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 4 client.15231 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645b0df4d60 con 0x5645b0a969f0 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.510+0000 7f21d3e00640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a969f0 0x5645b0ea36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.511+0000 7f21baa00640 10 client.15231 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:39:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.511+0000 7f21d3e00640 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a969f0 0x5645b0ea36e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1324e52369ebbc0d server_cookie=675b473495d424f0 in_seq=0 out_seq=0 2024-06-06T02:39:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.512+0000 7f21baa00640 1 -- 172.21.15.82:0/831684794 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5645b0df4d60 con 0x5645b0a969f0 2024-06-06T02:39:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.512+0000 7f21baa00640 10 client.15231 handle_command_reply: tid=0 2024-06-06T02:39:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 client.15231 shutdown 2024-06-06T02:39:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 msgr2=0x5645b0e91430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f21c80058c0 tx=0x7f21c80e03f0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 shutdown_connections 2024-06-06T02:39:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a969f0 0x5645b0ea36e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.513+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0e971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21baa00640 0 client.15231 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:39:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e91970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 1 --2- 172.21.15.82:0/831684794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e91430 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 >> 172.21.15.82:0/831684794 conn(0x5645b0acc460 msgr2=0x5645b0e86b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 shutdown_connections 2024-06-06T02:39:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 1 -- 172.21.15.82:0/831684794 wait complete. 2024-06-06T02:39:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.514+0000 7f21e1b25740 20 client.15231 trim_cache size 0 max 16384 2024-06-06T02:39:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 Processor -- start 2024-06-06T02:39:01.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 -- start start 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0ab7390 0x5645b0ea8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ad8070 0x5645b0ea93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41aee90 con 0x5645b0ab7390 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41ac760 con 0x5645b0ad8070 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.542+0000 7f21e1b25740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41aa590 con 0x5645b0aaf1b0 2024-06-06T02:39:01.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.543+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0ab7390 0x5645b0ea8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.543+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.543+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:34036/0 (socket says 172.21.15.82:34036) 2024-06-06T02:39:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.543+0000 7f21d8c00640 1 -- 172.21.15.82:0/4250889167 learned_addr learned my addr 172.21.15.82:0/4250889167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.543+0000 7f21d9600640 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ad8070 0x5645b0ea93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 -- 172.21.15.82:0/4250889167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ad8070 msgr2=0x5645b0ea93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ad8070 0x5645b0ea93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 -- 172.21.15.82:0/4250889167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0ab7390 msgr2=0x5645b0ea8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0ab7390 0x5645b0ea8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 -- 172.21.15.82:0/4250889167 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b0e97fd0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21d8c00640 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c6a0 tx=0x7f21c80c4250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb0b8f003bbb943 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21c5600640 1 -- 172.21.15.82:0/4250889167 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80a5940 con 0x5645b0aaf1b0 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21c5600640 1 -- 172.21.15.82:0/4250889167 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c80ca070 con 0x5645b0aaf1b0 2024-06-06T02:39:01.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.544+0000 7f21c5600640 1 -- 172.21.15.82:0/4250889167 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80b28e0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 -- 172.21.15.82:0/4250889167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 msgr2=0x5645b0e8b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c6a0 tx=0x7f21c80c4250 comp rx=0 tx=0).stop 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 -- 172.21.15.82:0/4250889167 shutdown_connections 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ad8070 0x5645b0ea93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0ab7390 0x5645b0ea8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 --2- 172.21.15.82:0/4250889167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0aaf1b0 0x5645b0e8b0b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.545+0000 7f21e1b25740 1 -- 172.21.15.82:0/4250889167 >> 172.21.15.82:0/4250889167 conn(0x5645b0acc460 msgr2=0x5645b0e8a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.546+0000 7f21e1b25740 1 -- 172.21.15.82:0/4250889167 shutdown_connections 2024-06-06T02:39:01.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.546+0000 7f21e1b25740 1 -- 172.21.15.82:0/4250889167 wait complete. 2024-06-06T02:39:01.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.546+0000 7f21e1b25740 1 -- start start 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.546+0000 7f21e1b25740 1 Processor -- start 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e99140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0f03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41aac20 con 0x5645b0aaf1b0 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41ac090 con 0x5645b0ab7390 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41ab2f0 con 0x5645b0ad8070 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21e1b25740 10 client.0 _ll_register_callbacks cb 0x7f21c8003dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.547+0000 7f21d9600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0f03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50126/0 (socket says 172.21.15.82:50126) 2024-06-06T02:39:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 -- 172.21.15.82:0/1195560531 learned_addr learned my addr 172.21.15.82:0/1195560531 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d3e00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e99140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 -- 172.21.15.82:0/1195560531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 msgr2=0x5645b0f03e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0f03e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 -- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 msgr2=0x5645b0e99140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e99140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d8c00640 1 -- 172.21.15.82:0/1195560531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b0f043f0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.548+0000 7f21d3e00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e99140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21d8c00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21c80cc090 tx=0x7f21c80039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d9a90fea6f171f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21baa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80a5940 con 0x5645b0aaf1b0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f21c80a6070 con 0x5645b0aaf1b0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c80ca070 con 0x5645b0aaf1b0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21c80a9590 con 0x5645b0aaf1b0 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21e1b25740 10 client.15237 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.549+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5645b0f043f0 con 0x5645b0aaf1b0 2024-06-06T02:39:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c80ca070 con 0x5645b0aaf1b0 2024-06-06T02:39:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f21c8087070 con 0x5645b0aaf1b0 2024-06-06T02:39:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 10 client.15237 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 10 client.15237 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 20 client.15237 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a6bda0 0x5645b0f0d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 4 client.15237 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.550+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645b0df0800 con 0x5645b0a6bda0 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.551+0000 7f21d3e00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a6bda0 0x5645b0f0d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.551+0000 7f21d3e00640 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a6bda0 0x5645b0f0d9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eee6bd75a1a9aba7 server_cookie=6a2171a5cad43f8 in_seq=0 out_seq=0 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.551+0000 7f21baa00640 10 client.15237 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21baa00640 1 -- 172.21.15.82:0/1195560531 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645b0df0800 con 0x5645b0a6bda0 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21baa00640 10 client.15237 handle_command_reply: tid=0 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 client.15237 shutdown 2024-06-06T02:39:01.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 msgr2=0x5645b0e98c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21c80cc090 tx=0x7f21c80039b0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 shutdown_connections 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5645b0a6bda0 0x5645b0f0d9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21baa00640 0 client.15237 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5645b0ad8070 0x5645b0f03e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5645b0ab7390 0x5645b0e99140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 --2- 172.21.15.82:0/1195560531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5645b0aaf1b0 0x5645b0e98c00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 >> 172.21.15.82:0/1195560531 conn(0x5645b0acc460 msgr2=0x5645b0e960d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 shutdown_connections 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 1 -- 172.21.15.82:0/1195560531 wait complete. 2024-06-06T02:39:01.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.552+0000 7f21e1b25740 20 client.15237 trim_cache size 0 max 16384 2024-06-06T02:39:01.555 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:39:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 msgr2=0x7f21bc0b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 0x7f21bc0b5010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5645b0e83f80 tx=0x7f21cc009500 comp rx=0 tx=0).stop 2024-06-06T02:39:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 msgr2=0x7f21d4199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:01.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f21c800e9c0 tx=0x7f21c800ee80 comp rx=0 tx=0).stop 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 shutdown_connections 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f21bc0b2b00 0x7f21bc0b5010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21d4108ad0 0x7f21d419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21d41033f0 0x7f21d4199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 --2- 172.21.15.82:0/2803832255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21d4102aa0 0x7f21d4199760 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.553+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 >> 172.21.15.82:0/2803832255 conn(0x7f21d40fe790 msgr2=0x7f21d40fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.554+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 shutdown_connections 2024-06-06T02:39:01.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:01.554+0000 7f21da000640 1 -- 172.21.15.82:0/2803832255 wait complete. 2024-06-06T02:39:02.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T02:39:02.860 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:02 smithi103 ceph-mon[36349]: pgmap v483: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-06-06T02:39:02.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:02 smithi082 ceph-mon[31579]: pgmap v483: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-06-06T02:39:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:02 smithi184 ceph-mon[36922]: pgmap v483: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-06-06T02:39:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:04 smithi082 ceph-mon[31579]: pgmap v484: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-06-06T02:39:04.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:04 smithi103 ceph-mon[36349]: pgmap v484: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-06-06T02:39:04.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:04 smithi184 ceph-mon[36922]: pgmap v484: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-06-06T02:39:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.184+0000 7f2e94c00640 1 -- 172.21.15.82:0/3448879304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 msgr2=0x7f2e90111750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.184+0000 7f2e94c00640 1 --2- 172.21.15.82:0/3448879304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e90111750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ca0 tx=0x7f2e8802a950 comp rx=0 tx=0).stop 2024-06-06T02:39:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 -- 172.21.15.82:0/3448879304 shutdown_connections 2024-06-06T02:39:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 --2- 172.21.15.82:0/3448879304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e90111750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 --2- 172.21.15.82:0/3448879304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 0x7f2e9010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 --2- 172.21.15.82:0/3448879304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e90074eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 -- 172.21.15.82:0/3448879304 >> 172.21.15.82:0/3448879304 conn(0x7f2e900fe7e0 msgr2=0x7f2e90100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 -- 172.21.15.82:0/3448879304 shutdown_connections 2024-06-06T02:39:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.185+0000 7f2e94c00640 1 -- 172.21.15.82:0/3448879304 wait complete. 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.186+0000 7f2e94c00640 1 Processor -- start 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.186+0000 7f2e94c00640 1 -- start start 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 0x7f2e901a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e9019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90114ef0 con 0x7f2e9010f330 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90114d70 con 0x7f2e900753f0 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e94c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90115070 con 0x7f2e90074aa0 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e8f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e8f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36230/0 (socket says 172.21.15.82:36230) 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e8f400640 1 -- 172.21.15.82:0/2080001951 learned_addr learned my addr 172.21.15.82:0/2080001951 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e9019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.187+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 0x7f2e901a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 -- 172.21.15.82:0/2080001951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 msgr2=0x7f2e901a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 0x7f2e901a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 -- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 msgr2=0x7f2e9019b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e9019b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 -- 172.21.15.82:0/2080001951 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9019be10 con 0x7f2e90074aa0 2024-06-06T02:39:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.188+0000 7f2e8f400640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ea60 tx=0x7f2e7800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.189+0000 7f2e8cc00640 1 -- 172.21.15.82:0/2080001951 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800cde0 con 0x7f2e90074aa0 2024-06-06T02:39:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.189+0000 7f2e8cc00640 1 -- 172.21.15.82:0/2080001951 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e780035f0 con 0x7f2e90074aa0 2024-06-06T02:39:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.189+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9019c100 con 0x7f2e90074aa0 2024-06-06T02:39:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.189+0000 7f2e8cc00640 1 -- 172.21.15.82:0/2080001951 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78010690 con 0x7f2e90074aa0 2024-06-06T02:39:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.189+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901a8300 con 0x7f2e90074aa0 2024-06-06T02:39:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 Processor -- start 2024-06-06T02:39:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 -- start start 2024-06-06T02:39:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e8aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 0x55b525e8afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b525dfede0 con 0x55b525abb1b0 2024-06-06T02:39:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b525dee380 con 0x55b525ac3390 2024-06-06T02:39:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.193+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b525df23c0 con 0x55b525ae4070 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36234/0 (socket says 172.21.15.82:36234) 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 -- 172.21.15.82:0/3974245450 learned_addr learned my addr 172.21.15.82:0/3974245450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e86a00640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 0x55b525e8afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8cc00640 1 -- 172.21.15.82:0/2080001951 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f2e780037a0 con 0x7f2e90074aa0 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 -- 172.21.15.82:0/3974245450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 msgr2=0x55b525e8afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 0x55b525e8afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.194+0000 7f2e8fe00640 1 -- 172.21.15.82:0/3974245450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 msgr2=0x55b525e8aa60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:39:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e8f400640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e8aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e8aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e8fe00640 1 -- 172.21.15.82:0/3974245450 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b525b4f650 con 0x55b525ae4070 2024-06-06T02:39:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e86a00640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 0x55b525e8afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e8f400640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.195+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ca0 tx=0x7f2e880099f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2b6bb826acec68 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.196+0000 7f2e84c00640 1 -- 172.21.15.82:0/3974245450 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88048070 con 0x55b525ae4070 2024-06-06T02:39:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.196+0000 7f2e84c00640 1 -- 172.21.15.82:0/3974245450 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e88003e20 con 0x55b525ae4070 2024-06-06T02:39:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.196+0000 7f2e84c00640 1 -- 172.21.15.82:0/3974245450 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88034040 con 0x55b525ae4070 2024-06-06T02:39:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.196+0000 7f2e8cc00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e8cc00640 1 -- 172.21.15.82:0/2080001951 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2e780e2710 con 0x7f2e90074aa0 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 -- 172.21.15.82:0/3974245450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 msgr2=0x55b525e8a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009ca0 tx=0x7f2e880099f0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 -- 172.21.15.82:0/3974245450 shutdown_connections 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ac3390 0x55b525e8afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e8aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/3974245450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ae4070 0x55b525e8a520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 -- 172.21.15.82:0/3974245450 >> 172.21.15.82:0/3974245450 conn(0x55b525ad8460 msgr2=0x55b525e86d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e8f400640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 -- 172.21.15.82:0/3974245450 shutdown_connections 2024-06-06T02:39:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.197+0000 7f2e9c8da740 1 -- 172.21.15.82:0/3974245450 wait complete. 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.198+0000 7f2e8f400640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 0x7f2e740b4d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b525e87c80 tx=0x7f2e7800ef90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.198+0000 7f2e9c8da740 1 -- start start 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.198+0000 7f2e9c8da740 1 Processor -- start 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e94c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b525c52700 con 0x55b525ac3390 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b525d8b6e0 con 0x55b525ae4070 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55b525e97630 con 0x55b525abb1b0 2024-06-06T02:39:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e9c8da740 10 client.0 _ll_register_callbacks cb 0x55b525d97da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e86a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e86a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42582/0 (socket says 172.21.15.82:42582) 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e86a00640 1 -- 172.21.15.82:0/2471582549 learned_addr learned my addr 172.21.15.82:0/2471582549 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.199+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e94c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 -- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 msgr2=0x55b525e94c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e94c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 -- 172.21.15.82:0/2471582549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 msgr2=0x55b525e9a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 -- 172.21.15.82:0/2471582549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b525db6f90 con 0x55b525ac3390 2024-06-06T02:39:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e80013510 tx=0x7f2e800139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29de9ce004a0a6ff server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e7d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80004230 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2e800043d0 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.200+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e88003e20 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e80013320 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 10 client.15246 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b525ea3700 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e88003e20 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x55b525ac3390 2024-06-06T02:39:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 10 client.15246 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 10 client.15246 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 20 client.15246 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525aa29f0 0x55b525ea6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 4 client.15246 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.201+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b525e00d30 con 0x55b525aa29f0 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.202+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525aa29f0 0x55b525ea6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.202+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525aa29f0 0x55b525ea6bf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=558fbffc4acd12da server_cookie=57c3eb9aa035566 in_seq=0 out_seq=0 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.202+0000 7f2e7d600640 10 client.15246 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e7d600640 1 -- 172.21.15.82:0/2471582549 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b525e00d30 con 0x55b525aa29f0 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e7d600640 10 client.15246 handle_command_reply: tid=0 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 client.15246 shutdown 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 msgr2=0x55b525e95190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e80013510 tx=0x7f2e800139d0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 shutdown_connections 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525aa29f0 0x55b525ea6bf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e95190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2471582549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e94c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e7d600640 0 client.15246 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.203+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 >> 172.21.15.82:0/2471582549 conn(0x55b525ad8460 msgr2=0x55b525e8c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.204+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 shutdown_connections 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.204+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2471582549 wait complete. 2024-06-06T02:39:05.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.204+0000 7f2e9c8da740 20 client.15246 trim_cache size 0 max 16384 2024-06-06T02:39:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.219+0000 7f2e9c8da740 1 Processor -- start 2024-06-06T02:39:05.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.219+0000 7f2e9c8da740 1 -- start start 2024-06-06T02:39:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e90250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901b3160 con 0x55b525ac3390 2024-06-06T02:39:05.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901b0a30 con 0x55b525ae4070 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901ae860 con 0x55b525abb1b0 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e86a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e86a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42592/0 (socket says 172.21.15.82:42592) 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e86a00640 1 -- 172.21.15.82:0/4154707989 learned_addr learned my addr 172.21.15.82:0/4154707989 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e90250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.220+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 -- 172.21.15.82:0/4154707989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 msgr2=0x55b525e90250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e90250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 -- 172.21.15.82:0/4154707989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 msgr2=0x55b525e968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 -- 172.21.15.82:0/4154707989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b525e82640 con 0x55b525ac3390 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e90250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e86a00640 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e800134e0 tx=0x7f2e800115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f31a1866a070da server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e7fe00640 1 -- 172.21.15.82:0/4154707989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8002b030 con 0x55b525ac3390 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e7fe00640 1 -- 172.21.15.82:0/4154707989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e80005560 con 0x55b525ac3390 2024-06-06T02:39:05.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.221+0000 7f2e7fe00640 1 -- 172.21.15.82:0/4154707989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80003b00 con 0x55b525ac3390 2024-06-06T02:39:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- 172.21.15.82:0/4154707989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 msgr2=0x55b525e9a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2e800134e0 tx=0x7f2e800115e0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- 172.21.15.82:0/4154707989 shutdown_connections 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525ac3390 0x55b525e9a8a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/4154707989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525abb1b0 0x55b525e90250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- 172.21.15.82:0/4154707989 >> 172.21.15.82:0/4154707989 conn(0x55b525ad8460 msgr2=0x55b525e961a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- 172.21.15.82:0/4154707989 shutdown_connections 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- 172.21.15.82:0/4154707989 wait complete. 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.223+0000 7f2e9c8da740 1 -- start start 2024-06-06T02:39:05.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 Processor -- start 2024-06-06T02:39:05.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ac3390 0x55b525e9cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901aeef0 con 0x55b525abb1b0 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901b0360 con 0x55b525ae4070 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2e901af5c0 con 0x55b525ac3390 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e9c8da740 10 client.0 _ll_register_callbacks cb 0x7f2e80009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.224+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42598/0 (socket says 172.21.15.82:42598) 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 -- 172.21.15.82:0/2492352982 learned_addr learned my addr 172.21.15.82:0/2492352982 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ac3390 0x55b525e9cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 -- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ac3390 msgr2=0x55b525e9cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ac3390 0x55b525e9cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 -- 172.21.15.82:0/2492352982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 msgr2=0x55b525e9d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 -- 172.21.15.82:0/2492352982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b525f16b90 con 0x55b525abb1b0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e8fe00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009620 tx=0x7f2e88055040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e79786e37bf256b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.225+0000 7f2e7d600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88048040 con 0x55b525abb1b0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2e88030970 con 0x55b525abb1b0 2024-06-06T02:39:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e80005560 con 0x55b525abb1b0 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e88030b70 con 0x55b525abb1b0 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e9c8da740 10 client.15252 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b525f17d40 con 0x55b525abb1b0 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.226+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e80005560 con 0x55b525abb1b0 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f2e88043410 con 0x55b525abb1b0 2024-06-06T02:39:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 10 client.15252 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 10 client.15252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 20 client.15252 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525a77da0 0x55b525f1a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 4 client.15252 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b525dfc7d0 con 0x55b525a77da0 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.227+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525a77da0 0x55b525f1a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e86a00640 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525a77da0 0x55b525f1a0e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a86a3ef80cf1d5a1 server_cookie=bb9131ba046d5b5a in_seq=0 out_seq=0 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e7d600640 10 client.15252 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e7d600640 1 -- 172.21.15.82:0/2492352982 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b525dfc7d0 con 0x55b525a77da0 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e7d600640 10 client.15252 handle_command_reply: tid=0 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 client.15252 shutdown 2024-06-06T02:39:05.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 msgr2=0x55b525e9c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009620 tx=0x7f2e88055040 comp rx=0 tx=0).stop 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 shutdown_connections 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x55b525a77da0 0x55b525f1a0e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b525ae4070 0x55b525e9d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b525ac3390 0x55b525e9cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e7d600640 0 client.15252 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 --2- 172.21.15.82:0/2492352982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b525abb1b0 0x55b525e9c9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.228+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 >> 172.21.15.82:0/2492352982 conn(0x55b525ad8460 msgr2=0x55b525e8a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 shutdown_connections 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e9c8da740 1 -- 172.21.15.82:0/2492352982 wait complete. 2024-06-06T02:39:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e9c8da740 20 client.15252 trim_cache size 0 max 16384 2024-06-06T02:39:05.232 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:39:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 msgr2=0x7f2e740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 0x7f2e740b4d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55b525e87c80 tx=0x7f2e7800ef90 comp rx=0 tx=0).stop 2024-06-06T02:39:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 msgr2=0x7f2e901a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ea60 tx=0x7f2e7800ef20 comp rx=0 tx=0).stop 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 shutdown_connections 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9010f330 0x7f2e9019b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e900753f0 0x7f2e901a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.229+0000 7f2e94c00640 1 --2- 172.21.15.82:0/2080001951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e90074aa0 0x7f2e901a1550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.230+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 >> 172.21.15.82:0/2080001951 conn(0x7f2e900fe7e0 msgr2=0x7f2e90100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.230+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 shutdown_connections 2024-06-06T02:39:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:05.230+0000 7f2e94c00640 1 -- 172.21.15.82:0/2080001951 wait complete. 2024-06-06T02:39:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 -- 172.21.15.82:0/541099337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e10101c10 msgr2=0x7f0e10102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 --2- 172.21.15.82:0/541099337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e10101c10 0x7f0e10102020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009900 tx=0x7f0dfc02a3f0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 -- 172.21.15.82:0/541099337 shutdown_connections 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 --2- 172.21.15.82:0/541099337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 0x7f0e10102970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 --2- 172.21.15.82:0/541099337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e10101c10 0x7f0e10102020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 --2- 172.21.15.82:0/541099337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e101012c0 0x7f0e101016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 -- 172.21.15.82:0/541099337 >> 172.21.15.82:0/541099337 conn(0x7f0e100fd0c0 msgr2=0x7f0e100ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 -- 172.21.15.82:0/541099337 shutdown_connections 2024-06-06T02:39:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.744+0000 7f0e15000640 1 -- 172.21.15.82:0/541099337 wait complete. 2024-06-06T02:39:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.745+0000 7f0e15000640 1 Processor -- start 2024-06-06T02:39:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.745+0000 7f0e15000640 1 -- start start 2024-06-06T02:39:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e10101c10 0x7f0e1019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 0x7f0e101a2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10110740 con 0x7f0e101012c0 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101105c0 con 0x7f0e10102560 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e15000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101108c0 con 0x7f0e10101c10 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42608/0 (socket says 172.21.15.82:42608) 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 -- 172.21.15.82:0/777804021 learned_addr learned my addr 172.21.15.82:0/777804021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 0x7f0e101a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e10101c10 0x7f0e1019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 -- 172.21.15.82:0/777804021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e10101c10 msgr2=0x7f0e1019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e10101c10 0x7f0e1019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 -- 172.21.15.82:0/777804021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 msgr2=0x7f0e101a2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 0x7f0e101a2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.746+0000 7f0e0f400640 1 -- 172.21.15.82:0/777804021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e101a2e90 con 0x7f0e101012c0 2024-06-06T02:39:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e0f400640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9c0 tx=0x7f0e0000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e07e00640 1 -- 172.21.15.82:0/777804021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000ccc0 con 0x7f0e101012c0 2024-06-06T02:39:05.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e07e00640 1 -- 172.21.15.82:0/777804021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e000035f0 con 0x7f0e101012c0 2024-06-06T02:39:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e101a3180 con 0x7f0e101012c0 2024-06-06T02:39:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e07e00640 1 -- 172.21.15.82:0/777804021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000ce60 con 0x7f0e101012c0 2024-06-06T02:39:05.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.747+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e101a36d0 con 0x7f0e101012c0 2024-06-06T02:39:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.751+0000 7f0e07e00640 1 -- 172.21.15.82:0/777804021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f0e00004000 con 0x7f0e101012c0 2024-06-06T02:39:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 Processor -- start 2024-06-06T02:39:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 -- start start 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245254d0 0x5613248f2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56132485d480 con 0x5613245461b0 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56132484ca20 con 0x5613245254d0 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e1d679740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561324850a60 con 0x56132451d2f0 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.752+0000 7f0e07e00640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 0x7f0df40b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36288/0 (socket says 172.21.15.82:36288) 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 -- 172.21.15.82:0/1641168263 learned_addr learned my addr 172.21.15.82:0/1641168263 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245254d0 0x5613248f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 0x7f0df40b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e07e00640 1 -- 172.21.15.82:0/777804021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0e000e28d0 con 0x7f0e101012c0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 -- 172.21.15.82:0/1641168263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245254d0 msgr2=0x5613248f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245254d0 0x5613248f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 -- 172.21.15.82:0/1641168263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 msgr2=0x5613248eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.753+0000 7f0e0f400640 1 -- 172.21.15.82:0/1641168263 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613248498d0 con 0x56132451d2f0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.754+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e000e0180 tx=0x7f0e000a94c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f747109ad823367 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.754+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 0x7f0df40b4e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b80 tx=0x7f0e08009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.754+0000 7f0e04c00640 1 -- 172.21.15.82:0/1641168263 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000aa450 con 0x56132451d2f0 2024-06-06T02:39:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.754+0000 7f0e04c00640 1 -- 172.21.15.82:0/1641168263 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e000a9d50 con 0x56132451d2f0 2024-06-06T02:39:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.754+0000 7f0e04c00640 1 -- 172.21.15.82:0/1641168263 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000042f0 con 0x56132451d2f0 2024-06-06T02:39:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 -- 172.21.15.82:0/1641168263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 msgr2=0x5613248eb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e000e0180 tx=0x7f0e000a94c0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 -- 172.21.15.82:0/1641168263 shutdown_connections 2024-06-06T02:39:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245254d0 0x5613248f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56132451d2f0 0x5613248eb480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1641168263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 -- 172.21.15.82:0/1641168263 >> 172.21.15.82:0/1641168263 conn(0x56132453a300 msgr2=0x5613248e68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 -- 172.21.15.82:0/1641168263 shutdown_connections 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.755+0000 7f0e1d679740 1 -- 172.21.15.82:0/1641168263 wait complete. 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.756+0000 7f0e1d679740 1 -- start start 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.756+0000 7f0e1d679740 1 Processor -- start 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 0x5613248fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561324787ab0 con 0x56132451d2f0 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613247ea630 con 0x5613245461b0 2024-06-06T02:39:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5613248f2d10 con 0x5613245254d0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e1d679740 10 client.0 _ll_register_callbacks cb 0x5613247f0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42622/0 (socket says 172.21.15.82:42622) 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 -- 172.21.15.82:0/1302977328 learned_addr learned my addr 172.21.15.82:0/1302977328 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 0x5613248fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 -- 172.21.15.82:0/1302977328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 msgr2=0x5613248f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 -- 172.21.15.82:0/1302977328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 msgr2=0x5613248fbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 0x5613248fbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0f400640 1 -- 172.21.15.82:0/1302977328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561324817170 con 0x56132451d2f0 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.757+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 0x5613248fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0e0f400640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e000e2bc0 tx=0x7f0e000039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60a9f9d0ec2424d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0df9600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e000a91b0 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0e000a56c0 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e000a9d50 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e000b2bb0 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0e1d679740 10 client.15264 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5613245b1790 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.758+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e000a9d50 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f0e000af290 con 0x56132451d2f0 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 10 client.15264 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 10 client.15264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 20 client.15264 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561324504d80 0x561324901990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 4 client.15264 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56132485f3d0 con 0x561324504d80 2024-06-06T02:39:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.759+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561324504d80 0x561324901990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.760+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561324504d80 0x561324901990 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315bb551324b9257 server_cookie=821bf0a9e83c9e7f in_seq=0 out_seq=0 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.760+0000 7f0df9600640 10 client.15264 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0df9600640 1 -- 172.21.15.82:0/1302977328 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56132485f3d0 con 0x561324504d80 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0df9600640 10 client.15264 handle_command_reply: tid=0 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 client.15264 shutdown 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 msgr2=0x5613248f4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e000e2bc0 tx=0x7f0e000039d0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 shutdown_connections 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613245461b0 0x5613248fbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561324504d80 0x561324901990 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 --2- 172.21.15.82:0/1302977328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56132451d2f0 0x5613248f4680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0df9600640 0 client.15264 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.761+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 >> 172.21.15.82:0/1302977328 conn(0x56132453a300 msgr2=0x5613248e77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.762+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 shutdown_connections 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.762+0000 7f0e1d679740 1 -- 172.21.15.82:0/1302977328 wait complete. 2024-06-06T02:39:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.762+0000 7f0e1d679740 20 client.15264 trim_cache size 0 max 16384 2024-06-06T02:39:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 Processor -- start 2024-06-06T02:39:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 -- start start 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101aed40 con 0x5613245461b0 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101ac610 con 0x56132451d2f0 2024-06-06T02:39:05.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.789+0000 7f0e1d679740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101aa440 con 0x5613245254d0 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36314/0 (socket says 172.21.15.82:36314) 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248edfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60072/0 (socket says 172.21.15.82:60072) 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 -- 172.21.15.82:0/386998611 learned_addr learned my addr 172.21.15.82:0/386998611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248fbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42626/0 (socket says 172.21.15.82:42626) 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 -- 172.21.15.82:0/386998611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 msgr2=0x5613248edfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248edfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 -- 172.21.15.82:0/386998611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 msgr2=0x5613248fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.790+0000 7f0e0ea00640 1 -- 172.21.15.82:0/386998611 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132462a620 con 0x5613245254d0 2024-06-06T02:39:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.795+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009230 tx=0x7f0dfc004550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c155363c7d707d6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.795+0000 7f0dfbe00640 1 -- 172.21.15.82:0/386998611 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc035040 con 0x5613245254d0 2024-06-06T02:39:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.795+0000 7f0dfbe00640 1 -- 172.21.15.82:0/386998611 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc04a070 con 0x5613245254d0 2024-06-06T02:39:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.795+0000 7f0dfbe00640 1 -- 172.21.15.82:0/386998611 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc031800 con 0x5613245254d0 2024-06-06T02:39:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 -- 172.21.15.82:0/386998611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 msgr2=0x5613248fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009230 tx=0x7f0dfc004550 comp rx=0 tx=0).stop 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 -- 172.21.15.82:0/386998611 shutdown_connections 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x5613248fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248fb9d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 --2- 172.21.15.82:0/386998611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248edfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 -- 172.21.15.82:0/386998611 >> 172.21.15.82:0/386998611 conn(0x56132453a300 msgr2=0x5613248e7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 -- 172.21.15.82:0/386998611 shutdown_connections 2024-06-06T02:39:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.796+0000 7f0e1d679740 1 -- 172.21.15.82:0/386998611 wait complete. 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.797+0000 7f0e1d679740 1 -- start start 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.797+0000 7f0e1d679740 1 Processor -- start 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101aaad0 con 0x5613245461b0 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101abf40 con 0x56132451d2f0 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0e101ab1a0 con 0x5613245254d0 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e1d679740 10 client.0 _ll_register_callbacks cb 0x7f0e000a96a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42640/0 (socket says 172.21.15.82:42640) 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 -- 172.21.15.82:0/2906055264 learned_addr learned my addr 172.21.15.82:0/2906055264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0ea00640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 -- 172.21.15.82:0/2906055264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 msgr2=0x5613248f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 -- 172.21.15.82:0/2906055264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 msgr2=0x5613248f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.798+0000 7f0e0fe00640 1 -- 172.21.15.82:0/2906055264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561324968570 con 0x5613245461b0 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0e0fe00640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e08003bb0 tx=0x7f0e08004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c8a24fad103f49 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0df9600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08020660 con 0x5613245461b0 2024-06-06T02:39:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0e08020800 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dfc04a070 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.799+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e08020a00 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 10 client.15270 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5613249696b0 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dfc04a070 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7f0e0801d040 con 0x5613245461b0 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 10 client.15270 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 10 client.15270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 20 client.15270 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5613244da1c0 0x56132496c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 4 client.15270 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:39:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5613248eb580 con 0x5613244da1c0 2024-06-06T02:39:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.800+0000 7f0e0f400640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5613244da1c0 0x56132496c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.801+0000 7f0df9600640 10 client.15270 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.801+0000 7f0e0f400640 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5613244da1c0 0x56132496c170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac0eb2ff420fcc0 server_cookie=9d5de6c70a3ef77c in_seq=0 out_seq=0 2024-06-06T02:39:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.805+0000 7f0df9600640 1 -- 172.21.15.82:0/2906055264 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5613248eb580 con 0x5613244da1c0 2024-06-06T02:39:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.805+0000 7f0df9600640 10 client.15270 handle_command_reply: tid=0 2024-06-06T02:39:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.805+0000 7f0e1d679740 1 client.15270 shutdown 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.805+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 msgr2=0x561324968030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.805+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e08003bb0 tx=0x7f0e08004ab0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 shutdown_connections 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5613244da1c0 0x56132496c170 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5613245461b0 0x561324968030 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5613245254d0 0x5613248f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 --2- 172.21.15.82:0/2906055264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56132451d2f0 0x5613248f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 >> 172.21.15.82:0/2906055264 conn(0x56132453a300 msgr2=0x5613248e4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0df9600640 0 client.15270 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 shutdown_connections 2024-06-06T02:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 1 -- 172.21.15.82:0/2906055264 wait complete. 2024-06-06T02:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.806+0000 7f0e1d679740 20 client.15270 trim_cache size 0 max 16384 2024-06-06T02:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:39:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 msgr2=0x7f0df40b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 0x7f0df40b4e00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009b80 tx=0x7f0e08009500 comp rx=0 tx=0).stop 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 msgr2=0x7f0e1019b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000e9c0 tx=0x7f0e0000edc0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 shutdown_connections 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102560 0x7f0e101a2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0df40b28f0 0x7f0df40b4e00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e10101c10 0x7f0e1019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 --2- 172.21.15.82:0/777804021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e101012c0 0x7f0e1019b350 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 >> 172.21.15.82:0/777804021 conn(0x7f0e100fd0c0 msgr2=0x7f0e101098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 shutdown_connections 2024-06-06T02:39:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:05.807+0000 7f0e15000640 1 -- 172.21.15.82:0/777804021 wait complete. 2024-06-06T02:39:06.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T02:39:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:06.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:06 smithi082 ceph-mon[31579]: pgmap v485: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-06-06T02:39:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:06 smithi103 ceph-mon[36349]: pgmap v485: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-06-06T02:39:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:06 smithi184 ceph-mon[36922]: pgmap v485: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 8 op/s 2024-06-06T02:39:07.453 INFO:tasks.workunit.client.0.smithi082.stderr:Updating files: 62% (7527/12088) Updating files: 63% (7616/12088) Updating files: 64% (7737/12088) Updating files: 65% (7858/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 99% (11993/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-06-06T02:39:07.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:07 smithi184 ceph-mon[36922]: pgmap v486: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:07.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:07 smithi082 ceph-mon[31579]: pgmap v486: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:07 smithi103 ceph-mon[36349]: pgmap v486: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to '3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8'. 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-06-06T02:39:08.600 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-06-06T02:39:08.601 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at 3c55257c8d0 Merge PR #48130 into wip-pdonnell-testing-20240605.005022-debug 2024-06-06T02:39:08.613 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-06-06T02:39:08.701 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-06-06T02:39:08.709 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T02:39:08.709 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 -- 172.21.15.82:0/1397357940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c1050f0 msgr2=0x7fcb7c105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 --2- 172.21.15.82:0/1397357940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c105500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009930 tx=0x7fcb6c02a420 comp rx=0 tx=0).stop 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 -- 172.21.15.82:0/1397357940 shutdown_connections 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 --2- 172.21.15.82:0/1397357940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 --2- 172.21.15.82:0/1397357940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c109a20 0x7fcb7c109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 --2- 172.21.15.82:0/1397357940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c105500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 -- 172.21.15.82:0/1397357940 >> 172.21.15.82:0/1397357940 conn(0x7fcb7c100b90 msgr2=0x7fcb7c102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 -- 172.21.15.82:0/1397357940 shutdown_connections 2024-06-06T02:39:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.260+0000 7fcb82000640 1 -- 172.21.15.82:0/1397357940 wait complete. 2024-06-06T02:39:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.261+0000 7fcb82000640 1 Processor -- start 2024-06-06T02:39:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 -- start start 2024-06-06T02:39:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 0x7fcb7c1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c115100 con 0x7fcb7c1050f0 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c114f80 con 0x7fcb7c10a370 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.262+0000 7fcb82000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c115280 con 0x7fcb7c109a20 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42660/0 (socket says 172.21.15.82:42660) 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 -- 172.21.15.82:0/2022620311 learned_addr learned my addr 172.21.15.82:0/2022620311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb72a00640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 0x7fcb7c1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7be00640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 -- 172.21.15.82:0/2022620311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 msgr2=0x7fcb7c1a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 0x7fcb7c1a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 -- 172.21.15.82:0/2022620311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 msgr2=0x7fcb7c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7b400640 1 -- 172.21.15.82:0/2022620311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c19bf60 con 0x7fcb7c1050f0 2024-06-06T02:39:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb7be00640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.263+0000 7fcb72a00640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 0x7fcb7c1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb7b400640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c02a940 tx=0x7fcb6c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb78c00640 1 -- 172.21.15.82:0/2022620311 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c03f070 con 0x7fcb7c1050f0 2024-06-06T02:39:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c19c1f0 con 0x7fcb7c1050f0 2024-06-06T02:39:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb78c00640 1 -- 172.21.15.82:0/2022620311 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb6c03bb10 con 0x7fcb7c1050f0 2024-06-06T02:39:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb78c00640 1 -- 172.21.15.82:0/2022620311 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035030 con 0x7fcb7c1050f0 2024-06-06T02:39:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.264+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c19c720 con 0x7fcb7c1050f0 2024-06-06T02:39:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.268+0000 7fcb885ee740 1 Processor -- start 2024-06-06T02:39:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.268+0000 7fcb885ee740 1 -- start start 2024-06-06T02:39:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.268+0000 7fcb78c00640 1 -- 172.21.15.82:0/2022620311 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fcb6c042070 con 0x7fcb7c1050f0 2024-06-06T02:39:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a428b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a42df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b109b6e10 con 0x561b1069c070 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561b109a63b0 con 0x561b106731b0 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb885ee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561b109aa3f0 con 0x561b1067b390 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42676/0 (socket says 172.21.15.82:42676) 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb7be00640 1 -- 172.21.15.82:0/882169367 learned_addr learned my addr 172.21.15.82:0/882169367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb7b400640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.269+0000 7fcb72a00640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a42df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 -- 172.21.15.82:0/882169367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 msgr2=0x561b10a42df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a42df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 -- 172.21.15.82:0/882169367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 msgr2=0x561b10a428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 -- 172.21.15.82:0/882169367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b10707650 con 0x561b1069c070 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7b400640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb72a00640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a42df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb7be00640 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb74011440 tx=0x7fcb74011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4b766441676d44 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb70c00640 1 -- 172.21.15.82:0/882169367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74004020 con 0x561b1069c070 2024-06-06T02:39:09.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb70c00640 1 -- 172.21.15.82:0/882169367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb740041c0 con 0x561b1069c070 2024-06-06T02:39:09.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb70c00640 1 -- 172.21.15.82:0/882169367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7400f7a0 con 0x561b1069c070 2024-06-06T02:39:09.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.270+0000 7fcb78c00640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 0x7fcb600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.271+0000 7fcb7b400640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 0x7fcb600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.271+0000 7fcb78c00640 1 -- 172.21.15.82:0/2022620311 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb6c102940 con 0x7fcb7c1050f0 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.271+0000 7fcb885ee740 1 -- 172.21.15.82:0/882169367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 msgr2=0x561b10a42370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.271+0000 7fcb885ee740 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcb74011440 tx=0x7fcb74011900 comp rx=0 tx=0).stop 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.271+0000 7fcb7b400640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 0x7fcb600b4e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x561b10a3fad0 tx=0x7fcb6c108530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 -- 172.21.15.82:0/882169367 shutdown_connections 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a42df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 --2- 172.21.15.82:0/882169367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a42370 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 -- 172.21.15.82:0/882169367 >> 172.21.15.82:0/882169367 conn(0x561b10690460 msgr2=0x561b10a3ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 -- 172.21.15.82:0/882169367 shutdown_connections 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 -- 172.21.15.82:0/882169367 wait complete. 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.272+0000 7fcb885ee740 1 -- start start 2024-06-06T02:39:09.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 Processor -- start 2024-06-06T02:39:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a4cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b1080a700 con 0x561b1069c070 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561b10943710 con 0x561b106731b0 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561b10a4f4e0 con 0x561b1067b390 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb885ee740 10 client.0 _ll_register_callbacks cb 0x561b1094fdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.273+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36352/0 (socket says 172.21.15.82:36352) 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 -- 172.21.15.82:0/58021136 learned_addr learned my addr 172.21.15.82:0/58021136 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb7be00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb7be00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a4cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 -- 172.21.15.82:0/58021136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 msgr2=0x561b10a4cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a4cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 -- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 msgr2=0x561b10a528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 -- 172.21.15.82:0/58021136 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1096efc0 con 0x561b1067b390 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb72a00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005fd0 tx=0x7fcb64012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dba195e52c710f6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.274+0000 7fcb69600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64003970 con 0x561b1067b390 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb740041c0 con 0x561b1067b390 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb64003b10 con 0x561b1067b390 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcb64003d10 con 0x561b1067b390 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb885ee740 10 client.25456 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.275+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b10a5b6f0 con 0x561b1067b390 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb740041c0 con 0x561b1067b390 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fcb64010630 con 0x561b1067b390 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 10 client.25456 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 20 client.25456 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1065a9f0 0x561b10a5ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 4 client.25456 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b109b8d60 con 0x561b1065a9f0 2024-06-06T02:39:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.276+0000 7fcb7be00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1065a9f0 0x561b10a5ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.277+0000 7fcb7be00640 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1065a9f0 0x561b10a5ebb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3152a1d98c8f70 server_cookie=5d526d7d27dc451a in_seq=0 out_seq=0 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.277+0000 7fcb69600640 10 client.25456 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb69600640 1 -- 172.21.15.82:0/58021136 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561b109b8d60 con 0x561b1065a9f0 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb69600640 10 client.25456 handle_command_reply: tid=0 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 client.25456 shutdown 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 msgr2=0x561b10a4d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb64005fd0 tx=0x7fcb64012820 comp rx=0 tx=0).stop 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 shutdown_connections 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1065a9f0 0x561b10a5ebb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1069c070 0x561b10a528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1067b390 0x561b10a4d000 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb69600640 0 client.25456 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 --2- 172.21.15.82:0/58021136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a4cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 >> 172.21.15.82:0/58021136 conn(0x561b10690460 msgr2=0x561b10a440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.278+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 shutdown_connections 2024-06-06T02:39:09.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.279+0000 7fcb885ee740 1 -- 172.21.15.82:0/58021136 wait complete. 2024-06-06T02:39:09.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.279+0000 7fcb885ee740 20 client.25456 trim_cache size 0 max 16384 2024-06-06T02:39:09.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.294+0000 7fcb885ee740 1 Processor -- start 2024-06-06T02:39:09.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.294+0000 7fcb885ee740 1 -- start start 2024-06-06T02:39:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1067b390 0x561b10a64390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10a648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1b3360 con 0x561b1067b390 2024-06-06T02:39:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1b0c30 con 0x561b106731b0 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb885ee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1aea60 con 0x561b1069c070 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1067b390 0x561b10a64390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60114/0 (socket says 172.21.15.82:60114) 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 -- 172.21.15.82:0/3399310568 learned_addr learned my addr 172.21.15.82:0/3399310568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10a648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 -- 172.21.15.82:0/3399310568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 msgr2=0x561b10a648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10a648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 -- 172.21.15.82:0/3399310568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1067b390 msgr2=0x561b10a64390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1067b390 0x561b10a64390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.295+0000 7fcb7be00640 1 -- 172.21.15.82:0/3399310568 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b10a3f7f0 con 0x561b106731b0 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.296+0000 7fcb7be00640 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb74005940 tx=0x7fcb74005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43c5e9efde2839f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.296+0000 7fcb6be00640 1 -- 172.21.15.82:0/3399310568 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7401d040 con 0x561b106731b0 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.296+0000 7fcb6be00640 1 -- 172.21.15.82:0/3399310568 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb7401e040 con 0x561b106731b0 2024-06-06T02:39:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.296+0000 7fcb6be00640 1 -- 172.21.15.82:0/3399310568 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740053e0 con 0x561b106731b0 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 -- 172.21.15.82:0/3399310568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 msgr2=0x561b10a51eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb74005940 tx=0x7fcb74005f90 comp rx=0 tx=0).stop 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 -- 172.21.15.82:0/3399310568 shutdown_connections 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10a648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b1067b390 0x561b10a64390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 --2- 172.21.15.82:0/3399310568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b106731b0 0x561b10a51eb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 -- 172.21.15.82:0/3399310568 >> 172.21.15.82:0/3399310568 conn(0x561b10690460 msgr2=0x561b10a517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 -- 172.21.15.82:0/3399310568 shutdown_connections 2024-06-06T02:39:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.297+0000 7fcb885ee740 1 -- 172.21.15.82:0/3399310568 wait complete. 2024-06-06T02:39:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.298+0000 7fcb885ee740 1 -- start start 2024-06-06T02:39:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.298+0000 7fcb885ee740 1 Processor -- start 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 0x561b10a54da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 0x561b10a552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10ac6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1af0f0 con 0x561b106731b0 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1b0560 con 0x561b1067b390 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1af7c0 con 0x561b1069c070 2024-06-06T02:39:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb885ee740 10 client.0 _ll_register_callbacks cb 0x7fcb6400f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 0x561b10a54da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb72a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 0x561b10a552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb7be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 0x561b10a54da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42710/0 (socket says 172.21.15.82:42710) 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb7be00640 1 -- 172.21.15.82:0/1423701916 learned_addr learned my addr 172.21.15.82:0/1423701916 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.299+0000 7fcb7be00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10ac6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 -- 172.21.15.82:0/1423701916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 msgr2=0x561b10ac6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10ac6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 -- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 msgr2=0x561b10a54da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 0x561b10a54da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 -- 172.21.15.82:0/1423701916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b10ac68a0 con 0x561b1067b390 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb72a00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 0x561b10a552e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400e3d0 tx=0x7fcb64003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e1ff5866fe329b5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb69600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640107c0 con 0x561b1067b390 2024-06-06T02:39:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcb6401c420 con 0x561b1067b390 2024-06-06T02:39:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.300+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb7401e040 con 0x561b1067b390 2024-06-06T02:39:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.301+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fcb6401c620 con 0x561b1067b390 2024-06-06T02:39:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.301+0000 7fcb885ee740 10 client.25430 fetch_fsmap learned FSMap version 26 2024-06-06T02:39:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.301+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561b10ac79a0 con 0x561b1067b390 2024-06-06T02:39:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.301+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb7401e040 con 0x561b1067b390 2024-06-06T02:39:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8338+0+0 (secure 0 0 0) 0x7fcb64027610 con 0x561b1067b390 2024-06-06T02:39:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 10 client.25430 fetch_fsmap finished waiting for FSMap version 26 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 20 client.25430 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1062fda0 0x561b10aca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 4 client.25430 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561b109b4800 con 0x561b1062fda0 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.302+0000 7fcb7be00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1062fda0 0x561b10aca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb7be00640 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1062fda0 0x561b10aca000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452dc65e6bbf0060 server_cookie=5918b70e66d2b7ae in_seq=0 out_seq=0 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb69600640 10 client.25430 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb69600640 1 -- 172.21.15.82:0/1423701916 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561b109b4800 con 0x561b1062fda0 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb69600640 10 client.25430 handle_command_reply: tid=0 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 client.25430 shutdown 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 msgr2=0x561b10a552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 0x561b10a552e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400e3d0 tx=0x7fcb64003c80 comp rx=0 tx=0).stop 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 shutdown_connections 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561b1069c070 0x561b10ac6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561b1067b390 0x561b10a552e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561b1062fda0 0x561b10aca000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 --2- 172.21.15.82:0/1423701916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b106731b0 0x561b10a54da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 >> 172.21.15.82:0/1423701916 conn(0x561b10690460 msgr2=0x561b10a42310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.303+0000 7fcb69600640 0 client.25430 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 shutdown_connections 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb885ee740 1 -- 172.21.15.82:0/1423701916 wait complete. 2024-06-06T02:39:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb885ee740 20 client.25430 trim_cache size 0 max 16384 2024-06-06T02:39:09.307 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 msgr2=0x7fcb600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 0x7fcb600b4e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x561b10a3fad0 tx=0x7fcb6c108530 comp rx=0 tx=0).stop 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 msgr2=0x7fcb7c1a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.304+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c02a940 tx=0x7fcb6c003b90 comp rx=0 tx=0).stop 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 shutdown_connections 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb7c10a370 0x7fcb7c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcb600b2900 0x7fcb600b4e10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb7c109a20 0x7fcb7c1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 --2- 172.21.15.82:0/2022620311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb7c1050f0 0x7fcb7c1a16d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 >> 172.21.15.82:0/2022620311 conn(0x7fcb7c100b90 msgr2=0x7fcb7c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 shutdown_connections 2024-06-06T02:39:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:09.305+0000 7fcb82000640 1 -- 172.21.15.82:0/2022620311 wait complete. 2024-06-06T02:39:10.125 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:09 smithi082 ceph-mon[31579]: pgmap v487: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:39:10.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:09 smithi103 ceph-mon[36349]: pgmap v487: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:39:10.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:09 smithi184 ceph-mon[36922]: pgmap v487: 97 pgs: 97 active+clean; 672 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:39:10.490 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-06-06T02:39:10.602 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-06-06T02:39:10.691 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-06-06T02:39:10.693 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T02:39:10.694 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-06-06T02:39:10.773 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-06-06T02:39:10.783 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:39:10.783 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-06-06T02:39:10.835 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-06-06T02:39:10.837 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-06-06T02:39:10.837 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-06-06T02:39:10.957 INFO:tasks.workunit.client.0.smithi082.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-06-06T02:39:10.959 INFO:tasks.workunit.client.0.smithi082.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-06-06T02:39:10.959 INFO:tasks.workunit.client.0.smithi082.stderr:+ trap -- retry EXIT 2024-06-06T02:39:10.959 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm -rf ffsb 2024-06-06T02:39:10.963 INFO:tasks.workunit.client.0.smithi082.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-06-06T02:39:10.971 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into 'ffsb'... 2024-06-06T02:39:11.401 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T02:39:11.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T02:39:11.880 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:12.224 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:11 smithi082 ceph-mon[31579]: pgmap v488: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:12.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:11 smithi103 ceph-mon[36349]: pgmap v488: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:12.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:11 smithi184 ceph-mon[36922]: pgmap v488: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-06-06T02:39:12.563 INFO:tasks.workunit.client.0.smithi082.stderr:+ trap - EXIT 2024-06-06T02:39:12.563 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd ffsb 2024-06-06T02:39:12.563 INFO:tasks.workunit.client.0.smithi082.stderr:+ ./configure 2024-06-06T02:39:12.884 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-06-06T02:39:13.906 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether build environment is sane... yes 2024-06-06T02:39:13.930 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-06-06T02:39:13.930 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gawk... gawk 2024-06-06T02:39:13.960 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether make sets $(MAKE)... yes 2024-06-06T02:39:14.046 INFO:tasks.workunit.client.0.smithi082.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-06-06T02:39:14.046 INFO:tasks.workunit.client.0.smithi082.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-06-06T02:39:14.062 INFO:tasks.workunit.client.0.smithi082.stdout:checking for style of include used by make... GNU 2024-06-06T02:39:14.070 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... gcc 2024-06-06T02:39:14.180 INFO:tasks.workunit.client.0.smithi082.stdout:checking for C compiler default output file name... a.out 2024-06-06T02:39:14.186 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether the C compiler works... yes 2024-06-06T02:39:14.190 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are cross compiling... no 2024-06-06T02:39:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 -- 172.21.15.82:0/947275817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 msgr2=0x7fcfa41032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 --2- 172.21.15.82:0/947275817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa41032d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009930 tx=0x7fcf9802a420 comp rx=0 tx=0).stop 2024-06-06T02:39:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 -- 172.21.15.82:0/947275817 shutdown_connections 2024-06-06T02:39:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 --2- 172.21.15.82:0/947275817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa410faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 --2- 172.21.15.82:0/947275817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 --2- 172.21.15.82:0/947275817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa41032d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 -- 172.21.15.82:0/947275817 >> 172.21.15.82:0/947275817 conn(0x7fcfa4079cb0 msgr2=0x7fcfa407a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 -- 172.21.15.82:0/947275817 shutdown_connections 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.209+0000 7fcfac800640 1 -- 172.21.15.82:0/947275817 wait complete. 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.210+0000 7fcfac800640 1 Processor -- start 2024-06-06T02:39:14.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.210+0000 7fcfac800640 1 -- start start 2024-06-06T02:39:14.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa4074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa40754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4112ec0 con 0x7fcfa41077f0 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4112d40 con 0x7fcfa4108140 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfac800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa4113040 con 0x7fcfa4102ec0 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa40754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46146/0 (socket says 172.21.15.82:46146) 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfa9400640 1 -- 172.21.15.82:0/2386714268 learned_addr learned my addr 172.21.15.82:0/2386714268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.211+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa4074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 -- 172.21.15.82:0/2386714268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 msgr2=0x7fcfa4074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa4074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 -- 172.21.15.82:0/2386714268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 msgr2=0x7fcfa40754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa40754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 -- 172.21.15.82:0/2386714268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa41a7c30 con 0x7fcfa41077f0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa40754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfa9400640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400e9f0 tx=0x7fcf9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2386714268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400ccc0 con 0x7fcfa41077f0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2386714268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf940108e0 con 0x7fcfa41077f0 2024-06-06T02:39:14.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa41a7f20 con 0x7fcfa41077f0 2024-06-06T02:39:14.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.212+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2386714268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf94018860 con 0x7fcfa41077f0 2024-06-06T02:39:14.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.213+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa41a8380 con 0x7fcfa41077f0 2024-06-06T02:39:14.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:13 smithi082 ceph-mon[31579]: pgmap v489: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:39:14.215 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:13 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:39:14.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.217+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2386714268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fcf94010430 con 0x7fcfa41077f0 2024-06-06T02:39:14.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.217+0000 7fcfb2d74740 1 Processor -- start 2024-06-06T02:39:14.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 -- start start 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca38a490 0x5616ca7593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca392670 0x5616ca759930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616ca6cdc60 con 0x5616ca3b3350 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616ca6bd200 con 0x5616ca392670 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.218+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5616ca6c1240 con 0x5616ca38a490 2024-06-06T02:39:14.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 0x7fcf8c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46148/0 (socket says 172.21.15.82:46148) 2024-06-06T02:39:14.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfaa800640 1 -- 172.21.15.82:0/2903293729 learned_addr learned my addr 172.21.15.82:0/2903293729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca38a490 0x5616ca7593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2386714268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcf940e2670 con 0x7fcfa41077f0 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfa9400640 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca392670 0x5616ca759930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.219+0000 7fcfaa800640 1 -- 172.21.15.82:0/2903293729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca38a490 msgr2=0x5616ca7593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca38a490 0x5616ca7593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 -- 172.21.15.82:0/2903293729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca392670 msgr2=0x5616ca759930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca392670 0x5616ca759930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 -- 172.21.15.82:0/2903293729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616ca41e930 con 0x5616ca3b3350 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 0x7fcf8c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00138d0 tx=0x7fcfa0013d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a141db2751d821 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.220+0000 7fcf93400640 1 -- 172.21.15.82:0/2903293729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0013050 con 0x5616ca3b3350 2024-06-06T02:39:14.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.221+0000 7fcf93400640 1 -- 172.21.15.82:0/2903293729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa00131f0 con 0x5616ca3b3350 2024-06-06T02:39:14.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.221+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 0x7fcf8c0b4d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0023000 tx=0x7fcfa0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.221+0000 7fcf93400640 1 -- 172.21.15.82:0/2903293729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa001b3e0 con 0x5616ca3b3350 2024-06-06T02:39:14.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2903293729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 msgr2=0x5616ca758eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00138d0 tx=0x7fcfa0013d90 comp rx=0 tx=0).stop 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2903293729 shutdown_connections 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca392670 0x5616ca759930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca38a490 0x5616ca7593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2903293729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca3b3350 0x5616ca758eb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2903293729 >> 172.21.15.82:0/2903293729 conn(0x5616ca3a7740 msgr2=0x5616ca755720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.222+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2903293729 shutdown_connections 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.223+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2903293729 wait complete. 2024-06-06T02:39:14.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.223+0000 7fcfb2d74740 1 -- start start 2024-06-06T02:39:14.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 Processor -- start 2024-06-06T02:39:14.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca763600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca763b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616ca521890 con 0x5616ca392670 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5616ca65a2c0 con 0x5616ca38a490 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5616ca766020 con 0x5616ca3b3350 2024-06-06T02:39:14.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.224+0000 7fcfb2d74740 10 client.0 _ll_register_callbacks cb 0x5616ca65f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca763b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfa9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca763600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50546/0 (socket says 172.21.15.82:50546) 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 -- 172.21.15.82:0/2563633018 learned_addr learned my addr 172.21.15.82:0/2563633018 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 -- 172.21.15.82:0/2563633018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 msgr2=0x5616ca763600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca763600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 -- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 msgr2=0x5616ca763b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca763b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.225+0000 7fcfaa800640 1 -- 172.21.15.82:0/2563633018 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ca769950 con 0x5616ca3b3350 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcfaa800640 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000f80 tx=0x7fcfa0011bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe5c7de9db2efab0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcf87e00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00133a0 con 0x5616ca3b3350 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa00131f0 con 0x5616ca3b3350 2024-06-06T02:39:14.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcfa0012450 con 0x5616ca3b3350 2024-06-06T02:39:14.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcfa0012650 con 0x5616ca3b3350 2024-06-06T02:39:14.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcfb2d74740 10 client.25474 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.226+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5616ca7722f0 con 0x5616ca3b3350 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa00131f0 con 0x5616ca3b3350 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcfa0027410 con 0x5616ca3b3350 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 10 client.25474 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 10 client.25474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 20 client.25474 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca371cd0 0x5616ca775670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 4 client.25474 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.227+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616ca6cfbb0 con 0x5616ca371cd0 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.228+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca371cd0 0x5616ca775670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.228+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca371cd0 0x5616ca775670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeba1f0d3fb467c4 server_cookie=711025ebf2147670 in_seq=0 out_seq=0 2024-06-06T02:39:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.228+0000 7fcf87e00640 10 client.25474 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:14.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.229+0000 7fcf87e00640 1 -- 172.21.15.82:0/2563633018 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5616ca6cfbb0 con 0x5616ca371cd0 2024-06-06T02:39:14.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.229+0000 7fcf87e00640 10 client.25474 handle_command_reply: tid=0 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.229+0000 7fcfb2d74740 1 client.25474 shutdown 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 msgr2=0x5616ca769390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000f80 tx=0x7fcfa0011bc0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 shutdown_connections 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca769390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca371cd0 0x5616ca775670 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca763b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/2563633018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca763600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 >> 172.21.15.82:0/2563633018 conn(0x5616ca3a7740 msgr2=0x5616ca75ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcf87e00640 0 client.25474 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 shutdown_connections 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 1 -- 172.21.15.82:0/2563633018 wait complete. 2024-06-06T02:39:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.230+0000 7fcfb2d74740 20 client.25474 trim_cache size 0 max 16384 2024-06-06T02:39:14.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.250+0000 7fcfb2d74740 1 Processor -- start 2024-06-06T02:39:14.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.250+0000 7fcfb2d74740 1 -- start start 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.250+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 0x5616ca769290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 0x5616ca77ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88010d50 con 0x5616ca38a490 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8800e620 con 0x5616ca3b3350 2024-06-06T02:39:14.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8800c450 con 0x5616ca392670 2024-06-06T02:39:14.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfa9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfa9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46170/0 (socket says 172.21.15.82:46170) 2024-06-06T02:39:14.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfa9e00640 1 -- 172.21.15.82:0/620406859 learned_addr learned my addr 172.21.15.82:0/620406859 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:14.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfa9400640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 0x5616ca769290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.251+0000 7fcfaa800640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 0x5616ca77ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 -- 172.21.15.82:0/620406859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 msgr2=0x5616ca77ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 0x5616ca77ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 -- 172.21.15.82:0/620406859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 msgr2=0x5616ca75d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 -- 172.21.15.82:0/620406859 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616ca75a2b0 con 0x5616ca392670 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfaa800640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 0x5616ca77ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcfa9400640 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 0x5616ca769290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf940dffe0 tx=0x7fcf94076520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=694aaddca68fcb7c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcf92a00640 1 -- 172.21.15.82:0/620406859 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940a96b0 con 0x5616ca392670 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcf92a00640 1 -- 172.21.15.82:0/620406859 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf940a9ba0 con 0x5616ca392670 2024-06-06T02:39:14.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.252+0000 7fcf92a00640 1 -- 172.21.15.82:0/620406859 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940a5510 con 0x5616ca392670 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- 172.21.15.82:0/620406859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 msgr2=0x5616ca769290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 0x5616ca769290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf940dffe0 tx=0x7fcf94076520 comp rx=0 tx=0).stop 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- 172.21.15.82:0/620406859 shutdown_connections 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca3b3350 0x5616ca77ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca392670 0x5616ca769290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/620406859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca38a490 0x5616ca75d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- 172.21.15.82:0/620406859 >> 172.21.15.82:0/620406859 conn(0x5616ca3a7740 msgr2=0x5616ca75caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- 172.21.15.82:0/620406859 shutdown_connections 2024-06-06T02:39:14.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- 172.21.15.82:0/620406859 wait complete. 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.254+0000 7fcfb2d74740 1 -- start start 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 Processor -- start 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca76bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8800cae0 con 0x5616ca392670 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8800df50 con 0x5616ca38a490 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8800d1b0 con 0x5616ca3b3350 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.255+0000 7fcfb2d74740 10 client.0 _ll_register_callbacks cb 0x7fcfa00137a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfaa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca76bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57072/0 (socket says 172.21.15.82:57072) 2024-06-06T02:39:14.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9e00640 1 -- 172.21.15.82:0/17671741 learned_addr learned my addr 172.21.15.82:0/17671741 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:14.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46172/0 (socket says 172.21.15.82:46172) 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 -- 172.21.15.82:0/17671741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 msgr2=0x5616ca76bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca76bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 -- 172.21.15.82:0/17671741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 msgr2=0x5616ca76b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9400640 1 -- 172.21.15.82:0/17671741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616ca7dd000 con 0x5616ca392670 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.256+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcf87e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcfa9400640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf940a9850 tx=0x7fcf940a9030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68afb5b5acc81a97 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:14.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf940c9020 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcf94076250 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf940a9ba0 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf94070050 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcfb2d74740 10 client.15306 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.257+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5616ca7de2a0 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf940a9ba0 con 0x5616ca392670 2024-06-06T02:39:14.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcf940cc0b0 con 0x5616ca392670 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 10 client.15306 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 20 client.15306 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca347080 0x5616ca7e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 4 client.15306 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.258+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5616ca6cb650 con 0x5616ca347080 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.259+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca347080 0x5616ca7e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.259+0000 7fcfa9e00640 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca347080 0x5616ca7e0a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e24a1b3b5569d13 server_cookie=13183f60ed714a47 in_seq=0 out_seq=0 2024-06-06T02:39:14.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.259+0000 7fcf87e00640 10 client.15306 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.261+0000 7fcf87e00640 1 -- 172.21.15.82:0/17671741 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5616ca6cb650 con 0x5616ca347080 2024-06-06T02:39:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.261+0000 7fcf87e00640 10 client.15306 handle_command_reply: tid=0 2024-06-06T02:39:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.261+0000 7fcfb2d74740 1 client.15306 shutdown 2024-06-06T02:39:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.261+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 msgr2=0x5616ca76b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.261+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf940a9850 tx=0x7fcf940a9030 comp rx=0 tx=0).stop 2024-06-06T02:39:14.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 shutdown_connections 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5616ca3b3350 0x5616ca76bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5616ca347080 0x5616ca7e0a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616ca392670 0x5616ca76b810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 --2- 172.21.15.82:0/17671741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5616ca38a490 0x5616ca76b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcf87e00640 0 client.15306 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 >> 172.21.15.82:0/17671741 conn(0x5616ca3a7740 msgr2=0x5616ca758e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 shutdown_connections 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 1 -- 172.21.15.82:0/17671741 wait complete. 2024-06-06T02:39:14.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.262+0000 7fcfb2d74740 20 client.15306 trim_cache size 0 max 16384 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "6d321da6-465e-4a8f-8f6f-7dad7c9ea9ec", 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:39:14.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 msgr2=0x7fcf8c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 0x7fcf8c0b4d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0023000 tx=0x7fcfa0020000 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 msgr2=0x7fcfa4074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400e9f0 tx=0x7fcf9400eeb0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 shutdown_connections 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfa4108140 0x7fcfa40754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfa41077f0 0x7fcfa4074fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf8c0b2880 0x7fcf8c0b4d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 --2- 172.21.15.82:0/2386714268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfa4102ec0 0x7fcfa4074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 >> 172.21.15.82:0/2386714268 conn(0x7fcfa4079cb0 msgr2=0x7fcfa4105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:14.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.264+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 shutdown_connections 2024-06-06T02:39:14.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:14.265+0000 7fcfac800640 1 -- 172.21.15.82:0/2386714268 wait complete. 2024-06-06T02:39:14.266 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of executables... 2024-06-06T02:39:14.342 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of object files... o 2024-06-06T02:39:14.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:13 smithi103 ceph-mon[36349]: pgmap v489: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:39:14.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:13 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:39:14.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:13 smithi184 ceph-mon[36922]: pgmap v489: 97 pgs: 97 active+clean; 673 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:39:14.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:13 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:39:14.400 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... yes 2024-06-06T02:39:14.462 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... yes 2024-06-06T02:39:14.598 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-06T02:39:14.822 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... gcc3 2024-06-06T02:39:15.075 INFO:tasks.workunit.client.0.smithi082.stdout:checking how to run the C preprocessor... gcc -E 2024-06-06T02:39:15.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:39:15.183 INFO:tasks.workunit.client.0.smithi082.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-06-06T02:39:15.185 INFO:tasks.workunit.client.0.smithi082.stdout:checking for egrep... /usr/bin/grep -E 2024-06-06T02:39:15.209 INFO:tasks.workunit.client.0.smithi082.stdout:checking for AIX... no 2024-06-06T02:39:15.233 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... (cached) gcc 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub queued for path: / 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.235 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:14 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.254 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-06T02:39:15.255 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-06T02:39:15.256 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-06T02:39:15.256 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... (cached) gcc3 2024-06-06T02:39:15.362 INFO:tasks.workunit.client.0.smithi082.stdout:checking for main in -lm... yes 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub queued for path: / 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:14 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub queued for path: / 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:14 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:15.475 INFO:tasks.workunit.client.0.smithi082.stdout:checking for main in -lpthread... yes 2024-06-06T02:39:15.594 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:15.812 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ANSI C header files... yes 2024-06-06T02:39:15.980 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-06-06T02:39:16.075 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/types.h... yes 2024-06-06T02:39:16.172 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/stat.h... yes 2024-06-06T02:39:16.264 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... yes 2024-06-06T02:39:16.264 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.264 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:16.264 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.264 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:16.265 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.265 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:15 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:39:16.265 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:16 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.265 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:16 smithi082 ceph-mon[31579]: pgmap v490: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-06-06T02:39:16.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:16.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:16.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:39:16.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:16 smithi103 ceph-mon[36349]: pgmap v490: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-06-06T02:39:16.374 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... yes 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:15 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:15 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:15 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:15 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:15 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:16 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:16 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:39:16.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:16 smithi184 ceph-mon[36922]: pgmap v490: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 134 KiB/s wr, 15 op/s 2024-06-06T02:39:16.534 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... yes 2024-06-06T02:39:16.657 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... yes 2024-06-06T02:39:16.757 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inttypes.h... yes 2024-06-06T02:39:16.897 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... yes 2024-06-06T02:39:17.035 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... yes 2024-06-06T02:39:17.185 INFO:tasks.workunit.client.0.smithi082.stdout:checking pthread.h usability... yes 2024-06-06T02:39:17.231 INFO:tasks.workunit.client.0.smithi082.stdout:checking pthread.h presence... yes 2024-06-06T02:39:17.231 INFO:tasks.workunit.client.0.smithi082.stdout:checking for pthread.h... yes 2024-06-06T02:39:17.347 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h usability... yes 2024-06-06T02:39:17.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:17 smithi103 ceph-mon[36349]: mgrmap e20: x(active, since 14m), standbys: z, y 2024-06-06T02:39:17.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:17 smithi082 ceph-mon[31579]: mgrmap e20: x(active, since 14m), standbys: z, y 2024-06-06T02:39:17.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:17 smithi184 ceph-mon[36922]: mgrmap e20: x(active, since 14m), standbys: z, y 2024-06-06T02:39:17.403 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h presence... yes 2024-06-06T02:39:17.405 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fcntl.h... yes 2024-06-06T02:39:17.518 INFO:tasks.workunit.client.0.smithi082.stdout:checking limits.h usability... yes 2024-06-06T02:39:17.560 INFO:tasks.workunit.client.0.smithi082.stdout:checking limits.h presence... yes 2024-06-06T02:39:17.561 INFO:tasks.workunit.client.0.smithi082.stdout:checking for limits.h... yes 2024-06-06T02:39:17.596 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... (cached) yes 2024-06-06T02:39:17.722 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h usability... yes 2024-06-06T02:39:17.775 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h presence... yes 2024-06-06T02:39:17.776 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/time.h... yes 2024-06-06T02:39:17.814 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... (cached) yes 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 -- 172.21.15.82:0/2786825018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c1050e0 msgr2=0x7f316c1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 --2- 172.21.15.82:0/2786825018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c1050e0 0x7f316c1054f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f315c009960 tx=0x7f315c02a460 comp rx=0 tx=0).stop 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 -- 172.21.15.82:0/2786825018 shutdown_connections 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 --2- 172.21.15.82:0/2786825018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 0x7f316c111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 --2- 172.21.15.82:0/2786825018 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c109a10 0x7f316c109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 --2- 172.21.15.82:0/2786825018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c1050e0 0x7f316c1054f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.901+0000 7f3172c00640 1 -- 172.21.15.82:0/2786825018 >> 172.21.15.82:0/2786825018 conn(0x7f316c100b40 msgr2=0x7f316c102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.902+0000 7f3172c00640 1 -- 172.21.15.82:0/2786825018 shutdown_connections 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.902+0000 7f3172c00640 1 -- 172.21.15.82:0/2786825018 wait complete. 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 Processor -- start 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 -- start start 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 0x7f316c1a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 0x7f316c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1150a0 con 0x7f316c109a10 2024-06-06T02:39:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f316c114f20 con 0x7f316c1050e0 2024-06-06T02:39:17.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.903+0000 7f3172c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f316c115220 con 0x7f316c10a360 2024-06-06T02:39:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 0x7f316c1a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f3170c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 0x7f316c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57084/0 (socket says 172.21.15.82:57084) 2024-06-06T02:39:17.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 0x7f316c1a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46182/0 (socket says 172.21.15.82:46182) 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 -- 172.21.15.82:0/3700262818 learned_addr learned my addr 172.21.15.82:0/3700262818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 -- 172.21.15.82:0/3700262818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 msgr2=0x7f316c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 0x7f316c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 -- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 msgr2=0x7f316c1a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 0x7f316c1a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.904+0000 7f316be00640 1 -- 172.21.15.82:0/3700262818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c19c020 con 0x7f316c1050e0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f316be00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f315c009930 tx=0x7f315c004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f3168c00640 1 -- 172.21.15.82:0/3700262818 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c03f030 con 0x7f316c1050e0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c19c2b0 con 0x7f316c1050e0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c19c7e0 con 0x7f316c1050e0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f3168c00640 1 -- 172.21.15.82:0/3700262818 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f315c004550 con 0x7f316c1050e0 2024-06-06T02:39:17.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.905+0000 7f3168c00640 1 -- 172.21.15.82:0/3700262818 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c049060 con 0x7f316c1050e0 2024-06-06T02:39:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.908+0000 7f317914a740 1 Processor -- start 2024-06-06T02:39:17.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 -- start start 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d8c625e20 con 0x556d8c2e21b0 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556d8c6153c0 con 0x556d8c30b070 2024-06-06T02:39:17.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f317914a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556d8c619400 con 0x556d8c2ea390 2024-06-06T02:39:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f3168c00640 1 -- 172.21.15.82:0/3700262818 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f315c003710 con 0x7f316c1050e0 2024-06-06T02:39:17.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f3170c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f316b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f316b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50598/0 (socket says 172.21.15.82:50598) 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f3170c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57092/0 (socket says 172.21.15.82:57092) 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.909+0000 7f316b400640 1 -- 172.21.15.82:0/4043674518 learned_addr learned my addr 172.21.15.82:0/4043674518 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f316be00640 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 -- 172.21.15.82:0/4043674518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 msgr2=0x556d8c6b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 -- 172.21.15.82:0/4043674518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 msgr2=0x556d8c6b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 -- 172.21.15.82:0/4043674518 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8c376650 con 0x556d8c30b070 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f316be00640 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3170c00640 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3164009f00 tx=0x7f3164011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b2ba7c5919618a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.910+0000 7f3161600640 1 -- 172.21.15.82:0/4043674518 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164004d20 con 0x556d8c30b070 2024-06-06T02:39:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f3161600640 1 -- 172.21.15.82:0/4043674518 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3164004050 con 0x556d8c30b070 2024-06-06T02:39:17.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f3161600640 1 -- 172.21.15.82:0/4043674518 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164005280 con 0x556d8c30b070 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f317914a740 1 -- 172.21.15.82:0/4043674518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 msgr2=0x556d8c6b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f317914a740 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3164009f00 tx=0x7f3164011810 comp rx=0 tx=0).stop 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f317914a740 1 -- 172.21.15.82:0/4043674518 shutdown_connections 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f317914a740 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.911+0000 7f317914a740 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f317914a740 1 --2- 172.21.15.82:0/4043674518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6b1380 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f317914a740 1 -- 172.21.15.82:0/4043674518 >> 172.21.15.82:0/4043674518 conn(0x556d8c2ff460 msgr2=0x556d8c6adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f3168c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 0x7f31500b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f3168c00640 1 -- 172.21.15.82:0/3700262818 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f315c1027f0 con 0x7f316c1050e0 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f317914a740 1 -- 172.21.15.82:0/4043674518 shutdown_connections 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f3170c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 0x7f31500b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.912+0000 7f317914a740 1 -- 172.21.15.82:0/4043674518 wait complete. 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.913+0000 7f317914a740 1 -- start start 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.913+0000 7f3170c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 0x7f31500b4d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f316401b040 tx=0x7f3164005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.913+0000 7f317914a740 1 Processor -- start 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.913+0000 7f317914a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 0x556d8c6bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.913+0000 7f317914a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f317914a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c30b070 0x556d8c6c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f317914a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d8c479700 con 0x556d8c30b070 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f317914a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556d8c5b2720 con 0x556d8c2e21b0 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f317914a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556d8c6be4f0 con 0x556d8c2ea390 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f317914a740 10 client.0 _ll_register_callbacks cb 0x556d8c5bede0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f3170c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c30b070 0x556d8c6c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50600/0 (socket says 172.21.15.82:50600) 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 0x556d8c6bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 -- 172.21.15.82:0/1484245905 learned_addr learned my addr 172.21.15.82:0/1484245905 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 -- 172.21.15.82:0/1484245905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 msgr2=0x556d8c6bb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 0x556d8c6bb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 -- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c30b070 msgr2=0x556d8c6c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c30b070 0x556d8c6c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316b400640 1 -- 172.21.15.82:0/1484245905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8c5ddfd0 con 0x556d8c2ea390 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.914+0000 7f316be00640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 0x556d8c6bb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.915+0000 7f316b400640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3158012740 tx=0x7f3158012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b6ea9eeaf1f792 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.915+0000 7f3156000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.915+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315800f920 con 0x556d8c2ea390 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.915+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f315800fac0 con 0x556d8c2ea390 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.915+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3164004050 con 0x556d8c2ea390 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.916+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f315800fcc0 con 0x556d8c2ea390 2024-06-06T02:39:17.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.916+0000 7f317914a740 10 client.25492 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:17.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.916+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d8c6ca570 con 0x556d8c2ea390 2024-06-06T02:39:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.916+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3164004050 con 0x556d8c2ea390 2024-06-06T02:39:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f315801c420 con 0x556d8c2ea390 2024-06-06T02:39:17.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 10 client.25492 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 20 client.25492 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c2c99f0 0x556d8c6cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 4 client.25492 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d8c627d70 con 0x556d8c2c99f0 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.917+0000 7f316be00640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c2c99f0 0x556d8c6cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.918+0000 7f316be00640 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c2c99f0 0x556d8c6cdb00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81948ba7f8696560 server_cookie=8955a52d064a1e6c in_seq=0 out_seq=0 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.918+0000 7f3156000640 10 client.25492 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.918+0000 7f3156000640 1 -- 172.21.15.82:0/1484245905 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556d8c627d70 con 0x556d8c2c99f0 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.918+0000 7f3156000640 10 client.25492 handle_command_reply: tid=0 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.918+0000 7f317914a740 1 client.25492 shutdown 2024-06-06T02:39:17.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 msgr2=0x556d8c6bbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3158012740 tx=0x7f3158012c00 comp rx=0 tx=0).stop 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 shutdown_connections 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c2c99f0 0x556d8c6cdb00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c30b070 0x556d8c6c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2ea390 0x556d8c6bbf20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f3156000640 0 client.25492 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 --2- 172.21.15.82:0/1484245905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2e21b0 0x556d8c6bb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 >> 172.21.15.82:0/1484245905 conn(0x556d8c2ff460 msgr2=0x556d8c6b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 shutdown_connections 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 1 -- 172.21.15.82:0/1484245905 wait complete. 2024-06-06T02:39:17.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.919+0000 7f317914a740 20 client.25492 trim_cache size 0 max 16384 2024-06-06T02:39:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.942+0000 7f317914a740 1 Processor -- start 2024-06-06T02:39:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.942+0000 7f317914a740 1 -- start start 2024-06-06T02:39:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2ea390 0x556d8c6ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1b32f0 con 0x556d8c2ea390 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1b0bc0 con 0x556d8c30b070 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f317914a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1ae9f0 con 0x556d8c2e21b0 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.943+0000 7f316b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2ea390 0x556d8c6ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50616/0 (socket says 172.21.15.82:50616) 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 -- 172.21.15.82:0/4193015805 learned_addr learned my addr 172.21.15.82:0/4193015805 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f3170c00640 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 -- 172.21.15.82:0/4193015805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 msgr2=0x556d8c6c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 -- 172.21.15.82:0/4193015805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2ea390 msgr2=0x556d8c6ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2ea390 0x556d8c6ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 -- 172.21.15.82:0/4193015805 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8c6b9d30 con 0x556d8c2e21b0 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.944+0000 7f316be00640 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f315c005f70 tx=0x7f315c003ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15e2a913503e829 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.945+0000 7f3160c00640 1 -- 172.21.15.82:0/4193015805 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c035040 con 0x556d8c2e21b0 2024-06-06T02:39:17.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.945+0000 7f3160c00640 1 -- 172.21.15.82:0/4193015805 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f315c0ce180 con 0x556d8c2e21b0 2024-06-06T02:39:17.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.945+0000 7f3160c00640 1 -- 172.21.15.82:0/4193015805 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0c62a0 con 0x556d8c2e21b0 2024-06-06T02:39:17.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 -- 172.21.15.82:0/4193015805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 msgr2=0x556d8c6adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f315c005f70 tx=0x7f315c003ab0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 -- 172.21.15.82:0/4193015805 shutdown_connections 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c30b070 0x556d8c6c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2ea390 0x556d8c6ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 --2- 172.21.15.82:0/4193015805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c2e21b0 0x556d8c6adcf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 -- 172.21.15.82:0/4193015805 >> 172.21.15.82:0/4193015805 conn(0x556d8c2ff460 msgr2=0x556d8c6ac230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 -- 172.21.15.82:0/4193015805 shutdown_connections 2024-06-06T02:39:17.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.946+0000 7f317914a740 1 -- 172.21.15.82:0/4193015805 wait complete. 2024-06-06T02:39:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.947+0000 7f317914a740 1 -- start start 2024-06-06T02:39:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.947+0000 7f317914a740 1 Processor -- start 2024-06-06T02:39:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.948+0000 7f317914a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.948+0000 7f317914a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.948+0000 7f317914a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 0x556d8c6c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.949 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/vfs.h usability... yes 2024-06-06T02:39:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.948+0000 7f316b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.948+0000 7f3170c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 0x556d8c6c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f316b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57128/0 (socket says 172.21.15.82:57128) 2024-06-06T02:39:17.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f316b400640 1 -- 172.21.15.82:0/560598542 learned_addr learned my addr 172.21.15.82:0/560598542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f3170c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 0x556d8c6c3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50624/0 (socket says 172.21.15.82:50624) 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f317914a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1af080 con 0x556d8c2e21b0 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1b04f0 con 0x556d8c2ea390 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f316c1af750 con 0x556d8c30b070 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f317914a740 10 client.0 _ll_register_callbacks cb 0x7f3158009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f316b400640 1 -- 172.21.15.82:0/560598542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 msgr2=0x556d8c6c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f316b400640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 0x556d8c6c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.949+0000 7f316b400640 1 -- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 msgr2=0x556d8c6c81d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:39:17.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.950+0000 7f316be00640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.950+0000 7f316b400640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.950+0000 7f316b400640 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d8c6c40c0 con 0x556d8c2ea390 2024-06-06T02:39:17.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.950+0000 7f316be00640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f316b400640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3158012740 tx=0x7f315800fb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dca5e04aa9d2340 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f3156000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315800fe60 con 0x556d8c2ea390 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315c0ce180 con 0x556d8c2ea390 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3158018040 con 0x556d8c2ea390 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f315801ca30 con 0x556d8c2ea390 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f317914a740 10 client.25466 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:17.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.951+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d8c7360f0 con 0x556d8c2ea390 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f315c0ce180 con 0x556d8c2ea390 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3158030030 con 0x556d8c2ea390 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 10 client.25466 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 10 client.25466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 20 client.25466 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c29eda0 0x556d8c7388e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:17.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 4 client.25466 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:39:17.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d8c623810 con 0x556d8c29eda0 2024-06-06T02:39:17.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.952+0000 7f316be00640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c29eda0 0x556d8c7388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:17.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.953+0000 7f316be00640 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c29eda0 0x556d8c7388e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdbf071c39de426 server_cookie=a20669e29e0c365c in_seq=0 out_seq=0 2024-06-06T02:39:17.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.953+0000 7f3156000640 10 client.25466 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.953+0000 7f3156000640 1 -- 172.21.15.82:0/560598542 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556d8c623810 con 0x556d8c29eda0 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.953+0000 7f3156000640 10 client.25466 handle_command_reply: tid=0 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.953+0000 7f317914a740 1 client.25466 shutdown 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 msgr2=0x556d8c6c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3158012740 tx=0x7f315800fb50 comp rx=0 tx=0).stop 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 shutdown_connections 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556d8c30b070 0x556d8c6c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556d8c2ea390 0x556d8c6c34e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556d8c29eda0 0x556d8c7388e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 --2- 172.21.15.82:0/560598542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d8c2e21b0 0x556d8c6c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f3156000640 0 client.25466 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 >> 172.21.15.82:0/560598542 conn(0x556d8c2ff460 msgr2=0x556d8c6b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 shutdown_connections 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 1 -- 172.21.15.82:0/560598542 wait complete. 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.954+0000 7f317914a740 20 client.25466 trim_cache size 0 max 16384 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-06-06T02:39:17.956 INFO:teuthology.orchestra.run.smithi082.stdout: "6d321da6-465e-4a8f-8f6f-7dad7c9ea9ec": { 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "6d321da6-465e-4a8f-8f6f-7dad7c9ea9ec", 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:39:17.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.955+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 msgr2=0x7f31500b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.955+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 0x7f31500b4d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f316401b040 tx=0x7f3164005fd0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.955+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 msgr2=0x7f316c1a1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.955+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f315c009930 tx=0x7f315c004060 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 shutdown_connections 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31500b2870 0x7f31500b4d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f316c10a360 0x7f316c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f316c109a10 0x7f316c1a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 --2- 172.21.15.82:0/3700262818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f316c1050e0 0x7f316c1a1790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 >> 172.21.15.82:0/3700262818 conn(0x7f316c100b40 msgr2=0x7f316c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 shutdown_connections 2024-06-06T02:39:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:17.956+0000 7f3172c00640 1 -- 172.21.15.82:0/3700262818 wait complete. 2024-06-06T02:39:17.992 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/vfs.h presence... yes 2024-06-06T02:39:17.993 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/vfs.h... yes 2024-06-06T02:39:18.085 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/limits.h usability... no 2024-06-06T02:39:18.125 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/limits.h presence... no 2024-06-06T02:39:18.126 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/limits.h... no 2024-06-06T02:39:18.193 INFO:tasks.workunit.client.0.smithi082.stdout:checking for an ANSI C-conforming const... yes 2024-06-06T02:39:18.288 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-06-06T02:39:18.292 INFO:tasks.workunit.client.0.smithi082.stdout:checking for function prototypes... yes 2024-06-06T02:39:18.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:18 smithi103 ceph-mon[36349]: pgmap v491: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 139 KiB/s wr, 16 op/s 2024-06-06T02:39:18.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:18 smithi082 ceph-mon[31579]: pgmap v491: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 139 KiB/s wr, 16 op/s 2024-06-06T02:39:18.386 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether setvbuf arguments are reversed... no 2024-06-06T02:39:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:18 smithi184 ceph-mon[36922]: pgmap v491: 97 pgs: 97 active+clean; 2.2 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 139 KiB/s wr, 16 op/s 2024-06-06T02:39:18.545 INFO:tasks.workunit.client.0.smithi082.stdout:checking for system... yes 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 -- 172.21.15.82:0/3349886263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 msgr2=0x7f3fc8103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 --2- 172.21.15.82:0/3349886263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc8103f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009860 tx=0x7f3fb402a340 comp rx=0 tx=0).stop 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 -- 172.21.15.82:0/3349886263 shutdown_connections 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 --2- 172.21.15.82:0/3349886263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 --2- 172.21.15.82:0/3349886263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc8103f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 --2- 172.21.15.82:0/3349886263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.026+0000 7f3fce000640 1 -- 172.21.15.82:0/3349886263 >> 172.21.15.82:0/3349886263 conn(0x7f3fc80fe1d0 msgr2=0x7f3fc8100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.027+0000 7f3fce000640 1 -- 172.21.15.82:0/3349886263 shutdown_connections 2024-06-06T02:39:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.027+0000 7f3fce000640 1 -- 172.21.15.82:0/3349886263 wait complete. 2024-06-06T02:39:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 Processor -- start 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 -- start start 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc81a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810e4f0 con 0x7f3fc81029d0 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810e370 con 0x7f3fc8103af0 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.028+0000 7f3fce000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810e670 con 0x7f3fc8104440 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46250/0 (socket says 172.21.15.82:46250) 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 -- 172.21.15.82:0/1630310045 learned_addr learned my addr 172.21.15.82:0/1630310045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fcd600640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc81a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 -- 172.21.15.82:0/1630310045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 msgr2=0x7f3fc81a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc81a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 -- 172.21.15.82:0/1630310045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 msgr2=0x7f3fc81996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc81996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fccc00640 1 -- 172.21.15.82:0/1630310045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc81a0ca0 con 0x7f3fc81029d0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.029+0000 7f3fcd600640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc81a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fccc00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9f0 tx=0x7f3fbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fc5600640 1 -- 172.21.15.82:0/1630310045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00ccc0 con 0x7f3fc81029d0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc81a0f90 con 0x7f3fc81029d0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fc5600640 1 -- 172.21.15.82:0/1630310045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fbc0108e0 con 0x7f3fc81029d0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fc5600640 1 -- 172.21.15.82:0/1630310045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc018880 con 0x7f3fc81029d0 2024-06-06T02:39:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.030+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc81a1400 con 0x7f3fc81029d0 2024-06-06T02:39:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.033+0000 7f3fd664f740 1 Processor -- start 2024-06-06T02:39:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 -- start start 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fc5600640 1 -- 172.21.15.82:0/1630310045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3fbc018a20 con 0x7f3fc81029d0 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414a4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 0x55d5414ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d541412480 con 0x55d5410fb1b0 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d541401a20 con 0x55d5410da4d0 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fd664f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d541405a60 con 0x55d5410d22f0 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46264/0 (socket says 172.21.15.82:46264) 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fcd600640 1 -- 172.21.15.82:0/3879734457 learned_addr learned my addr 172.21.15.82:0/3879734457 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fccc00640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.034+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 0x55d5414ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 -- 172.21.15.82:0/3879734457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 msgr2=0x55d5414a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 -- 172.21.15.82:0/3879734457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 msgr2=0x55d5414ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 0x55d5414ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 -- 172.21.15.82:0/3879734457 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5413fe8d0 con 0x55d5410fb1b0 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 0x55d5414ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.035+0000 7f3fcd600640 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009f60 tx=0x7f3fc0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2f085e94e3774a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fb9c00640 1 -- 172.21.15.82:0/3879734457 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0011640 con 0x55d5410fb1b0 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fb9c00640 1 -- 172.21.15.82:0/3879734457 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc0011c90 con 0x55d5410fb1b0 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fb9c00640 1 -- 172.21.15.82:0/3879734457 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0010cd0 con 0x55d5410fb1b0 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fc5600640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 0x7f3fb00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fc5600640 1 -- 172.21.15.82:0/1630310045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fbc0e2660 con 0x7f3fc81029d0 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.036+0000 7f3fccc00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 0x7f3fb00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- 172.21.15.82:0/3879734457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 msgr2=0x55d5414a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009f60 tx=0x7f3fc0009f90 comp rx=0 tx=0).stop 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- 172.21.15.82:0/3879734457 shutdown_connections 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410da4d0 0x55d5414ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 --2- 172.21.15.82:0/3879734457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414a4350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- 172.21.15.82:0/3879734457 >> 172.21.15.82:0/3879734457 conn(0x55d5410ef300 msgr2=0x55d54149fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fccc00640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 0x7f3fb00b4cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0e2900 tx=0x7f3fbc0e8110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- 172.21.15.82:0/3879734457 shutdown_connections 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- 172.21.15.82:0/3879734457 wait complete. 2024-06-06T02:39:19.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.037+0000 7f3fd664f740 1 -- start start 2024-06-06T02:39:19.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 Processor -- start 2024-06-06T02:39:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410d22f0 0x55d5414adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d54133cab0 con 0x55d5410fb1b0 2024-06-06T02:39:19.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d54139f630 con 0x55d5410d22f0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d5414ac120 con 0x55d5410da4d0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.038+0000 7f3fd664f740 10 client.0 _ll_register_callbacks cb 0x55d5413a5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50678/0 (socket says 172.21.15.82:50678) 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 -- 172.21.15.82:0/2412526156 learned_addr learned my addr 172.21.15.82:0/2412526156 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410d22f0 0x55d5414adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 -- 172.21.15.82:0/2412526156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410d22f0 msgr2=0x55d5414adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410d22f0 0x55d5414adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 -- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 msgr2=0x55d5414b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 -- 172.21.15.82:0/2412526156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5413cc170 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402a860 tx=0x7f3fb4030d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24819d9ee15d1ac server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.039+0000 7f3fae000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4037040 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fb4004240 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fc0011c90 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3fb4004440 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fd664f740 10 client.25507 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d541166790 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.040+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc0011c90 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3fb4004a60 con 0x55d5410da4d0 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 10 client.25507 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 10 client.25507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 20 client.25507 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d5410b9d80 0x55d5414bb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 4 client.25507 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5414143d0 con 0x55d5410b9d80 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.041+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d5410b9d80 0x55d5414bb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.042+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d5410b9d80 0x55d5414bb340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847acef6a36a4a30 server_cookie=4c971c67773bd71 in_seq=0 out_seq=0 2024-06-06T02:39:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.042+0000 7f3fae000640 10 client.25507 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fae000640 1 -- 172.21.15.82:0/2412526156 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d5414143d0 con 0x55d5410b9d80 2024-06-06T02:39:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fae000640 10 client.25507 handle_command_reply: tid=0 2024-06-06T02:39:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 client.25507 shutdown 2024-06-06T02:39:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 msgr2=0x55d5414ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3fb402a860 tx=0x7f3fb4030d40 comp rx=0 tx=0).stop 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 shutdown_connections 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d5410b9d80 0x55d5414bb340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410fb1b0 0x55d5414b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410da4d0 0x55d5414ae000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fae000640 0 client.25507 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2412526156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410d22f0 0x55d5414adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 >> 172.21.15.82:0/2412526156 conn(0x55d5410ef300 msgr2=0x55d5414a0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 shutdown_connections 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 1 -- 172.21.15.82:0/2412526156 wait complete. 2024-06-06T02:39:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.043+0000 7f3fd664f740 20 client.25507 trim_cache size 0 max 16384 2024-06-06T02:39:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.066+0000 7f3fd664f740 1 Processor -- start 2024-06-06T02:39:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.066+0000 7f3fd664f740 1 -- start start 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d54149aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d5414b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81aa910 con 0x55d5410da4d0 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81a81e0 con 0x55d5410fb1b0 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fd664f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81a6010 con 0x55d5410d22f0 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d54149aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50682/0 (socket says 172.21.15.82:50682) 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fcd600640 1 -- 172.21.15.82:0/2879906852 learned_addr learned my addr 172.21.15.82:0/2879906852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.067+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d5414b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 -- 172.21.15.82:0/2879906852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 msgr2=0x55d5414b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d5414b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 -- 172.21.15.82:0/2879906852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 msgr2=0x55d54149aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d54149aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 -- 172.21.15.82:0/2879906852 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5411df620 con 0x55d5410d22f0 2024-06-06T02:39:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fcd600640 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009f30 tx=0x7f3fc00092c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a19bab3d5fb8776 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fb9200640 1 -- 172.21.15.82:0/2879906852 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0024040 con 0x55d5410d22f0 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.068+0000 7f3fb9200640 1 -- 172.21.15.82:0/2879906852 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc0010c10 con 0x55d5410d22f0 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.069+0000 7f3fb9200640 1 -- 172.21.15.82:0/2879906852 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00119e0 con 0x55d5410d22f0 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- 172.21.15.82:0/2879906852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 msgr2=0x55d54149a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009f30 tx=0x7f3fc00092c0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- 172.21.15.82:0/2879906852 shutdown_connections 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d5414b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d54149aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 --2- 172.21.15.82:0/2879906852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d54149a5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- 172.21.15.82:0/2879906852 >> 172.21.15.82:0/2879906852 conn(0x55d5410ef300 msgr2=0x55d541499e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- 172.21.15.82:0/2879906852 shutdown_connections 2024-06-06T02:39:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- 172.21.15.82:0/2879906852 wait complete. 2024-06-06T02:39:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.070+0000 7f3fd664f740 1 -- start start 2024-06-06T02:39:19.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 Processor -- start 2024-06-06T02:39:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d541521ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81a66a0 con 0x55d5410da4d0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81a7b10 con 0x55d5410fb1b0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc81a6d70 con 0x55d5410d22f0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fd664f740 10 client.0 _ll_register_callbacks cb 0x7f3fb40096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.071+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fcd600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46306/0 (socket says 172.21.15.82:46306) 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 -- 172.21.15.82:0/1468830024 learned_addr learned my addr 172.21.15.82:0/1468830024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fcd600640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d541521ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 -- 172.21.15.82:0/1468830024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 msgr2=0x55d5414b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 -- 172.21.15.82:0/1468830024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 msgr2=0x55d541521ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d541521ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 -- 172.21.15.82:0/1468830024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5414b5890 con 0x55d5410da4d0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fc7e00640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40304b0 tx=0x7f3fb4030fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5a0db6fb0d4ebe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.072+0000 7f3fae000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4037040 con 0x55d5410da4d0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3fb4004990 con 0x55d5410da4d0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fc0010c10 con 0x55d5410da4d0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3fb4004bb0 con 0x55d5410da4d0 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fd664f740 10 client.15336 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.073+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d541522f70 con 0x55d5410da4d0 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc0010c10 con 0x55d5410da4d0 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3fb4059020 con 0x55d5410da4d0 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 10 client.15336 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 20 client.15336 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d54108f1c0 0x55d5415259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 4 client.15336 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:39:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.074+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d54140fe70 con 0x55d54108f1c0 2024-06-06T02:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.075+0000 7f3fcd600640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d54108f1c0 0x55d5415259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.076+0000 7f3fcd600640 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d54108f1c0 0x55d5415259e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7b5c35a5d9b019 server_cookie=e01219748845b127 in_seq=0 out_seq=0 2024-06-06T02:39:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.076+0000 7f3fae000640 10 client.15336 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:19.080 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gettimeofday... yes 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fae000640 1 -- 172.21.15.82:0/1468830024 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d54140fe70 con 0x55d54108f1c0 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fae000640 10 client.15336 handle_command_reply: tid=0 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 client.15336 shutdown 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 msgr2=0x55d5414b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40304b0 tx=0x7f3fb4030fc0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 shutdown_connections 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d5410fb1b0 0x55d541521ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d54108f1c0 0x55d5415259e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d5410da4d0 0x55d5414b28a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 --2- 172.21.15.82:0/1468830024 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5410d22f0 0x55d5414b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fae000640 0 client.15336 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.192+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 >> 172.21.15.82:0/1468830024 conn(0x55d5410ef300 msgr2=0x55d54149a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 shutdown_connections 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fd664f740 1 -- 172.21.15.82:0/1468830024 wait complete. 2024-06-06T02:39:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fd664f740 20 client.15336 trim_cache size 0 max 16384 2024-06-06T02:39:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:39:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:39:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:39:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 msgr2=0x7f3fb00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 0x7f3fb00b4cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0e2900 tx=0x7f3fbc0e8110 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 msgr2=0x7f3fc8199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.193+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00e9f0 tx=0x7f3fbc00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 shutdown_connections 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f3fb00b27e0 0x7f3fb00b4cf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3fc8104440 0x7f3fc81a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fc8103af0 0x7f3fc81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 --2- 172.21.15.82:0/1630310045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3fc81029d0 0x7f3fc8199160 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 >> 172.21.15.82:0/1630310045 conn(0x7f3fc80fe1d0 msgr2=0x7f3fc8106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 shutdown_connections 2024-06-06T02:39:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:19.194+0000 7f3fce000640 1 -- 172.21.15.82:0/1630310045 wait complete. 2024-06-06T02:39:19.508 INFO:tasks.workunit.client.0.smithi082.stdout:checking for mkdir... yes 2024-06-06T02:39:19.652 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strerror... yes 2024-06-06T02:39:19.808 INFO:tasks.workunit.client.0.smithi082.stdout:checking for open64... yes 2024-06-06T02:39:19.939 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stat64... yes 2024-06-06T02:39:19.979 INFO:tasks.cephfs.filesystem:scrub status for tag:6d321da6-465e-4a8f-8f6f-7dad7c9ea9ec - {'path': '/', 'tag': '6d321da6-465e-4a8f-8f6f-7dad7c9ea9ec', 'options': 'recursive,force'} 2024-06-06T02:39:20.089 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fseeko64... yes 2024-06-06T02:39:20.229 INFO:tasks.workunit.client.0.smithi082.stdout:checking for lrand48_r... yes 2024-06-06T02:39:20.366 INFO:tasks.workunit.client.0.smithi082.stdout:checking for srand48_r... yes 2024-06-06T02:39:20.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:20 smithi103 ceph-mon[36349]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 148 KiB/s wr, 19 op/s 2024-06-06T02:39:20.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:20 smithi082 ceph-mon[31579]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 148 KiB/s wr, 19 op/s 2024-06-06T02:39:20.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:20 smithi184 ceph-mon[36922]: pgmap v492: 97 pgs: 97 active+clean; 2.3 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 148 KiB/s wr, 19 op/s 2024-06-06T02:39:20.420 INFO:tasks.workunit.client.0.smithi082.stdout:configure: creating ./config.status 2024-06-06T02:39:20.713 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating Makefile 2024-06-06T02:39:20.751 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating config.h 2024-06-06T02:39:20.796 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing depfiles commands 2024-06-06T02:39:20.930 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing default commands 2024-06-06T02:39:21.059 INFO:tasks.workunit.client.0.smithi082.stderr:+ make 2024-06-06T02:39:21.075 INFO:tasks.workunit.client.0.smithi082.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-06-06T02:39:21.082 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-06-06T02:39:21.085 INFO:tasks.workunit.client.0.smithi082.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-06-06T02:39:21.085 INFO:tasks.workunit.client.0.smithi082.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-06-06T02:39:21.086 INFO:tasks.workunit.client.0.smithi082.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-06-06T02:39:21.086 INFO:tasks.workunit.client.0.smithi082.stderr: any GNU archive site. 2024-06-06T02:39:21.092 INFO:tasks.workunit.client.0.smithi082.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-06-06T02:39:21.097 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-06-06T02:39:21.099 INFO:tasks.workunit.client.0.smithi082.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-06-06T02:39:21.099 INFO:tasks.workunit.client.0.smithi082.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-06-06T02:39:21.099 INFO:tasks.workunit.client.0.smithi082.stderr: You might want to install the `Automake' and `Perl' packages. 2024-06-06T02:39:21.099 INFO:tasks.workunit.client.0.smithi082.stderr: Grab them from any GNU archive site. 2024-06-06T02:39:21.190 INFO:tasks.workunit.client.0.smithi082.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-06-06T02:39:21.748 INFO:tasks.workunit.client.0.smithi082.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-06-06T02:39:21.748 INFO:tasks.workunit.client.0.smithi082.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-06-06T02:39:21.748 INFO:tasks.workunit.client.0.smithi082.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-06-06T02:39:21.748 INFO:tasks.workunit.client.0.smithi082.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-06-06T02:39:21.986 INFO:tasks.workunit.client.0.smithi082.stdout:/bin/sh ./config.status --recheck 2024-06-06T02:39:22.153 INFO:tasks.workunit.client.0.smithi082.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-06-06T02:39:22.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:22 smithi103 ceph-mon[36349]: pgmap v493: 97 pgs: 97 active+clean; 4.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 345 KiB/s wr, 70 op/s 2024-06-06T02:39:22.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:22 smithi082 ceph-mon[31579]: pgmap v493: 97 pgs: 97 active+clean; 4.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 345 KiB/s wr, 70 op/s 2024-06-06T02:39:22.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:22 smithi184 ceph-mon[36922]: pgmap v493: 97 pgs: 97 active+clean; 4.3 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 345 KiB/s wr, 70 op/s 2024-06-06T02:39:22.468 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-06-06T02:39:23.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:23 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:39:23.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:23 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:39:23.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:23 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:39:23.490 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether build environment is sane... yes 2024-06-06T02:39:23.507 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-06-06T02:39:23.507 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gawk... gawk 2024-06-06T02:39:23.536 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether make sets $(MAKE)... yes 2024-06-06T02:39:23.627 INFO:tasks.workunit.client.0.smithi082.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-06-06T02:39:23.627 INFO:tasks.workunit.client.0.smithi082.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-06-06T02:39:23.648 INFO:tasks.workunit.client.0.smithi082.stdout:checking for style of include used by make... GNU 2024-06-06T02:39:23.655 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... gcc 2024-06-06T02:39:23.849 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether the C compiler works... yes 2024-06-06T02:39:23.849 INFO:tasks.workunit.client.0.smithi082.stdout:checking for C compiler default output file name... a.out 2024-06-06T02:39:23.930 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of executables... 2024-06-06T02:39:24.018 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are cross compiling... no 2024-06-06T02:39:24.110 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of object files... o 2024-06-06T02:39:24.157 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... yes 2024-06-06T02:39:24.209 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... yes 2024-06-06T02:39:24.294 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ISO C89... none needed 2024-06-06T02:39:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:24 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:39:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:24 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:39:24.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:24 smithi103 ceph-mon[36349]: pgmap v494: 97 pgs: 97 active+clean; 4.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 370 KiB/s wr, 99 op/s 2024-06-06T02:39:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:24 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:39:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:24 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:39:24.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:24 smithi082 ceph-mon[31579]: pgmap v494: 97 pgs: 97 active+clean; 4.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 370 KiB/s wr, 99 op/s 2024-06-06T02:39:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:24 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:39:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:24 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:39:24.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:24 smithi184 ceph-mon[36922]: pgmap v494: 97 pgs: 97 active+clean; 4.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 370 KiB/s wr, 99 op/s 2024-06-06T02:39:24.526 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... gcc3 2024-06-06T02:39:24.646 INFO:tasks.workunit.client.0.smithi082.stdout:checking how to run the C preprocessor... gcc -E 2024-06-06T02:39:24.756 INFO:tasks.workunit.client.0.smithi082.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-06-06T02:39:24.759 INFO:tasks.workunit.client.0.smithi082.stdout:checking for egrep... /usr/bin/grep -E 2024-06-06T02:39:25.671 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ANSI C header files... yes 2024-06-06T02:39:25.872 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/types.h... yes 2024-06-06T02:39:25.969 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/stat.h... yes 2024-06-06T02:39:26.056 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... yes 2024-06-06T02:39:26.151 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... yes 2024-06-06T02:39:26.239 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... yes 2024-06-06T02:39:26.323 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... yes 2024-06-06T02:39:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:26 smithi103 ceph-mon[36349]: pgmap v495: 97 pgs: 97 active+clean; 5.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 439 KiB/s wr, 117 op/s 2024-06-06T02:39:26.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:26 smithi082 ceph-mon[31579]: pgmap v495: 97 pgs: 97 active+clean; 5.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 439 KiB/s wr, 117 op/s 2024-06-06T02:39:26.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:26 smithi184 ceph-mon[36922]: pgmap v495: 97 pgs: 97 active+clean; 5.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 439 KiB/s wr, 117 op/s 2024-06-06T02:39:26.410 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inttypes.h... yes 2024-06-06T02:39:26.492 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... yes 2024-06-06T02:39:26.584 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... yes 2024-06-06T02:39:26.702 INFO:tasks.workunit.client.0.smithi082.stdout:checking minix/config.h usability... no 2024-06-06T02:39:26.813 INFO:tasks.workunit.client.0.smithi082.stdout:checking minix/config.h presence... no 2024-06-06T02:39:26.814 INFO:tasks.workunit.client.0.smithi082.stdout:checking for minix/config.h... no 2024-06-06T02:39:26.875 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-06-06T02:39:26.876 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... (cached) gcc 2024-06-06T02:39:26.936 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-06-06T02:39:26.936 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... (cached) yes 2024-06-06T02:39:26.936 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-06-06T02:39:26.936 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... (cached) gcc3 2024-06-06T02:39:27.020 INFO:tasks.workunit.client.0.smithi082.stdout:checking for main in -lm... yes 2024-06-06T02:39:27.118 INFO:tasks.workunit.client.0.smithi082.stdout:checking for main in -lpthread... yes 2024-06-06T02:39:27.120 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ANSI C header files... (cached) yes 2024-06-06T02:39:27.215 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-06-06T02:39:27.325 INFO:tasks.workunit.client.0.smithi082.stdout:checking pthread.h usability... yes 2024-06-06T02:39:27.359 INFO:tasks.workunit.client.0.smithi082.stdout:checking pthread.h presence... yes 2024-06-06T02:39:27.359 INFO:tasks.workunit.client.0.smithi082.stdout:checking for pthread.h... yes 2024-06-06T02:39:27.441 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h usability... yes 2024-06-06T02:39:27.479 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h presence... yes 2024-06-06T02:39:27.480 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fcntl.h... yes 2024-06-06T02:39:27.580 INFO:tasks.workunit.client.0.smithi082.stdout:checking limits.h usability... yes 2024-06-06T02:39:27.621 INFO:tasks.workunit.client.0.smithi082.stdout:checking limits.h presence... yes 2024-06-06T02:39:27.622 INFO:tasks.workunit.client.0.smithi082.stdout:checking for limits.h... yes 2024-06-06T02:39:27.644 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... (cached) yes 2024-06-06T02:39:27.716 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h usability... yes 2024-06-06T02:39:27.744 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h presence... yes 2024-06-06T02:39:27.744 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/time.h... yes 2024-06-06T02:39:27.769 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... (cached) yes 2024-06-06T02:39:27.837 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/vfs.h usability... yes 2024-06-06T02:39:27.866 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/vfs.h presence... yes 2024-06-06T02:39:27.866 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/vfs.h... yes 2024-06-06T02:39:27.970 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/limits.h usability... no 2024-06-06T02:39:28.022 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/limits.h presence... no 2024-06-06T02:39:28.022 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/limits.h... no 2024-06-06T02:39:28.072 INFO:tasks.workunit.client.0.smithi082.stdout:checking for an ANSI C-conforming const... yes 2024-06-06T02:39:28.122 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-06-06T02:39:28.220 INFO:tasks.workunit.client.0.smithi082.stdout:checking for system... yes 2024-06-06T02:39:28.335 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gettimeofday... yes 2024-06-06T02:39:28.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:28 smithi103 ceph-mon[36349]: pgmap v496: 97 pgs: 97 active+clean; 5.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 306 KiB/s wr, 109 op/s 2024-06-06T02:39:28.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:28 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:39:28.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:28 smithi082 ceph-mon[31579]: pgmap v496: 97 pgs: 97 active+clean; 5.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 306 KiB/s wr, 109 op/s 2024-06-06T02:39:28.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:28 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:39:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:28 smithi184 ceph-mon[36922]: pgmap v496: 97 pgs: 97 active+clean; 5.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 306 KiB/s wr, 109 op/s 2024-06-06T02:39:28.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:28 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:39:28.439 INFO:tasks.workunit.client.0.smithi082.stdout:checking for mkdir... yes 2024-06-06T02:39:28.547 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strerror... yes 2024-06-06T02:39:28.650 INFO:tasks.workunit.client.0.smithi082.stdout:checking for open64... yes 2024-06-06T02:39:28.759 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stat64... yes 2024-06-06T02:39:28.875 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fseeko64... yes 2024-06-06T02:39:28.986 INFO:tasks.workunit.client.0.smithi082.stdout:checking for lrand48_r... yes 2024-06-06T02:39:29.099 INFO:tasks.workunit.client.0.smithi082.stdout:checking for srand48_r... yes 2024-06-06T02:39:29.148 INFO:tasks.workunit.client.0.smithi082.stdout:configure: creating ./config.status 2024-06-06T02:39:29.331 INFO:tasks.workunit.client.0.smithi082.stdout: /bin/sh ./config.status 2024-06-06T02:39:29.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:39:29.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:39:29.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:39:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:39:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:39:29.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:39:29.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:39:29.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:39:29.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:39:29.459 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating Makefile 2024-06-06T02:39:29.492 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating config.h 2024-06-06T02:39:29.550 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing depfiles commands 2024-06-06T02:39:29.592 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing default commands 2024-06-06T02:39:29.663 INFO:tasks.workunit.client.0.smithi082.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-06-06T02:39:29.933 INFO:tasks.workunit.client.0.smithi082.stdout:rm -f stamp-h1 2024-06-06T02:39:29.937 INFO:tasks.workunit.client.0.smithi082.stdout:touch config.h.in 2024-06-06T02:39:29.941 INFO:tasks.workunit.client.0.smithi082.stdout:cd . && /bin/sh ./config.status config.h 2024-06-06T02:39:30.069 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating config.h 2024-06-06T02:39:30.133 INFO:tasks.workunit.client.0.smithi082.stdout:make all-am 2024-06-06T02:39:30.144 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-06-06T02:39:30.144 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-06-06T02:39:30.403 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-06-06T02:39:30.413 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-06-06T02:39:30.553 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-06-06T02:39:30.561 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-06-06T02:39:30.693 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-06-06T02:39:30.699 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-06-06T02:39:30.832 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-06-06T02:39:30.840 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-06-06T02:39:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:30 smithi103 ceph-mon[36349]: pgmap v497: 97 pgs: 97 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 346 KiB/s wr, 109 op/s 2024-06-06T02:39:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:30 smithi082 ceph-mon[31579]: pgmap v497: 97 pgs: 97 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 346 KiB/s wr, 109 op/s 2024-06-06T02:39:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:30 smithi184 ceph-mon[36922]: pgmap v497: 97 pgs: 97 active+clean; 5.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 346 KiB/s wr, 109 op/s 2024-06-06T02:39:31.019 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-06-06T02:39:31.025 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-06-06T02:39:31.116 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-06-06T02:39:31.124 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-06-06T02:39:31.202 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-06-06T02:39:31.211 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-06-06T02:39:31.298 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-06-06T02:39:31.306 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-06-06T02:39:31.575 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-06-06T02:39:31.580 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-06-06T02:39:31.768 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-06-06T02:39:31.776 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-06-06T02:39:31.985 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-06-06T02:39:31.991 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-06-06T02:39:32.104 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-06-06T02:39:32.110 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-06-06T02:39:32.226 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-06-06T02:39:32.236 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-06-06T02:39:32.394 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-06-06T02:39:32.401 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 -- 172.21.15.82:0/2344269623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 msgr2=0x7ff4fc074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 --2- 172.21.15.82:0/2344269623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc074b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009c10 tx=0x7ff4ec02a6e0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 -- 172.21.15.82:0/2344269623 shutdown_connections 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 --2- 172.21.15.82:0/2344269623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 --2- 172.21.15.82:0/2344269623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 --2- 172.21.15.82:0/2344269623 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc074b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 -- 172.21.15.82:0/2344269623 >> 172.21.15.82:0/2344269623 conn(0x7ff4fc0fe1d0 msgr2=0x7ff4fc100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 -- 172.21.15.82:0/2344269623 shutdown_connections 2024-06-06T02:39:32.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.408+0000 7ff4fb200640 1 -- 172.21.15.82:0/2344269623 wait complete. 2024-06-06T02:39:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.410+0000 7ff4fb200640 1 Processor -- start 2024-06-06T02:39:32.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.410+0000 7ff4fb200640 1 -- start start 2024-06-06T02:39:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc114b10 con 0x7ff4fc10f010 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc114990 con 0x7ff4fc076690 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fb200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc114c90 con 0x7ff4fc075090 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44086/0 (socket says 172.21.15.82:44086) 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4fa800640 1 -- 172.21.15.82:0/3193921374 learned_addr learned my addr 172.21.15.82:0/3193921374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4f1400640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.411 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.411+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 -- 172.21.15.82:0/3193921374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 msgr2=0x7ff4fc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 -- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 msgr2=0x7ff4fc1a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 -- 172.21.15.82:0/3193921374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc1a72f0 con 0x7ff4fc075090 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4fa800640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f1400640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.412+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc19f7b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec034040 tx=0x7ff4ec030ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.413+0000 7ff4f3400640 1 -- 172.21.15.82:0/3193921374 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec041020 con 0x7ff4fc075090 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.413+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc1a7580 con 0x7ff4fc075090 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.413+0000 7ff4f3400640 1 -- 172.21.15.82:0/3193921374 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ec030e90 con 0x7ff4fc075090 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.413+0000 7ff4f3400640 1 -- 172.21.15.82:0/3193921374 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec036040 con 0x7ff4fc075090 2024-06-06T02:39:32.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.413+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc1a7a90 con 0x7ff4fc075090 2024-06-06T02:39:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.416+0000 7ff50818a740 1 Processor -- start 2024-06-06T02:39:32.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.416+0000 7ff50818a740 1 -- start start 2024-06-06T02:39:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a10373e2f0 0x55a103b0c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b13340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a103a7e480 con 0x55a10373e2f0 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a103a6da20 con 0x55a1037464d0 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff50818a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a103a71a60 con 0x55a1037671b0 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:34288/0 (socket says 172.21.15.82:34288) 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 -- 172.21.15.82:0/1670661240 learned_addr learned my addr 172.21.15.82:0/1670661240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4f1400640 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b13340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 -- 172.21.15.82:0/1670661240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 msgr2=0x55a103b13340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b13340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 -- 172.21.15.82:0/1670661240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a10373e2f0 msgr2=0x55a103b0c480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a10373e2f0 0x55a103b0c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.417 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.417+0000 7ff4fa800640 1 -- 172.21.15.82:0/1670661240 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a103a6a8d0 con 0x55a1037671b0 2024-06-06T02:39:32.418 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.418+0000 7ff4fa800640 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40115d0 tx=0x7ff4f4011a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f8f282d610e005 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.418+0000 7ff4eb400640 1 -- 172.21.15.82:0/1670661240 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f401e070 con 0x55a1037671b0 2024-06-06T02:39:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.418+0000 7ff4eb400640 1 -- 172.21.15.82:0/1670661240 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f400fb70 con 0x55a1037671b0 2024-06-06T02:39:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.418+0000 7ff4eb400640 1 -- 172.21.15.82:0/1670661240 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4019ba0 con 0x55a1037671b0 2024-06-06T02:39:32.419 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 -- 172.21.15.82:0/1670661240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 msgr2=0x55a103b0bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40115d0 tx=0x7ff4f4011a90 comp rx=0 tx=0).stop 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff4f3400640 1 -- 172.21.15.82:0/3193921374 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff4ec044020 con 0x7ff4fc075090 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 -- 172.21.15.82:0/1670661240 shutdown_connections 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b13340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a10373e2f0 0x55a103b0c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 --2- 172.21.15.82:0/1670661240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b0bf40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 -- 172.21.15.82:0/1670661240 >> 172.21.15.82:0/1670661240 conn(0x55a10375b300 msgr2=0x55a103b078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 -- 172.21.15.82:0/1670661240 shutdown_connections 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.419+0000 7ff50818a740 1 -- 172.21.15.82:0/1670661240 wait complete. 2024-06-06T02:39:32.420 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.420+0000 7ff50818a740 1 -- start start 2024-06-06T02:39:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.420+0000 7ff50818a740 1 Processor -- start 2024-06-06T02:39:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b157a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b15ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1039a8ab0 con 0x55a1037671b0 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a103a0b630 con 0x55a103725d80 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a103b13d10 con 0x55a1037464d0 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff50818a740 10 client.0 _ll_register_callbacks cb 0x55a103a11610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f3400640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 0x7ff4e00b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b15ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45538/0 (socket says 172.21.15.82:45538) 2024-06-06T02:39:32.425 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f1400640 1 -- 172.21.15.82:0/466637875 learned_addr learned my addr 172.21.15.82:0/466637875 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4fa800640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b157a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4fa800640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 0x7ff4e00b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.421+0000 7ff4f3400640 1 -- 172.21.15.82:0/3193921374 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff4ec102f20 con 0x7ff4fc075090 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 -- 172.21.15.82:0/466637875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 msgr2=0x55a103b157a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b157a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 -- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 msgr2=0x55a103b15ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b15ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 -- 172.21.15.82:0/466637875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a103a38170 con 0x55a103725d80 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b15ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4f1400640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40129e0 tx=0x7ff4e4012ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600beb7ddcf4f58a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:32.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4fa800640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 0x7ff4e00b4c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a103b14d30 tx=0x7ff4f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.422+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4004050 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f400fb70 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff4e40041f0 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff4e40043f0 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff50818a740 10 client.25496 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a1037d2790 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.423+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f400fb70 con 0x55a103725d80 2024-06-06T02:39:32.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff4e4003bc0 con 0x55a103725d80 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 10 client.25496 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 10 client.25496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 20 client.25496 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1036fb1c0 0x55a103b22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 4 client.25496 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a103a803d0 con 0x55a1036fb1c0 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.424+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1036fb1c0 0x55a103b22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.425+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1036fb1c0 0x55a103b22fa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248c046236b8131d server_cookie=77faabf7f4776100 in_seq=0 out_seq=0 2024-06-06T02:39:32.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.425+0000 7ff4dfe00640 10 client.25496 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff4dfe00640 1 -- 172.21.15.82:0/466637875 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a103a803d0 con 0x55a1036fb1c0 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff4dfe00640 10 client.25496 handle_command_reply: tid=0 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 client.25496 shutdown 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 msgr2=0x55a103b1cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40129e0 tx=0x7ff4e4012ea0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 shutdown_connections 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b1cbd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1036fb1c0 0x55a103b22fa0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b15ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 --2- 172.21.15.82:0/466637875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b157a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff4dfe00640 0 client.25496 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:32.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.426+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 >> 172.21.15.82:0/466637875 conn(0x55a10375b300 msgr2=0x55a103b087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.427+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 shutdown_connections 2024-06-06T02:39:32.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.427+0000 7ff50818a740 1 -- 172.21.15.82:0/466637875 wait complete. 2024-06-06T02:39:32.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.427+0000 7ff50818a740 20 client.25496 trim_cache size 0 max 16384 2024-06-06T02:39:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.444+0000 7ff50818a740 1 Processor -- start 2024-06-06T02:39:32.443 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.444+0000 7ff50818a740 1 -- start start 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.444+0000 7ff50818a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a103725d80 0x55a103b08ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff50818a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b1cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff50818a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff50818a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1b3080 con 0x55a103725d80 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff50818a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1b0950 con 0x55a1037464d0 2024-06-06T02:39:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff50818a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1ae780 con 0x55a1037671b0 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a103725d80 0x55a103b08ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:34304/0 (socket says 172.21.15.82:34304) 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 -- 172.21.15.82:0/712379217 learned_addr learned my addr 172.21.15.82:0/712379217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4f1400640 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b1cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 -- 172.21.15.82:0/712379217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 msgr2=0x55a103b1cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b1cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 -- 172.21.15.82:0/712379217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a103725d80 msgr2=0x55a103b08ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a103725d80 0x55a103b08ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.445+0000 7ff4fa800640 1 -- 172.21.15.82:0/712379217 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a10384b620 con 0x55a1037671b0 2024-06-06T02:39:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.446+0000 7ff4fa800640 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4012fa0 tx=0x7ff4f40056f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7daec36cc2dd7a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.446+0000 7ff4eaa00640 1 -- 172.21.15.82:0/712379217 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f401e040 con 0x55a1037671b0 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.446+0000 7ff4eaa00640 1 -- 172.21.15.82:0/712379217 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f4019cc0 con 0x55a1037671b0 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.446+0000 7ff4eaa00640 1 -- 172.21.15.82:0/712379217 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4003c60 con 0x55a1037671b0 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 -- 172.21.15.82:0/712379217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 msgr2=0x55a103b1d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4012fa0 tx=0x7ff4f40056f0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 -- 172.21.15.82:0/712379217 shutdown_connections 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037671b0 0x55a103b1d0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1037464d0 0x55a103b1cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 --2- 172.21.15.82:0/712379217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a103725d80 0x55a103b08ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.447+0000 7ff50818a740 1 -- 172.21.15.82:0/712379217 >> 172.21.15.82:0/712379217 conn(0x55a10375b300 msgr2=0x55a103b08590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.448+0000 7ff50818a740 1 -- 172.21.15.82:0/712379217 shutdown_connections 2024-06-06T02:39:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.448+0000 7ff50818a740 1 -- 172.21.15.82:0/712379217 wait complete. 2024-06-06T02:39:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.448+0000 7ff50818a740 1 -- start start 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.448+0000 7ff50818a740 1 Processor -- start 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b1a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1aee10 con 0x55a1037671b0 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1b0280 con 0x55a103725d80 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc1af4e0 con 0x55a1037464d0 2024-06-06T02:39:32.451 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff50818a740 10 client.0 _ll_register_callbacks cb 0x7ff4e4012620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45566/0 (socket says 172.21.15.82:45566) 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4f9e00640 1 -- 172.21.15.82:0/494516680 learned_addr learned my addr 172.21.15.82:0/494516680 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4fa800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44104/0 (socket says 172.21.15.82:44104) 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.449+0000 7ff4f1400640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b1a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 -- 172.21.15.82:0/494516680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 msgr2=0x55a103b1a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b1a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 -- 172.21.15.82:0/494516680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 msgr2=0x55a103b19e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 -- 172.21.15.82:0/494516680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a103b1d300 con 0x55a1037671b0 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4fa800640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400a010 tx=0x7ff4f4019bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a715b7a26974fe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4042060 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff4f40039a0 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.450+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4f4019cc0 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff4f401e040 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 10 client.15348 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a103b8ad00 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f4019cc0 con 0x55a1037671b0 2024-06-06T02:39:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff4f40289f0 con 0x55a1037671b0 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 10 client.15348 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 20 client.15348 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a103b8b540 0x55a103b8d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 4 client.15348 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a103a7be70 con 0x55a103b8b540 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.451+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a103b8b540 0x55a103b8d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.452+0000 7ff4f9e00640 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a103b8b540 0x55a103b8d960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7437012fbdae7aa server_cookie=e375ddc4909163c1 in_seq=0 out_seq=0 2024-06-06T02:39:32.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.452+0000 7ff4dfe00640 10 client.15348 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:32.455 INFO:tasks.workunit.client.0.smithi082.stderr:In file included from parser.h:22, 2024-06-06T02:39:32.455 INFO:tasks.workunit.client.0.smithi082.stderr: from parser.c:25: 2024-06-06T02:39:32.455 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c: In function ‘init_filesys’: 2024-06-06T02:39:32.455 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.456 INFO:tasks.workunit.client.0.smithi082.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.457 INFO:tasks.workunit.client.0.smithi082.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.458 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.459 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.460 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-06-06T02:39:32.461 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.462 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c: In function ‘init_tg_stats’: 2024-06-06T02:39:32.462 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.462 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.462 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: 971 | list_for_each_entry(tmp_list, 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.463 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.464 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: 971 | list_for_each_entry(tmp_list, 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.465 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.466 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: 980 | list_for_each_entry(tmp_list, 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: | ^ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: 36 | container_of(ptr, type, member) 2024-06-06T02:39:32.467 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~ 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~ 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr: 980 | list_for_each_entry(tmp_list, 2024-06-06T02:39:32.468 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff4dfe00640 1 -- 172.21.15.82:0/494516680 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a103a7be70 con 0x55a103b8b540 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff4dfe00640 10 client.15348 handle_command_reply: tid=0 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 client.15348 shutdown 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 msgr2=0x55a103b89800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400a010 tx=0x7ff4f4019bd0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 shutdown_connections 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a103b8b540 0x55a103b8d960 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1037671b0 0x55a103b89800 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1037464d0 0x55a103b1a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 --2- 172.21.15.82:0/494516680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a103725d80 0x55a103b19e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 >> 172.21.15.82:0/494516680 conn(0x55a10375b300 msgr2=0x55a103b08d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff4dfe00640 0 client.15348 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.529+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 shutdown_connections 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff50818a740 1 -- 172.21.15.82:0/494516680 wait complete. 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff50818a740 20 client.15348 trim_cache size 0 max 16384 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:39:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 msgr2=0x7ff4e00b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 0x7ff4e00b4c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a103b14d30 tx=0x7ff4f4000bc0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 msgr2=0x7ff4fc19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.530+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc19f7b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec034040 tx=0x7ff4ec030ca0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 shutdown_connections 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4fc10f010 0x7ff4fc1a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4fc076690 0x7ff4fc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff4e00b2770 0x7ff4e00b4c80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 --2- 172.21.15.82:0/3193921374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4fc075090 0x7ff4fc19f7b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 >> 172.21.15.82:0/3193921374 conn(0x7ff4fc0fe1d0 msgr2=0x7ff4fc102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 shutdown_connections 2024-06-06T02:39:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:32.531+0000 7ff4fb200640 1 -- 172.21.15.82:0/3193921374 wait complete. 2024-06-06T02:39:32.551 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c: In function ‘get_optstr’: 2024-06-06T02:39:32.551 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-06-06T02:39:32.551 INFO:tasks.workunit.client.0.smithi082.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-06-06T02:39:32.552 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.552 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:200:14: note: source object declared here 2024-06-06T02:39:32.552 INFO:tasks.workunit.client.0.smithi082.stderr: 200 | char temp[BUFSIZE]; 2024-06-06T02:39:32.552 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~ 2024-06-06T02:39:32.559 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c: In function ‘size64_convert’: 2024-06-06T02:39:32.559 INFO:tasks.workunit.client.0.smithi082.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-06-06T02:39:32.559 INFO:tasks.workunit.client.0.smithi082.stderr: 119 | memcpy(unit, "\0", 3); 2024-06-06T02:39:32.559 INFO:tasks.workunit.client.0.smithi082.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-06-06T02:39:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:32 smithi103 ceph-mon[36349]: pgmap v498: 97 pgs: 97 active+clean; 6.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 431 KiB/s wr, 127 op/s 2024-06-06T02:39:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:32 smithi082 ceph-mon[31579]: pgmap v498: 97 pgs: 97 active+clean; 6.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 431 KiB/s wr, 127 op/s 2024-06-06T02:39:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:32 smithi184 ceph-mon[36922]: pgmap v498: 97 pgs: 97 active+clean; 6.2 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 431 KiB/s wr, 127 op/s 2024-06-06T02:39:32.920 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-06-06T02:39:32.927 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-06-06T02:39:33.021 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-06-06T02:39:33.025 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-06-06T02:39:33.162 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-06-06T02:39:33.170 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-06-06T02:39:33.233 INFO:tasks.workunit.client.0.smithi082.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-06-06T02:39:33.242 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-06-06T02:39:33.311 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-06-06T02:39:33.313 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd .. 2024-06-06T02:39:33.313 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir tmp 2024-06-06T02:39:33.318 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd tmp 2024-06-06T02:39:33.318 INFO:tasks.workunit.client.0.smithi082.stderr:+ for f in $mydir/*.ffsb 2024-06-06T02:39:33.318 INFO:tasks.workunit.client.0.smithi082.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-06-06T02:39:33.320 INFO:tasks.workunit.client.0.smithi082.stdout:FFSB version 6.0-RC2 started 2024-06-06T02:39:33.320 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout:benchmark time = 300 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout:ThreadGroup 0 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout:================ 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout: num_threads = 32 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout: read_random = off 2024-06-06T02:39:33.328 INFO:tasks.workunit.client.0.smithi082.stdout: read_size = 0 (0B) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: read_blocksize = 0 (0B) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: read_skip = off 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: read_skipsize = 0 (0B) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: write_random = on 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: write_size = 5242880 (5MB) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: fsync_file = 0 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: write_blocksize = 4096 (4KB) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: wait time = 0 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: op weights 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: read = 0 (0.00%) 2024-06-06T02:39:33.329 INFO:tasks.workunit.client.0.smithi082.stdout: readall = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: write = 1 (100.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: create = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: append = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: delete = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: metaop = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: createdir = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: stat = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: writeall = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: writeall_fsync = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: open_close = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: write_fsync = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: create_fsync = 0 (0.00%) 2024-06-06T02:39:33.330 INFO:tasks.workunit.client.0.smithi082.stdout: append_fsync = 0 (0.00%) 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout:FileSystem . 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout:========== 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: num_dirs = 0 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: starting files = 128 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: min file size = 104857600 (100MB) 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: max file size = 104857600 (100MB) 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: directio = off 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: alignedio = on 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: bufferedio = off 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.331 INFO:tasks.workunit.client.0.smithi082.stdout: aging is off 2024-06-06T02:39:33.332 INFO:tasks.workunit.client.0.smithi082.stdout: current utilization = 0.00% 2024-06-06T02:39:33.332 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:39:33.332 INFO:tasks.workunit.client.0.smithi082.stdout:checking existing fs: . 2024-06-06T02:39:33.332 INFO:tasks.workunit.client.0.smithi082.stdout:recreating new fileset 2024-06-06T02:39:33.333 INFO:tasks.workunit.client.0.smithi082.stderr:opendir: No such file or directory 2024-06-06T02:39:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:34 smithi103 ceph-mon[36349]: pgmap v499: 97 pgs: 97 active+clean; 6.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 312 KiB/s wr, 89 op/s 2024-06-06T02:39:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:34 smithi082 ceph-mon[31579]: pgmap v499: 97 pgs: 97 active+clean; 6.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 312 KiB/s wr, 89 op/s 2024-06-06T02:39:34.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:34 smithi184 ceph-mon[36922]: pgmap v499: 97 pgs: 97 active+clean; 6.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 312 KiB/s wr, 89 op/s 2024-06-06T02:39:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:36 smithi103 ceph-mon[36349]: pgmap v500: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 296 KiB/s wr, 72 op/s 2024-06-06T02:39:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:36 smithi082 ceph-mon[31579]: pgmap v500: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 296 KiB/s wr, 72 op/s 2024-06-06T02:39:36.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:36 smithi184 ceph-mon[36922]: pgmap v500: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 296 KiB/s wr, 72 op/s 2024-06-06T02:39:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:38 smithi103 ceph-mon[36349]: pgmap v501: 97 pgs: 97 active+clean; 2.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 229 KiB/s wr, 73 op/s 2024-06-06T02:39:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:38 smithi082 ceph-mon[31579]: pgmap v501: 97 pgs: 97 active+clean; 2.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 229 KiB/s wr, 73 op/s 2024-06-06T02:39:38.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:38 smithi184 ceph-mon[36922]: pgmap v501: 97 pgs: 97 active+clean; 2.9 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 229 KiB/s wr, 73 op/s 2024-06-06T02:39:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:40 smithi103 ceph-mon[36349]: pgmap v502: 97 pgs: 97 active+clean; 16 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-06-06T02:39:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:40 smithi082 ceph-mon[31579]: pgmap v502: 97 pgs: 97 active+clean; 16 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-06-06T02:39:40.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:40 smithi184 ceph-mon[36922]: pgmap v502: 97 pgs: 97 active+clean; 16 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.3 MiB/s wr, 88 op/s 2024-06-06T02:39:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:42 smithi103 ceph-mon[36349]: pgmap v503: 97 pgs: 97 active+clean; 80 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.7 MiB/s wr, 98 op/s 2024-06-06T02:39:42.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:42 smithi082 ceph-mon[31579]: pgmap v503: 97 pgs: 97 active+clean; 80 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.7 MiB/s wr, 98 op/s 2024-06-06T02:39:42.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:42 smithi184 ceph-mon[36922]: pgmap v503: 97 pgs: 97 active+clean; 80 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.7 MiB/s wr, 98 op/s 2024-06-06T02:39:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:44 smithi103 ceph-mon[36349]: pgmap v504: 97 pgs: 97 active+clean; 201 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-06-06T02:39:44.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:44 smithi082 ceph-mon[31579]: pgmap v504: 97 pgs: 97 active+clean; 201 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-06-06T02:39:44.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:44 smithi184 ceph-mon[36922]: pgmap v504: 97 pgs: 97 active+clean; 201 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-06-06T02:39:45.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 -- 172.21.15.82:0/391352094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4075090 msgr2=0x7f15d4075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 --2- 172.21.15.82:0/391352094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4075090 0x7f15d4075500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009930 tx=0x7f15c002a420 comp rx=0 tx=0).stop 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 -- 172.21.15.82:0/391352094 shutdown_connections 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 --2- 172.21.15.82:0/391352094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 0x7f15d4111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 --2- 172.21.15.82:0/391352094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4075090 0x7f15d4075500 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 --2- 172.21.15.82:0/391352094 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4076690 0x7f15d4074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 -- 172.21.15.82:0/391352094 >> 172.21.15.82:0/391352094 conn(0x7f15d40fe1d0 msgr2=0x7f15d4100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 -- 172.21.15.82:0/391352094 shutdown_connections 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.740+0000 7f15d8a00640 1 -- 172.21.15.82:0/391352094 wait complete. 2024-06-06T02:39:45.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 Processor -- start 2024-06-06T02:39:45.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 -- start start 2024-06-06T02:39:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 0x7f15d419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 0x7f15d41a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4114b10 con 0x7f15d4076690 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4114990 con 0x7f15d410f010 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.742+0000 7f15d8a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15d4114c90 con 0x7f15d4075090 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33454/0 (socket says 172.21.15.82:33454) 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 -- 172.21.15.82:0/693563367 learned_addr learned my addr 172.21.15.82:0/693563367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d3200640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 0x7f15d41a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d1e00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 0x7f15d419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 -- 172.21.15.82:0/693563367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 msgr2=0x7f15d41a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 0x7f15d41a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 -- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 msgr2=0x7f15d419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 0x7f15d419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 -- 172.21.15.82:0/693563367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d41a7260 con 0x7f15d4075090 2024-06-06T02:39:45.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d1e00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 0x7f15d419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.743+0000 7f15d2800640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e9c0 tx=0x7f15c400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.744+0000 7f15cb400640 1 -- 172.21.15.82:0/693563367 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c400cd80 con 0x7f15d4075090 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.744+0000 7f15cb400640 1 -- 172.21.15.82:0/693563367 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c40035f0 con 0x7f15d4075090 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.744+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d41a7550 con 0x7f15d4075090 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.744+0000 7f15cb400640 1 -- 172.21.15.82:0/693563367 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4010690 con 0x7f15d4075090 2024-06-06T02:39:45.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.744+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d41a7aa0 con 0x7f15d4075090 2024-06-06T02:39:45.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.748+0000 7f15cb400640 1 -- 172.21.15.82:0/693563367 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f15c40037a0 con 0x7f15d4075090 2024-06-06T02:39:45.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.748+0000 7f15e0393740 1 Processor -- start 2024-06-06T02:39:45.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 -- start start 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956156f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x559956157480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x55995615e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599560c9480 con 0x559955d892f0 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5599560b8a20 con 0x559955db21b0 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15e0393740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5599560bca60 con 0x559955d914d0 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15d1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x55995615e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.749+0000 7f15cb400640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 0x7f15b80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x55995615e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33464/0 (socket says 172.21.15.82:33464) 2024-06-06T02:39:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d1e00640 1 -- 172.21.15.82:0/3264010542 learned_addr learned my addr 172.21.15.82:0/3264010542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d3200640 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15cb400640 1 -- 172.21.15.82:0/693563367 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f15c40e26e0 con 0x7f15d4075090 2024-06-06T02:39:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x559956157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d3200640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 0x7f15b80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 -- 172.21.15.82:0/3264010542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 msgr2=0x55995615e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x55995615e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 -- 172.21.15.82:0/3264010542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 msgr2=0x559956156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.750+0000 7f15d2800640 1 -- 172.21.15.82:0/3264010542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599560b58d0 con 0x559955d892f0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.751+0000 7f15d2800640 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x559956157480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15c40e01a0 tx=0x7f15c40a5cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c2381036d76eed server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.751+0000 7f15d3200640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 0x7f15b80b4cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15cc005c40 tx=0x7f15cc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.751+0000 7f15bf400640 1 -- 172.21.15.82:0/3264010542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40aa3c0 con 0x559955d892f0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.751+0000 7f15bf400640 1 -- 172.21.15.82:0/3264010542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c40a9cc0 con 0x559955d892f0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.751+0000 7f15bf400640 1 -- 172.21.15.82:0/3264010542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40de110 con 0x559955d892f0 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 -- 172.21.15.82:0/3264010542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 msgr2=0x559956157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x559956157480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15c40e01a0 tx=0x7f15c40a5cb0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 -- 172.21.15.82:0/3264010542 shutdown_connections 2024-06-06T02:39:45.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x55995615e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x559956157480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 --2- 172.21.15.82:0/3264010542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 -- 172.21.15.82:0/3264010542 >> 172.21.15.82:0/3264010542 conn(0x559955da6300 msgr2=0x5599561528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 -- 172.21.15.82:0/3264010542 shutdown_connections 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.752+0000 7f15e0393740 1 -- 172.21.15.82:0/3264010542 wait complete. 2024-06-06T02:39:45.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 -- start start 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 Processor -- start 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559955ff3ab0 con 0x559955d892f0 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559956056630 con 0x559955db21b0 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55995615ed10 con 0x559955d914d0 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.753+0000 7f15e0393740 10 client.0 _ll_register_callbacks cb 0x55995605c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43170/0 (socket says 172.21.15.82:43170) 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 -- 172.21.15.82:0/3607432822 learned_addr learned my addr 172.21.15.82:0/3607432822 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d1e00640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d3200640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 -- 172.21.15.82:0/3607432822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 msgr2=0x559956160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 -- 172.21.15.82:0/3607432822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 msgr2=0x559956167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 -- 172.21.15.82:0/3607432822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559956083170 con 0x559955d892f0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d3200640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15d2800640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f15c40b2b80 tx=0x7f15c40a54d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32146040e725cc75 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.754+0000 7f15b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4003bc0 con 0x559955d892f0 2024-06-06T02:39:45.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f15c40b28a0 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c40a9cc0 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15c40ae070 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 10 client.15360 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559955e1d790 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c40a9cc0 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f15c40a56a0 con 0x559955d892f0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 10 client.15360 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 20 client.15360 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d70d80 0x55995616d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 4 client.15360 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.755+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599560cb3d0 con 0x559955d70d80 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.756+0000 7f15d1e00640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d70d80 0x55995616d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.760 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.756+0000 7f15d1e00640 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d70d80 0x55995616d9c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c6cb9de5a8af4a0 server_cookie=583efd9dbdfe8aca in_seq=0 out_seq=0 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.756+0000 7f15b3e00640 10 client.15360 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15b3e00640 1 -- 172.21.15.82:0/3607432822 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5599560cb3d0 con 0x559955d70d80 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15b3e00640 10 client.15360 handle_command_reply: tid=0 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 client.15360 shutdown 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 msgr2=0x5599561606b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f15c40b2b80 tx=0x7f15c40a54d0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 shutdown_connections 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d70d80 0x55995616d9c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 --2- 172.21.15.82:0/3607432822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561606b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15b3e00640 0 client.15360 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.757+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 >> 172.21.15.82:0/3607432822 conn(0x559955da6300 msgr2=0x5599561537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.758+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 shutdown_connections 2024-06-06T02:39:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.758+0000 7f15e0393740 1 -- 172.21.15.82:0/3607432822 wait complete. 2024-06-06T02:39:45.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.758+0000 7f15e0393740 20 client.15360 trim_cache size 0 max 16384 2024-06-06T02:39:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 Processor -- start 2024-06-06T02:39:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 -- start start 2024-06-06T02:39:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41b3150 con 0x559955d892f0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41b0a20 con 0x559955db21b0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.775+0000 7f15e0393740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41ae850 con 0x559955d914d0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:33492/0 (socket says 172.21.15.82:33492) 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 -- 172.21.15.82:0/2690877123 learned_addr learned my addr 172.21.15.82:0/2690877123 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d3200640 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 -- 172.21.15.82:0/2690877123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 msgr2=0x559956153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 -- 172.21.15.82:0/2690877123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 msgr2=0x5599561539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 -- 172.21.15.82:0/2690877123 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559955e96620 con 0x559955d914d0 2024-06-06T02:39:45.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d3200640 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:39:45.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.776+0000 7f15d1e00640 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009230 tx=0x7f15c0005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8302bda046098d9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.777+0000 7f15bea00640 1 -- 172.21.15.82:0/2690877123 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c004a070 con 0x559955d914d0 2024-06-06T02:39:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.777+0000 7f15bea00640 1 -- 172.21.15.82:0/2690877123 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c00054f0 con 0x559955d914d0 2024-06-06T02:39:45.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.777+0000 7f15bea00640 1 -- 172.21.15.82:0/2690877123 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0035040 con 0x559955d914d0 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- 172.21.15.82:0/2690877123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 msgr2=0x559956167a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009230 tx=0x7f15c0005a20 comp rx=0 tx=0).stop 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- 172.21.15.82:0/2690877123 shutdown_connections 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955db21b0 0x559956153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956167a00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 --2- 172.21.15.82:0/2690877123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955d892f0 0x5599561539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- 172.21.15.82:0/2690877123 >> 172.21.15.82:0/2690877123 conn(0x559955da6300 msgr2=0x559956153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- 172.21.15.82:0/2690877123 shutdown_connections 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- 172.21.15.82:0/2690877123 wait complete. 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 -- start start 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.778+0000 7f15e0393740 1 Processor -- start 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956164d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955db21b0 0x5599561d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41aeee0 con 0x559955db21b0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41b0350 con 0x559955d892f0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f15d41af5b0 con 0x559955d914d0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15e0393740 10 client.0 _ll_register_callbacks cb 0x7f15c40046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34202/0 (socket says 172.21.15.82:34202) 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955db21b0 0x5599561d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d2800640 1 -- 172.21.15.82:0/962968 learned_addr learned my addr 172.21.15.82:0/962968 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d1e00640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d2800640 1 -- 172.21.15.82:0/962968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 msgr2=0x559956164d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.779+0000 7f15d2800640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956164d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15d2800640 1 -- 172.21.15.82:0/962968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955db21b0 msgr2=0x5599561d40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15d2800640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955db21b0 0x5599561d40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15d2800640 1 -- 172.21.15.82:0/962968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599561652f0 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15d2800640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15c40a99c0 tx=0x7f15c40e2980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45ac251cbac19dcd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c40a5b80 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f15c40a8f20 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c00054f0 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f15c40aa3c0 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15e0393740 10 client.25520 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.780+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599561d5640 con 0x559955d892f0 2024-06-06T02:39:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c00054f0 con 0x559955d892f0 2024-06-06T02:39:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f15c40af200 con 0x559955d892f0 2024-06-06T02:39:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 10 client.25520 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 10 client.25520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 20 client.25520 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d461c0 0x5599561d7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 4 client.25520 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599560c6e70 con 0x559955d461c0 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.781+0000 7f15d1e00640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d461c0 0x5599561d7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.782+0000 7f15b3e00640 10 client.25520 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.782+0000 7f15d1e00640 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d461c0 0x5599561d7ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820d6e39f74b9a10 server_cookie=efda5c0a123b810e in_seq=0 out_seq=0 2024-06-06T02:39:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.806+0000 7f15b3e00640 1 -- 172.21.15.82:0/962968 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599560c6e70 con 0x559955d461c0 2024-06-06T02:39:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.806+0000 7f15b3e00640 10 client.25520 handle_command_reply: tid=0 2024-06-06T02:39:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.806+0000 7f15e0393740 1 client.25520 shutdown 2024-06-06T02:39:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 msgr2=0x5599561647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f15c40a99c0 tx=0x7f15c40e2980 comp rx=0 tx=0).stop 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 shutdown_connections 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559955d461c0 0x5599561d7ec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559955db21b0 0x5599561d40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559955d914d0 0x559956164d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15b3e00640 0 client.25520 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 --2- 172.21.15.82:0/962968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559955d892f0 0x5599561647c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 >> 172.21.15.82:0/962968 conn(0x559955da6300 msgr2=0x55995615a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 shutdown_connections 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 1 -- 172.21.15.82:0/962968 wait complete. 2024-06-06T02:39:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.807+0000 7f15e0393740 20 client.25520 trim_cache size 0 max 16384 2024-06-06T02:39:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:39:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:39:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:39:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:39:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 msgr2=0x7f15b80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 0x7f15b80b4cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15cc005c40 tx=0x7f15cc009500 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 msgr2=0x7f15d419f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15c400e9c0 tx=0x7f15c400ee80 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 shutdown_connections 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15d410f010 0x7f15d41a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15d4076690 0x7f15d419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f15b80b27e0 0x7f15b80b4cf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 --2- 172.21.15.82:0/693563367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15d4075090 0x7f15d419f720 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 >> 172.21.15.82:0/693563367 conn(0x7f15d40fe1d0 msgr2=0x7f15d4102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 shutdown_connections 2024-06-06T02:39:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:45.808+0000 7f15d8a00640 1 -- 172.21.15.82:0/693563367 wait complete. 2024-06-06T02:39:45.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:45 smithi103 ceph-mon[36349]: pgmap v505: 97 pgs: 97 active+clean; 749 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-06-06T02:39:45.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:45 smithi082 ceph-mon[31579]: pgmap v505: 97 pgs: 97 active+clean; 749 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-06-06T02:39:45.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:45 smithi184 ceph-mon[36922]: pgmap v505: 97 pgs: 97 active+clean; 749 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-06-06T02:39:48.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:47 smithi103 ceph-mon[36349]: pgmap v506: 97 pgs: 97 active+clean; 1.3 GiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 112 MiB/s wr, 100 op/s 2024-06-06T02:39:48.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:47 smithi082 ceph-mon[31579]: pgmap v506: 97 pgs: 97 active+clean; 1.3 GiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 112 MiB/s wr, 100 op/s 2024-06-06T02:39:48.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:47 smithi184 ceph-mon[36922]: pgmap v506: 97 pgs: 97 active+clean; 1.3 GiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 112 MiB/s wr, 100 op/s 2024-06-06T02:39:49.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:39:50.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:49 smithi103 ceph-mon[36349]: pgmap v507: 97 pgs: 97 active+clean; 1.4 GiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 120 MiB/s wr, 94 op/s 2024-06-06T02:39:50.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:49 smithi082 ceph-mon[31579]: pgmap v507: 97 pgs: 97 active+clean; 1.4 GiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 120 MiB/s wr, 94 op/s 2024-06-06T02:39:50.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:49 smithi184 ceph-mon[36922]: pgmap v507: 97 pgs: 97 active+clean; 1.4 GiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 120 MiB/s wr, 94 op/s 2024-06-06T02:39:50.539 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:52.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:51 smithi082 ceph-mon[31579]: pgmap v508: 97 pgs: 97 active+clean; 2.1 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 174 MiB/s wr, 98 op/s 2024-06-06T02:39:52.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:51 smithi103 ceph-mon[36349]: pgmap v508: 97 pgs: 97 active+clean; 2.1 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 174 MiB/s wr, 98 op/s 2024-06-06T02:39:52.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:51 smithi184 ceph-mon[36922]: pgmap v508: 97 pgs: 97 active+clean; 2.1 GiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 174 MiB/s wr, 98 op/s 2024-06-06T02:39:53.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.452+0000 7f1c31800640 1 -- 172.21.15.82:0/1050902763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10a0b0 msgr2=0x7f1c2c1162b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.454+0000 7f1c31800640 1 --2- 172.21.15.82:0/1050902763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1162b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009900 tx=0x7f1c2402b720 comp rx=0 tx=0).stop 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.455+0000 7f1c31800640 1 -- 172.21.15.82:0/1050902763 shutdown_connections 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.455+0000 7f1c31800640 1 --2- 172.21.15.82:0/1050902763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1162b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.455+0000 7f1c31800640 1 --2- 172.21.15.82:0/1050902763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c109760 0x7f1c2c109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.455+0000 7f1c31800640 1 --2- 172.21.15.82:0/1050902763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c10f510 0x7f1c2c10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.455+0000 7f1c31800640 1 -- 172.21.15.82:0/1050902763 >> 172.21.15.82:0/1050902763 conn(0x7f1c2c06f1d0 msgr2=0x7f1c2c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.460+0000 7f1c31800640 1 -- 172.21.15.82:0/1050902763 shutdown_connections 2024-06-06T02:39:53.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.461+0000 7f1c31800640 1 -- 172.21.15.82:0/1050902763 wait complete. 2024-06-06T02:39:53.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.463+0000 7f1c31800640 1 Processor -- start 2024-06-06T02:39:53.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.464+0000 7f1c31800640 1 -- start start 2024-06-06T02:39:53.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.465+0000 7f1c31800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c109760 0x7f1c2c1a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.465+0000 7f1c31800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.466+0000 7f1c31800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.467+0000 7f1c31800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1192d0 con 0x7f1c2c109760 2024-06-06T02:39:53.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.467+0000 7f1c30e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.467+0000 7f1c30e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:48950/0 (socket says 172.21.15.82:48950) 2024-06-06T02:39:53.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.467+0000 7f1c30e00640 1 -- 172.21.15.82:0/2740645316 learned_addr learned my addr 172.21.15.82:0/2740645316 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:53.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.468+0000 7f1c2b400640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.469+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c119150 con 0x7f1c2c10a0b0 2024-06-06T02:39:53.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.470+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c119450 con 0x7f1c2c10f510 2024-06-06T02:39:53.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.471+0000 7f1c30e00640 1 -- 172.21.15.82:0/2740645316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c10a0b0 msgr2=0x7f1c2c1a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.471+0000 7f1c30e00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1a8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.471+0000 7f1c30e00640 1 -- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c109760 msgr2=0x7f1c2c1a8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.471+0000 7f1c30e00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c109760 0x7f1c2c1a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.471+0000 7f1c30e00640 1 -- 172.21.15.82:0/2740645316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2c1ad190 con 0x7f1c2c10f510 2024-06-06T02:39:53.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.473+0000 7f1c30e00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c24032640 tx=0x7f1c24032670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.473+0000 7f1c28c00640 1 -- 172.21.15.82:0/2740645316 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24030510 con 0x7f1c2c10f510 2024-06-06T02:39:53.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.474+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2c1ad420 con 0x7f1c2c10f510 2024-06-06T02:39:53.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.474+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2c1ad950 con 0x7f1c2c10f510 2024-06-06T02:39:53.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.476+0000 7f1c28c00640 1 -- 172.21.15.82:0/2740645316 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c24030b60 con 0x7f1c2c10f510 2024-06-06T02:39:53.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.476+0000 7f1c28c00640 1 -- 172.21.15.82:0/2740645316 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24030510 con 0x7f1c2c10f510 2024-06-06T02:39:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.487+0000 7f1c28c00640 1 -- 172.21.15.82:0/2740645316 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1c24044020 con 0x7f1c2c10f510 2024-06-06T02:39:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.490+0000 7f1c28c00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 0x7f1c100b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.490+0000 7f1c28c00640 1 -- 172.21.15.82:0/2740645316 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1c24102a60 con 0x7f1c2c10f510 2024-06-06T02:39:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.492+0000 7f1c394cf740 1 Processor -- start 2024-06-06T02:39:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.493+0000 7f1c394cf740 1 -- start start 2024-06-06T02:39:53.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.495+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a938510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.496+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 0x55ac0a938a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.496+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a938510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.496+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a938510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50354/0 (socket says 172.21.15.82:50354) 2024-06-06T02:39:53.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.497+0000 7f1c2be00640 1 -- 172.21.15.82:0/1012557671 learned_addr learned my addr 172.21.15.82:0/1012557671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:53.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.498+0000 7f1c2b400640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 0x55ac0a938a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.498+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a938f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.499+0000 7f1c30e00640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a938f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.500+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a8ace00 con 0x55ac0a571390 2024-06-06T02:39:53.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.500+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a89c3a0 con 0x55ac0a592070 2024-06-06T02:39:53.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.501+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a8a03e0 con 0x55ac0a5691b0 2024-06-06T02:39:53.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.501+0000 7f1c2be00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 0x7f1c100b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.503+0000 7f1c30e00640 1 -- 172.21.15.82:0/1012557671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 msgr2=0x55ac0a938a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.503+0000 7f1c30e00640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 0x55ac0a938a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.504+0000 7f1c30e00640 1 -- 172.21.15.82:0/1012557671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 msgr2=0x55ac0a938510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.504+0000 7f1c30e00640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a938510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.504+0000 7f1c30e00640 1 -- 172.21.15.82:0/1012557671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac0a5fd650 con 0x55ac0a571390 2024-06-06T02:39:53.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.505+0000 7f1c2b400640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 0x55ac0a938a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:53.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.505+0000 7f1c2be00640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 0x7f1c100b4f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c18013850 tx=0x7f1c18009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.506+0000 7f1c30e00640 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a938f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c24100560 tx=0x7f1c2402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b88f920ed153a9e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.507+0000 7f1c21600640 1 -- 172.21.15.82:0/1012557671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c240e3020 con 0x55ac0a571390 2024-06-06T02:39:53.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.508+0000 7f1c21600640 1 -- 172.21.15.82:0/1012557671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c240ca080 con 0x55ac0a571390 2024-06-06T02:39:53.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.508+0000 7f1c21600640 1 -- 172.21.15.82:0/1012557671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c240ca2e0 con 0x55ac0a571390 2024-06-06T02:39:53.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.509+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 msgr2=0x55ac0a938f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.509+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a938f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c24100560 tx=0x7f1c2402b720 comp rx=0 tx=0).stop 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 shutdown_connections 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a938f90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a5691b0 0x55ac0a938a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1012557671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a938510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 >> 172.21.15.82:0/1012557671 conn(0x55ac0a586460 msgr2=0x55ac0a934d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 shutdown_connections 2024-06-06T02:39:53.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.510+0000 7f1c394cf740 1 -- 172.21.15.82:0/1012557671 wait complete. 2024-06-06T02:39:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.511+0000 7f1c394cf740 1 -- start start 2024-06-06T02:39:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.511+0000 7f1c394cf740 1 Processor -- start 2024-06-06T02:39:53.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.514+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a9430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a9487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c394cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a700700 con 0x55ac0a571390 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c394cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a839700 con 0x55ac0a5691b0 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c394cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac0a945440 con 0x55ac0a592070 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.515+0000 7f1c2b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a9430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.516+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.516+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50362/0 (socket says 172.21.15.82:50362) 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.516+0000 7f1c2be00640 1 -- 172.21.15.82:0/3609821736 learned_addr learned my addr 172.21.15.82:0/3609821736 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.516+0000 7f1c30e00640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a9487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c2be00640 1 -- 172.21.15.82:0/3609821736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 msgr2=0x55ac0a9487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c2be00640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a9487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c2be00640 1 -- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 msgr2=0x55ac0a9430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c2be00640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a9430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c394cf740 10 client.0 _ll_register_callbacks cb 0x55ac0a845dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:53.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c2be00640 1 -- 172.21.15.82:0/3609821736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac0a864fb0 con 0x55ac0a5691b0 2024-06-06T02:39:53.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.517+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c240ca080 con 0x55ac0a5691b0 2024-06-06T02:39:53.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.518+0000 7f1c2be00640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c18010cd0 tx=0x7f1c18009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b4c02aee96dc8e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.518+0000 7f1c16000640 10 client.25532 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:53.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.519+0000 7f1c16000640 1 -- 172.21.15.82:0/3609821736 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1802f050 con 0x55ac0a5691b0 2024-06-06T02:39:53.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.520+0000 7f1c16000640 1 -- 172.21.15.82:0/3609821736 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1c18003b70 con 0x55ac0a5691b0 2024-06-06T02:39:53.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.521+0000 7f1c16000640 1 -- 172.21.15.82:0/3609821736 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c18026070 con 0x55ac0a5691b0 2024-06-06T02:39:53.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.521+0000 7f1c394cf740 10 client.25532 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:53.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.521+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ac0a962440 con 0x55ac0a5691b0 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c16000640 1 -- 172.21.15.82:0/3609821736 <== mon.2 v2:172.21.15.103:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c1801f420 con 0x55ac0a5691b0 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 10 client.25532 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 10 client.25532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 20 client.25532 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a5509f0 0x55ac0a965940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 4 client.25532 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.522+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac0a8aed50 con 0x55ac0a5509f0 2024-06-06T02:39:53.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.526+0000 7f1c2b400640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a5509f0 0x55ac0a965940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.529+0000 7f1c2b400640 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a5509f0 0x55ac0a965940 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77fa2aa7b25a1e9 server_cookie=5a42e641532b769e in_seq=0 out_seq=0 2024-06-06T02:39:53.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.529+0000 7f1c16000640 10 client.25532 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:53.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.531+0000 7f1c16000640 1 -- 172.21.15.82:0/3609821736 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ac0a8aed50 con 0x55ac0a5509f0 2024-06-06T02:39:53.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.531+0000 7f1c16000640 10 client.25532 handle_command_reply: tid=0 2024-06-06T02:39:53.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.531+0000 7f1c394cf740 1 client.25532 shutdown 2024-06-06T02:39:53.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.532+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 msgr2=0x55ac0a942bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.532+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1c18010cd0 tx=0x7f1c18009570 comp rx=0 tx=0).stop 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 shutdown_connections 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a9487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a5509f0 0x55ac0a965940 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a571390 0x55ac0a9430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3609821736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a5691b0 0x55ac0a942bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 >> 172.21.15.82:0/3609821736 conn(0x55ac0a586460 msgr2=0x55ac0a93a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c16000640 0 client.25532 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:53.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 shutdown_connections 2024-06-06T02:39:53.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.533+0000 7f1c394cf740 1 -- 172.21.15.82:0/3609821736 wait complete. 2024-06-06T02:39:53.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.534+0000 7f1c394cf740 20 client.25532 trim_cache size 0 max 16384 2024-06-06T02:39:53.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.572+0000 7f1c394cf740 1 Processor -- start 2024-06-06T02:39:53.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.572+0000 7f1c394cf740 1 -- start start 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a943200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a93c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c010d40 con 0x55ac0a5691b0 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00e610 con 0x55ac0a571390 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c394cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00c440 con 0x55ac0a592070 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c2b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c2be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a943200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c30e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a93c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.573+0000 7f1c2b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50366/0 (socket says 172.21.15.82:50366) 2024-06-06T02:39:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 -- 172.21.15.82:0/3356161204 learned_addr learned my addr 172.21.15.82:0/3356161204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 -- 172.21.15.82:0/3356161204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 msgr2=0x55ac0a93c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a93c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 -- 172.21.15.82:0/3356161204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 msgr2=0x55ac0a943200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a943200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 -- 172.21.15.82:0/3356161204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac0a934530 con 0x55ac0a571390 2024-06-06T02:39:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.574+0000 7f1c2b400640 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06bcb0 tx=0x7f1c1c0039c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4754f844199bdf6c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.575+0000 7f1c20c00640 1 -- 172.21.15.82:0/3356161204 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c022070 con 0x55ac0a571390 2024-06-06T02:39:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.575+0000 7f1c20c00640 1 -- 172.21.15.82:0/3356161204 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c01d860 con 0x55ac0a571390 2024-06-06T02:39:53.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.575+0000 7f1c20c00640 1 -- 172.21.15.82:0/3356161204 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c015070 con 0x55ac0a571390 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 -- 172.21.15.82:0/3356161204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 msgr2=0x55ac0a93a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c06bcb0 tx=0x7f1c1c0039c0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 -- 172.21.15.82:0/3356161204 shutdown_connections 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a592070 0x55ac0a93c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a571390 0x55ac0a93a850 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 --2- 172.21.15.82:0/3356161204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a943200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.576+0000 7f1c394cf740 1 -- 172.21.15.82:0/3356161204 >> 172.21.15.82:0/3356161204 conn(0x55ac0a586460 msgr2=0x55ac0a93a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.577+0000 7f1c394cf740 1 -- 172.21.15.82:0/3356161204 shutdown_connections 2024-06-06T02:39:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.577+0000 7f1c394cf740 1 -- 172.21.15.82:0/3356161204 wait complete. 2024-06-06T02:39:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.577+0000 7f1c394cf740 1 -- start start 2024-06-06T02:39:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.577+0000 7f1c394cf740 1 Processor -- start 2024-06-06T02:39:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a94f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a96b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00cad0 con 0x55ac0a5691b0 2024-06-06T02:39:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00df40 con 0x55ac0a592070 2024-06-06T02:39:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c00d1a0 con 0x55ac0a571390 2024-06-06T02:39:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c394cf740 10 client.0 _ll_register_callbacks cb 0x55ac0a845dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c2b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c2b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49004/0 (socket says 172.21.15.82:49004) 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.578+0000 7f1c2b400640 1 -- 172.21.15.82:0/1760135096 learned_addr learned my addr 172.21.15.82:0/1760135096 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c30e00640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a96b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2be00640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a94f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 -- 172.21.15.82:0/1760135096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 msgr2=0x55ac0a96b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a96b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 -- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 msgr2=0x55ac0a94f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:53.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a94f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 -- 172.21.15.82:0/1760135096 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac0a96b660 con 0x55ac0a571390 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c2b400640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0044a0 tx=0x7f1c1c00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e1385d68f22ca30 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.579+0000 7f1c16000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c02b030 con 0x55ac0a571390 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c1c01d860 con 0x55ac0a571390 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1c1c01dc20 con 0x55ac0a571390 2024-06-06T02:39:53.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c1c037050 con 0x55ac0a571390 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c394cf740 10 client.25567 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac0a94d7c0 con 0x55ac0a571390 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.580+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c01d860 con 0x55ac0a571390 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c1c004990 con 0x55ac0a571390 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 10 client.25567 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 10 client.25567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 20 client.25567 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a525da0 0x55ac0a9d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 4 client.25567 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac0a93e5b0 con 0x55ac0a525da0 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.581+0000 7f1c2be00640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a525da0 0x55ac0a9d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c2be00640 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a525da0 0x55ac0a9d0490 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14926228dac66b2 server_cookie=a3debb6dd84deb6e in_seq=0 out_seq=0 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c16000640 10 client.25567 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c16000640 1 -- 172.21.15.82:0/1760135096 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ac0a93e5b0 con 0x55ac0a525da0 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c16000640 10 client.25567 handle_command_reply: tid=0 2024-06-06T02:39:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c394cf740 1 client.25567 shutdown 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 msgr2=0x55ac0a96abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.582+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0044a0 tx=0x7f1c1c00ded0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 shutdown_connections 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac0a592070 0x55ac0a96b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac0a571390 0x55ac0a96abe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac0a525da0 0x55ac0a9d0490 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 --2- 172.21.15.82:0/1760135096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac0a5691b0 0x55ac0a94f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 >> 172.21.15.82:0/1760135096 conn(0x55ac0a586460 msgr2=0x55ac0a9476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c16000640 0 client.25567 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 shutdown_connections 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 1 -- 172.21.15.82:0/1760135096 wait complete. 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.583+0000 7f1c394cf740 20 client.25567 trim_cache size 0 max 16384 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-06-06T02:39:53.585 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 msgr2=0x7f1c100b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 0x7f1c100b4f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c18013850 tx=0x7f1c18009720 comp rx=0 tx=0).stop 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 msgr2=0x7f1c2c1acb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c24032640 tx=0x7f1c24032670 comp rx=0 tx=0).stop 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 shutdown_connections 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1c100b2a70 0x7f1c100b4f80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c2c10f510 0x7f1c2c1acb50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c2c10a0b0 0x7f1c2c1a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 --2- 172.21.15.82:0/2740645316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c2c109760 0x7f1c2c1a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 >> 172.21.15.82:0/2740645316 conn(0x7f1c2c06f1d0 msgr2=0x7f1c2c072b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 shutdown_connections 2024-06-06T02:39:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:53.584+0000 7f1c31800640 1 -- 172.21.15.82:0/2740645316 wait complete. 2024-06-06T02:39:54.282 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:53 smithi082 ceph-mon[31579]: pgmap v509: 97 pgs: 97 active+clean; 2.5 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 209 MiB/s wr, 104 op/s 2024-06-06T02:39:54.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:53 smithi103 ceph-mon[36349]: pgmap v509: 97 pgs: 97 active+clean; 2.5 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 209 MiB/s wr, 104 op/s 2024-06-06T02:39:54.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:53 smithi184 ceph-mon[36922]: pgmap v509: 97 pgs: 97 active+clean; 2.5 GiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 209 MiB/s wr, 104 op/s 2024-06-06T02:39:54.894 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T02:39:54.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:39:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:39:56.284 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:56 smithi082 ceph-mon[31579]: pgmap v510: 97 pgs: 97 active+clean; 3.2 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 254 MiB/s wr, 99 op/s 2024-06-06T02:39:56.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:56 smithi103 ceph-mon[36349]: pgmap v510: 97 pgs: 97 active+clean; 3.2 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 254 MiB/s wr, 99 op/s 2024-06-06T02:39:56.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:56 smithi184 ceph-mon[36922]: pgmap v510: 97 pgs: 97 active+clean; 3.2 GiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 254 MiB/s wr, 99 op/s 2024-06-06T02:39:58.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:58 smithi082 ceph-mon[31579]: pgmap v511: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 261 MiB/s wr, 99 op/s 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.129+0000 7f4404200640 1 -- 172.21.15.82:0/1805335265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 msgr2=0x7f43fc11e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.129+0000 7f4404200640 1 --2- 172.21.15.82:0/1805335265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc11e8a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009ca0 tx=0x7f43f402a8f0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 -- 172.21.15.82:0/1805335265 shutdown_connections 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 --2- 172.21.15.82:0/1805335265 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc11e8a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 --2- 172.21.15.82:0/1805335265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc11bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 --2- 172.21.15.82:0/1805335265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 0x7f43fc109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 -- 172.21.15.82:0/1805335265 >> 172.21.15.82:0/1805335265 conn(0x7f43fc06df60 msgr2=0x7f43fc06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 -- 172.21.15.82:0/1805335265 shutdown_connections 2024-06-06T02:39:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.130+0000 7f4404200640 1 -- 172.21.15.82:0/1805335265 wait complete. 2024-06-06T02:39:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.132+0000 7f4404200640 1 Processor -- start 2024-06-06T02:39:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.132+0000 7f4404200640 1 -- start start 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 0x7f43fc1a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc1a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc121e20 con 0x7f43fc10a0b0 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc121ca0 con 0x7f43fc109760 2024-06-06T02:39:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.133+0000 7f4404200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc121fa0 con 0x7f43fc11c480 2024-06-06T02:39:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.134+0000 7f4402200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.134+0000 7f4402200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49030/0 (socket says 172.21.15.82:49030) 2024-06-06T02:39:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.134+0000 7f4402200640 1 -- 172.21.15.82:0/2247875850 learned_addr learned my addr 172.21.15.82:0/2247875850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.135+0000 7f4400e00640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc1a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.134+0000 7f4401800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 0x7f43fc1a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4402200640 1 -- 172.21.15.82:0/2247875850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 msgr2=0x7f43fc1a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4402200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 0x7f43fc1a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4402200640 1 -- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 msgr2=0x7f43fc1a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4402200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc1a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4402200640 1 -- 172.21.15.82:0/2247875850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc1ad550 con 0x7f43fc11c480 2024-06-06T02:39:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.136+0000 7f4400e00640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc1a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:58.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.137+0000 7f4402200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f43f4006010 tx=0x7f43f4031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.138+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4003b70 con 0x7f43fc11c480 2024-06-06T02:39:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.138+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43f402d070 con 0x7f43fc11c480 2024-06-06T02:39:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.138+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f402f8a0 con 0x7f43fc11c480 2024-06-06T02:39:58.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.138+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc1ad7e0 con 0x7f43fc11c480 2024-06-06T02:39:58.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.138+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1adcd0 con 0x7f43fc11c480 2024-06-06T02:39:58.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.140+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc109b70 con 0x7f43fc11c480 2024-06-06T02:39:58.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.144+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f43f4004b40 con 0x7f43fc11c480 2024-06-06T02:39:58.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.146+0000 7f43fa000640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 0x7f43e40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:58.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.147+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f43f41037b0 con 0x7f43fc11c480 2024-06-06T02:39:58.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.147+0000 7f4401800640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 0x7f43e40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:58.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.148+0000 7f4401800640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 0x7f43e40b4d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bbe0 tx=0x7f43ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.149+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f43f40cb4d0 con 0x7f43fc11c480 2024-06-06T02:39:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:58 smithi103 ceph-mon[36349]: pgmap v511: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 261 MiB/s wr, 99 op/s 2024-06-06T02:39:58.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:58 smithi184 ceph-mon[36922]: pgmap v511: 97 pgs: 97 active+clean; 3.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 261 MiB/s wr, 99 op/s 2024-06-06T02:39:58.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.674+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43fc1b52e0 con 0x7f43fc11c480 2024-06-06T02:39:58.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.676+0000 7f43fa000640 1 -- 172.21.15.82:0/2247875850 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11872 (secure 0 0 0) 0x7f43f40cadd0 con 0x7f43fc11c480 2024-06-06T02:39:58.677 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:39:58.677 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:39:12.567026+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:39:58.677 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-06-06T02:39:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.682+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 msgr2=0x7f43e40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.682+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 0x7f43e40b4d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bbe0 tx=0x7f43ec00b390 comp rx=0 tx=0).stop 2024-06-06T02:39:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.682+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 msgr2=0x7f43fc1acf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:58.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.682+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f43f4006010 tx=0x7f43f4031a20 comp rx=0 tx=0).stop 2024-06-06T02:39:58.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 shutdown_connections 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f43e40b2870 0x7f43e40b4d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43fc11c480 0x7f43fc1acf10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc10a0b0 0x7f43fc1a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 --2- 172.21.15.82:0/2247875850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43fc109760 0x7f43fc1a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.684+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 >> 172.21.15.82:0/2247875850 conn(0x7f43fc06df60 msgr2=0x7f43fc119f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:58.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.685+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 shutdown_connections 2024-06-06T02:39:58.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:39:58.685+0000 7f4404200640 1 -- 172.21.15.82:0/2247875850 wait complete. 2024-06-06T02:39:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.016+0000 7f37e5c00640 1 -- 172.21.15.82:0/1511457497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e01034d0 msgr2=0x7f37e01058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.016+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1511457497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e01034d0 0x7f37e01058f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009ca0 tx=0x7f37d002a8c0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 -- 172.21.15.82:0/1511457497 shutdown_connections 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1511457497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e010abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1511457497 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e0105e30 0x7f37e0108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1511457497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e01034d0 0x7f37e01058f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 -- 172.21.15.82:0/1511457497 >> 172.21.15.82:0/1511457497 conn(0x7f37e00fd0c0 msgr2=0x7f37e00ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 -- 172.21.15.82:0/1511457497 shutdown_connections 2024-06-06T02:39:59.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.017+0000 7f37e5c00640 1 -- 172.21.15.82:0/1511457497 wait complete. 2024-06-06T02:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 Processor -- start 2024-06-06T02:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 -- start start 2024-06-06T02:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 0x7f37e0102d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 0x7f37e01013e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e0101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37e010e4e0 con 0x7f37e01034d0 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37e010e360 con 0x7f37e0105e30 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.018+0000 7f37e5c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37e010e660 con 0x7f37e0108790 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 0x7f37e0102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37e5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e0101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 0x7f37e01013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37e5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e0101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49044/0 (socket says 172.21.15.82:49044) 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 0x7f37e0102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41072/0 (socket says 172.21.15.82:41072) 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37e5200640 1 -- 172.21.15.82:0/1584773143 learned_addr learned my addr 172.21.15.82:0/1584773143 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 -- 172.21.15.82:0/1584773143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 msgr2=0x7f37e0101920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e0101920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 -- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 msgr2=0x7f37e0102d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 0x7f37e0102d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 -- 172.21.15.82:0/1584773143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e0102050 con 0x7f37e0105e30 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.019+0000 7f37d7400640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 0x7f37e01013e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37c800e9f0 tx=0x7f37c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.020+0000 7f37dd600640 1 -- 172.21.15.82:0/1584773143 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c800ccc0 con 0x7f37e0105e30 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.020+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e01a31b0 con 0x7f37e0105e30 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.020+0000 7f37dd600640 1 -- 172.21.15.82:0/1584773143 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37c80108e0 con 0x7f37e0105e30 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.020+0000 7f37dd600640 1 -- 172.21.15.82:0/1584773143 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8018750 con 0x7f37e0105e30 2024-06-06T02:39:59.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.020+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e01a36a0 con 0x7f37e0105e30 2024-06-06T02:39:59.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.023+0000 7f37ee373740 1 Processor -- start 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.023+0000 7f37dd600640 1 -- 172.21.15.82:0/1584773143 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f37c8010430 con 0x7f37e0105e30 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.023+0000 7f37ee373740 1 -- start start 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f1290f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ec32f0 0x5583f1291480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5583f1203480 con 0x5583f0ec32f0 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583f11f2a20 con 0x5583f0eec1b0 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37ee373740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583f11f6a60 con 0x5583f0ecb4d0 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37d7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37d7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49058/0 (socket says 172.21.15.82:49058) 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37d7400640 1 -- 172.21.15.82:0/482023543 learned_addr learned my addr 172.21.15.82:0/482023543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:59.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.024+0000 7f37e5200640 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f1290f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37dfe00640 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ec32f0 0x5583f1291480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 -- 172.21.15.82:0/482023543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 msgr2=0x5583f1290f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f1290f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 -- 172.21.15.82:0/482023543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ec32f0 msgr2=0x5583f1291480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ec32f0 0x5583f1291480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 -- 172.21.15.82:0/482023543 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f11ef8d0 con 0x5583f0ecb4d0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37d7400640 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37c80e8600 tx=0x7f37c80e8ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe1f2207636d8378 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.025+0000 7f37dd600640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 0x7f37c40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.026+0000 7f37dd600640 1 -- 172.21.15.82:0/1584773143 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f37c80e2520 con 0x7f37e0105e30 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.026+0000 7f37e5200640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 0x7f37c40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.026+0000 7f37d5600640 1 -- 172.21.15.82:0/482023543 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80f5070 con 0x5583f0ecb4d0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.026+0000 7f37d5600640 1 -- 172.21.15.82:0/482023543 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37c80946f0 con 0x5583f0ecb4d0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.026+0000 7f37d5600640 1 -- 172.21.15.82:0/482023543 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c80a9320 con 0x5583f0ecb4d0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 -- 172.21.15.82:0/482023543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 msgr2=0x5583f1298340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37c80e8600 tx=0x7f37c80e8ac0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37e5200640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 0x7f37c40b4d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009640 tx=0x7f37d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 -- 172.21.15.82:0/482023543 shutdown_connections 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f1298340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ec32f0 0x5583f1291480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 --2- 172.21.15.82:0/482023543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f1290f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 -- 172.21.15.82:0/482023543 >> 172.21.15.82:0/482023543 conn(0x5583f0ee0300 msgr2=0x5583f128c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 -- 172.21.15.82:0/482023543 shutdown_connections 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.027+0000 7f37ee373740 1 -- 172.21.15.82:0/482023543 wait complete. 2024-06-06T02:39:59.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.028+0000 7f37ee373740 1 -- start start 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.028+0000 7f37ee373740 1 Processor -- start 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0eec1b0 0x5583f12a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5583f112dab0 con 0x5583f0eec1b0 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5583f1190630 con 0x5583f0ecb4d0 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5583f1298d10 con 0x5583f0ec32f0 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37ee373740 10 client.0 _ll_register_callbacks cb 0x5583f1196610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37e5200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0eec1b0 0x5583f12a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37d7400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50426/0 (socket says 172.21.15.82:50426) 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49070/0 (socket says 172.21.15.82:49070) 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37d7400640 1 -- 172.21.15.82:0/4204887302 learned_addr learned my addr 172.21.15.82:0/4204887302 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 -- 172.21.15.82:0/4204887302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 msgr2=0x5583f129ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 -- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0eec1b0 msgr2=0x5583f12a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0eec1b0 0x5583f12a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37dfe00640 1 -- 172.21.15.82:0/4204887302 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f11bd170 con 0x5583f0ec32f0 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.029+0000 7f37d7400640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.030+0000 7f37dfe00640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37d0006010 tx=0x7f37d0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb2e6b557c5f00e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.030+0000 7f37ce000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:39:59.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.030+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0003d80 con 0x5583f0ec32f0 2024-06-06T02:39:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.030+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f37d0004040 con 0x5583f0ec32f0 2024-06-06T02:39:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.030+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c80946f0 con 0x5583f0ec32f0 2024-06-06T02:39:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.031+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f37d00098c0 con 0x5583f0ec32f0 2024-06-06T02:39:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.031+0000 7f37ee373740 10 client.25585 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:59.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.031+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583f0f57790 con 0x5583f0ec32f0 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.031+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37c80946f0 con 0x5583f0ec32f0 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f37d0004240 con 0x5583f0ec32f0 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 10 client.25585 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 10 client.25585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 20 client.25585 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f0eaad80 0x5583f12a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 4 client.25585 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583f12053d0 con 0x5583f0eaad80 2024-06-06T02:39:59.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.033+0000 7f37d7400640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f0eaad80 0x5583f12a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.034+0000 7f37d7400640 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f0eaad80 0x5583f12a7e70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b44176779aa811a server_cookie=57b1d781dab13221 in_seq=0 out_seq=0 2024-06-06T02:39:59.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.034+0000 7f37ce000640 10 client.25585 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.036+0000 7f37ce000640 1 -- 172.21.15.82:0/4204887302 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5583f12053d0 con 0x5583f0eaad80 2024-06-06T02:39:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.036+0000 7f37ce000640 10 client.25585 handle_command_reply: tid=0 2024-06-06T02:39:59.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.036+0000 7f37ee373740 1 client.25585 shutdown 2024-06-06T02:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 msgr2=0x5583f129a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f37d0006010 tx=0x7f37d0004a40 comp rx=0 tx=0).stop 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 shutdown_connections 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f0eaad80 0x5583f12a7e70 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0eec1b0 0x5583f12a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0ecb4d0 0x5583f129ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 --2- 172.21.15.82:0/4204887302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ec32f0 0x5583f129a6c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ce000640 0 client.25585 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.037+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 >> 172.21.15.82:0/4204887302 conn(0x5583f0ee0300 msgr2=0x5583f128d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.038+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 shutdown_connections 2024-06-06T02:39:59.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.038+0000 7f37ee373740 1 -- 172.21.15.82:0/4204887302 wait complete. 2024-06-06T02:39:59.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.038+0000 7f37ee373740 20 client.25585 trim_cache size 0 max 16384 2024-06-06T02:39:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.132+0000 7f37ee373740 1 Processor -- start 2024-06-06T02:39:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 -- start start 2024-06-06T02:39:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ecb4d0 0x5583f128da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f128dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01aa8b0 con 0x5583f0ecb4d0 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01a8180 con 0x5583f0eec1b0 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.137+0000 7f37ee373740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01a5fb0 con 0x5583f0e801c0 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.138+0000 7f37e5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.138+0000 7f37e5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:49078/0 (socket says 172.21.15.82:49078) 2024-06-06T02:39:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.138+0000 7f37e5200640 1 -- 172.21.15.82:0/2692755080 learned_addr learned my addr 172.21.15.82:0/2692755080 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.139+0000 7f37e5200640 1 -- 172.21.15.82:0/2692755080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 msgr2=0x5583f128dfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:39:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.140+0000 7f37e5200640 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f128dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.143+0000 7f37e5200640 1 -- 172.21.15.82:0/2692755080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ecb4d0 msgr2=0x5583f128da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.143+0000 7f37e5200640 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ecb4d0 0x5583f128da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.143+0000 7f37e5200640 1 -- 172.21.15.82:0/2692755080 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f0fd0620 con 0x5583f0e801c0 2024-06-06T02:39:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.143+0000 7f37e5200640 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37d801d8f0 tx=0x7f37d8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78bab1c76ef23e40 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.144+0000 7f37d4c00640 1 -- 172.21.15.82:0/2692755080 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8029460 con 0x5583f0e801c0 2024-06-06T02:39:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.144+0000 7f37d4c00640 1 -- 172.21.15.82:0/2692755080 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d802e070 con 0x5583f0e801c0 2024-06-06T02:39:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.145+0000 7f37ee373740 1 -- 172.21.15.82:0/2692755080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 msgr2=0x5583f12a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.146+0000 7f37d4c00640 1 -- 172.21.15.82:0/2692755080 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d800fa60 con 0x5583f0e801c0 2024-06-06T02:39:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.146+0000 7f37ee373740 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f37d801d8f0 tx=0x7f37d8017000 comp rx=0 tx=0).stop 2024-06-06T02:39:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.151+0000 7f37ee373740 1 -- 172.21.15.82:0/2692755080 shutdown_connections 2024-06-06T02:39:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0e801c0 0x5583f12a1a80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f128dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 --2- 172.21.15.82:0/2692755080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0ecb4d0 0x5583f128da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 -- 172.21.15.82:0/2692755080 >> 172.21.15.82:0/2692755080 conn(0x5583f0ee0300 msgr2=0x5583f128d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 -- 172.21.15.82:0/2692755080 shutdown_connections 2024-06-06T02:39:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.156+0000 7f37ee373740 1 -- 172.21.15.82:0/2692755080 wait complete. 2024-06-06T02:39:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.157+0000 7f37ee373740 1 -- start start 2024-06-06T02:39:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.157+0000 7f37ee373740 1 Processor -- start 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0e801c0 0x5583f129c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f129ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01a6640 con 0x5583f0e801c0 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01a7ab0 con 0x5583f0eec1b0 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01a6d10 con 0x5583f0ecb4d0 2024-06-06T02:39:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.165+0000 7f37ee373740 10 client.0 _ll_register_callbacks cb 0x7f37d0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.166+0000 7f37e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.166+0000 7f37e5200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50448/0 (socket says 172.21.15.82:50448) 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.166+0000 7f37e5200640 1 -- 172.21.15.82:0/653912709 learned_addr learned my addr 172.21.15.82:0/653912709 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37dfe00640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0e801c0 0x5583f129c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37e5200640 1 -- 172.21.15.82:0/653912709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 msgr2=0x5583f129ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37e5200640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f129ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37e5200640 1 -- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0e801c0 msgr2=0x5583f129c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:39:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37e5200640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0e801c0 0x5583f129c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.167+0000 7f37e5200640 1 -- 172.21.15.82:0/653912709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f12a1e20 con 0x5583f0eec1b0 2024-06-06T02:39:59.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.168+0000 7f37e5200640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37d800f5a0 tx=0x7f37d8005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d123f7485bf2fb79 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:39:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.169+0000 7f37ce000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:39:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.169+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8038070 con 0x5583f0eec1b0 2024-06-06T02:39:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.169+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f37d800fbd0 con 0x5583f0eec1b0 2024-06-06T02:39:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.171+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d802e070 con 0x5583f0eec1b0 2024-06-06T02:39:59.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.171+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f37d8042050 con 0x5583f0eec1b0 2024-06-06T02:39:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.172+0000 7f37ee373740 10 client.25559 fetch_fsmap learned FSMap version 27 2024-06-06T02:39:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.172+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583f1320b10 con 0x5583f0eec1b0 2024-06-06T02:39:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.178+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37d802e070 con 0x5583f0eec1b0 2024-06-06T02:39:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.178+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f37d80294a0 con 0x5583f0eec1b0 2024-06-06T02:39:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 10 client.25559 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 20 client.25559 populate_metadata read hostname 'smithi082' 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f1321500 0x5583f1323920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37dfe00640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f1321500 0x5583f1323920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 4 client.25559 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:39:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.181+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583f1200e70 con 0x5583f1321500 2024-06-06T02:39:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.184+0000 7f37ce000640 10 client.25559 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.188+0000 7f37dfe00640 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f1321500 0x5583f1323920 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87133d4de3f44e2 server_cookie=642b973242f9f972 in_seq=0 out_seq=0 2024-06-06T02:39:59.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.252+0000 7f37ce000640 1 -- 172.21.15.82:0/653912709 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583f1200e70 con 0x5583f1321500 2024-06-06T02:39:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.252+0000 7f37ce000640 10 client.25559 handle_command_reply: tid=0 2024-06-06T02:39:59.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.253+0000 7f37ee373740 1 client.25559 shutdown 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.253+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 msgr2=0x5583f131f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.253+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37d800f5a0 tx=0x7f37d8005680 comp rx=0 tx=0).stop 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 shutdown_connections 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5583f0eec1b0 0x5583f131f600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5583f0ecb4d0 0x5583f129ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5583f1321500 0x5583f1323920 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ce000640 0 client.25559 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 --2- 172.21.15.82:0/653912709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5583f0e801c0 0x5583f129c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.254+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 >> 172.21.15.82:0/653912709 conn(0x5583f0ee0300 msgr2=0x5583f1293e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.255+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 shutdown_connections 2024-06-06T02:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.257+0000 7f37ee373740 1 -- 172.21.15.82:0/653912709 wait complete. 2024-06-06T02:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.258+0000 7f37ee373740 20 client.25559 trim_cache size 0 max 16384 2024-06-06T02:39:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:39:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:39:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:39:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 msgr2=0x7f37c40b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 0x7f37c40b4d70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f37d8009640 tx=0x7f37d8005f90 comp rx=0 tx=0).stop 2024-06-06T02:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 msgr2=0x7f37e01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 0x7f37e01013e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37c800e9f0 tx=0x7f37c800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 shutdown_connections 2024-06-06T02:39:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f37c40b2860 0x7f37c40b4d70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37e0108790 0x7f37e0101920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37e0105e30 0x7f37e01013e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 --2- 172.21.15.82:0/1584773143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37e01034d0 0x7f37e0102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:39:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.263+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 >> 172.21.15.82:0/1584773143 conn(0x7f37e00fd0c0 msgr2=0x7f37e0104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.264+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 shutdown_connections 2024-06-06T02:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:39:59.264+0000 7f37e5c00640 1 -- 172.21.15.82:0/1584773143 wait complete. 2024-06-06T02:39:59.314 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:39:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2247875850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:39:59.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:39:59 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2247875850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:39:59.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:39:59 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2247875850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:39:59.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T02:40:00.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:00 smithi082 ceph-mon[31579]: pgmap v512: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 231 MiB/s wr, 100 op/s 2024-06-06T02:40:00.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:00 smithi082 ceph-mon[31579]: overall HEALTH_OK 2024-06-06T02:40:00.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:00 smithi103 ceph-mon[36349]: pgmap v512: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 231 MiB/s wr, 100 op/s 2024-06-06T02:40:00.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:00 smithi103 ceph-mon[36349]: overall HEALTH_OK 2024-06-06T02:40:00.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:00 smithi184 ceph-mon[36922]: pgmap v512: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 231 MiB/s wr, 100 op/s 2024-06-06T02:40:00.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:00 smithi184 ceph-mon[36922]: overall HEALTH_OK 2024-06-06T02:40:00.498 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:02.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:02 smithi103 ceph-mon[36349]: pgmap v513: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 267 MiB/s wr, 101 op/s 2024-06-06T02:40:02.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:02 smithi082 ceph-mon[31579]: pgmap v513: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 267 MiB/s wr, 101 op/s 2024-06-06T02:40:02.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:02 smithi184 ceph-mon[36922]: pgmap v513: 97 pgs: 97 active+clean; 4.5 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 267 MiB/s wr, 101 op/s 2024-06-06T02:40:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.177+0000 7f6b35600640 1 -- 172.21.15.82:0/1586725929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 msgr2=0x7f6b30115780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.177+0000 7f6b35600640 1 --2- 172.21.15.82:0/1586725929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b30115780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009900 tx=0x7f6b2002a420 comp rx=0 tx=0).stop 2024-06-06T02:40:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 -- 172.21.15.82:0/1586725929 shutdown_connections 2024-06-06T02:40:03.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 --2- 172.21.15.82:0/1586725929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b30115cc0 0x7f6b301180e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 --2- 172.21.15.82:0/1586725929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b30115780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 --2- 172.21.15.82:0/1586725929 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b301099f0 0x7f6b30109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 -- 172.21.15.82:0/1586725929 >> 172.21.15.82:0/1586725929 conn(0x7f6b3006df60 msgr2=0x7f6b3006e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.183+0000 7f6b35600640 1 -- 172.21.15.82:0/1586725929 shutdown_connections 2024-06-06T02:40:03.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.184+0000 7f6b35600640 1 -- 172.21.15.82:0/1586725929 wait complete. 2024-06-06T02:40:03.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.186+0000 7f6b35600640 1 Processor -- start 2024-06-06T02:40:03.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.186+0000 7f6b35600640 1 -- start start 2024-06-06T02:40:03.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b301099f0 0x7f6b301a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b301a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 0x7f6b301a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3011b6e0 con 0x7f6b301099f0 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3011b560 con 0x7f6b30115cc0 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.187+0000 7f6b35600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3011b860 con 0x7f6b30113360 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.189+0000 7f6b2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 0x7f6b301a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.189+0000 7f6b2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 0x7f6b301a8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58112/0 (socket says 172.21.15.82:58112) 2024-06-06T02:40:03.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.189+0000 7f6b2f400640 1 -- 172.21.15.82:0/568753405 learned_addr learned my addr 172.21.15.82:0/568753405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:03.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.189+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b301099f0 0x7f6b301a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.189+0000 7f6b2e000640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b301a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.191+0000 7f6b2e000640 1 -- 172.21.15.82:0/568753405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 msgr2=0x7f6b301a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.191+0000 7f6b2e000640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 0x7f6b301a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.191+0000 7f6b2e000640 1 -- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b301099f0 msgr2=0x7f6b301a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.191+0000 7f6b2e000640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b301099f0 0x7f6b301a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.191+0000 7f6b2e000640 1 -- 172.21.15.82:0/568753405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b301a91f0 con 0x7f6b30113360 2024-06-06T02:40:03.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.193+0000 7f6b2e000640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b301a48e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009230 tx=0x7f6b20003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.193+0000 7f6b27400640 1 -- 172.21.15.82:0/568753405 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2003f070 con 0x7f6b30113360 2024-06-06T02:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.194+0000 7f6b27400640 1 -- 172.21.15.82:0/568753405 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2003bb10 con 0x7f6b30113360 2024-06-06T02:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.194+0000 7f6b27400640 1 -- 172.21.15.82:0/568753405 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2003f070 con 0x7f6b30113360 2024-06-06T02:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.196+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b301a9480 con 0x7f6b30113360 2024-06-06T02:40:03.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.196+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b301a98e0 con 0x7f6b30113360 2024-06-06T02:40:03.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.209+0000 7f6b27400640 1 -- 172.21.15.82:0/568753405 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f6b20042070 con 0x7f6b30113360 2024-06-06T02:40:03.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.212+0000 7f6b27400640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 0x7f6b140b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.212+0000 7f6b27400640 1 -- 172.21.15.82:0/568753405 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b20102320 con 0x7f6b30113360 2024-06-06T02:40:03.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.213+0000 7f6b3bc2e740 1 Processor -- start 2024-06-06T02:40:03.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.214+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 0x7f6b140b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.215+0000 7f6b3bc2e740 1 -- start start 2024-06-06T02:40:03.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.216+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 0x55cbd3dcdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.216+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 0x55cbd3dce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.217+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 0x55cbd3dce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.217+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 0x7f6b140b5000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6b30074590 tx=0x7f6b28009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.218+0000 7f6b2ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 0x55cbd3dcdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.218+0000 7f6b2ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 0x55cbd3dcdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47944/0 (socket says 172.21.15.82:47944) 2024-06-06T02:40:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.219+0000 7f6b2ea00640 1 -- 172.21.15.82:0/2077710987 learned_addr learned my addr 172.21.15.82:0/2077710987 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.219+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3d39de0 con 0x55cbd39fe390 2024-06-06T02:40:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.219+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3d29380 con 0x55cbd39f61b0 2024-06-06T02:40:03.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.219+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3d2d3c0 con 0x55cbd3a1f070 2024-06-06T02:40:03.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.219+0000 7f6b2e000640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 0x55cbd3dce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.221+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 0x55cbd3dce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2e000640 1 -- 172.21.15.82:0/2077710987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 msgr2=0x55cbd3dcdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2e000640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 0x55cbd3dcdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2e000640 1 -- 172.21.15.82:0/2077710987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 msgr2=0x55cbd3dce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2e000640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 0x55cbd3dce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2e000640 1 -- 172.21.15.82:0/2077710987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd3a8a650 con 0x55cbd39f61b0 2024-06-06T02:40:03.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.222+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 0x55cbd3dce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:03.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.223+0000 7f6b2e000640 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 0x55cbd3dce090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6b200c5980 tx=0x7f6b2002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aff9132c52d2120f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.224+0000 7f6b1be00640 1 -- 172.21.15.82:0/2077710987 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20031430 con 0x55cbd39f61b0 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.224+0000 7f6b1be00640 1 -- 172.21.15.82:0/2077710987 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b200c9410 con 0x55cbd39f61b0 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.224+0000 7f6b1be00640 1 -- 172.21.15.82:0/2077710987 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200c5b90 con 0x55cbd39f61b0 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 msgr2=0x55cbd3dce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 0x55cbd3dce090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6b200c5980 tx=0x7f6b2002a420 comp rx=0 tx=0).stop 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 shutdown_connections 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39fe390 0x55cbd3dce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39f61b0 0x55cbd3dce090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2077710987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd3a1f070 0x55cbd3dcdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 >> 172.21.15.82:0/2077710987 conn(0x55cbd3a13460 msgr2=0x55cbd3dca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.225+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 shutdown_connections 2024-06-06T02:40:03.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.226+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2077710987 wait complete. 2024-06-06T02:40:03.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.226+0000 7f6b3bc2e740 1 -- start start 2024-06-06T02:40:03.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.227+0000 7f6b3bc2e740 1 Processor -- start 2024-06-06T02:40:03.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.227+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.227+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.228+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.228+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58130/0 (socket says 172.21.15.82:58130) 2024-06-06T02:40:03.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.228+0000 7f6b2e000640 1 -- 172.21.15.82:0/767143584 learned_addr learned my addr 172.21.15.82:0/767143584 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:03.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.228+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dd99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.229+0000 7f6b2f400640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dd99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.229+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.229+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3b8d700 con 0x55cbd39dd9f0 2024-06-06T02:40:03.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.229+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3cc66e0 con 0x55cbd3a1f070 2024-06-06T02:40:03.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.229+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55cbd3ddaa80 con 0x55cbd39fe390 2024-06-06T02:40:03.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 -- 172.21.15.82:0/767143584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 msgr2=0x55cbd3dd8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 -- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 msgr2=0x55cbd3dd89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd3cf1f90 con 0x55cbd39dd9f0 2024-06-06T02:40:03.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b18c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:40:03.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.230+0000 7f6b2f400640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dd99c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c012700 tx=0x7f6b1c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed88c95fa8c364f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.231+0000 7f6b18c00640 1 -- 172.21.15.82:0/767143584 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00f8c0 con 0x55cbd39dd9f0 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.231+0000 7f6b18c00640 1 -- 172.21.15.82:0/767143584 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b1c018070 con 0x55cbd39dd9f0 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.231+0000 7f6b18c00640 10 client.0 inactive, discarding osd_map(80..80 src has 1..80) 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.231+0000 7f6b3bc2e740 10 client.0 _ll_register_callbacks cb 0x55cbd3cd2da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.232+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b200c9410 con 0x55cbd39dd9f0 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.232+0000 7f6b18c00640 1 -- 172.21.15.82:0/767143584 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b1c00f8c0 con 0x55cbd39dd9f0 2024-06-06T02:40:03.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.232+0000 7f6b3bc2e740 10 client.15408 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:03.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.232+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55cbd3de6a30 con 0x55cbd39dd9f0 2024-06-06T02:40:03.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.233+0000 7f6b18c00640 1 -- 172.21.15.82:0/767143584 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b1c00fa60 con 0x55cbd39dd9f0 2024-06-06T02:40:03.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.233+0000 7f6b3bc2e740 10 client.15408 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:03.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b3bc2e740 10 client.15408 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:40:03.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b3bc2e740 20 client.15408 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:03.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd39b2da0 0x55cbd3de9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b3bc2e740 4 client.15408 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:03.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd39b2da0 0x55cbd3de9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.234+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6b200c9410 con 0x55cbd39b2da0 2024-06-06T02:40:03.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.235+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd39b2da0 0x55cbd3de9eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=462568b96b6acf9 server_cookie=c8368ba5c93d6c32 in_seq=0 out_seq=0 2024-06-06T02:40:03.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.235+0000 7f6b18c00640 10 client.15408 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:40:03.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.236+0000 7f6b18c00640 1 -- 172.21.15.82:0/767143584 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f6b200c9410 con 0x55cbd39b2da0 2024-06-06T02:40:03.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.236+0000 7f6b18c00640 10 client.15408 handle_command_reply: tid=0 2024-06-06T02:40:03.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.237+0000 7f6b3bc2e740 1 client.15408 shutdown 2024-06-06T02:40:03.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.237+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 msgr2=0x55cbd3dd99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.237+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dd99c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c012700 tx=0x7f6b1c012bc0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 shutdown_connections 2024-06-06T02:40:03.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd39b2da0 0x55cbd3de9eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dd99c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/767143584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.238+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 >> 172.21.15.82:0/767143584 conn(0x55cbd3a13460 msgr2=0x55cbd3dcd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.239+0000 7f6b18c00640 0 client.15408 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:40:03.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.240+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 shutdown_connections 2024-06-06T02:40:03.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.244+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/767143584 wait complete. 2024-06-06T02:40:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.248+0000 7f6b3bc2e740 20 client.15408 trim_cache size 0 max 16384 2024-06-06T02:40:03.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.307+0000 7f6b3bc2e740 1 Processor -- start 2024-06-06T02:40:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 -- start start 2024-06-06T02:40:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b7720 con 0x55cbd3a1f070 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b4ff0 con 0x55cbd39dd9f0 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.308+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b2e20 con 0x55cbd39fe390 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.312+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.315+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47974/0 (socket says 172.21.15.82:47974) 2024-06-06T02:40:03.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.315+0000 7f6b2e000640 1 -- 172.21.15.82:0/290561742 learned_addr learned my addr 172.21.15.82:0/290561742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:03.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.316+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.319+0000 7f6b2e000640 1 -- 172.21.15.82:0/290561742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 msgr2=0x55cbd3dca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.319+0000 7f6b2f400640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.320+0000 7f6b2e000640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.321+0000 7f6b2e000640 1 -- 172.21.15.82:0/290561742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 msgr2=0x55cbd3dd9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.321+0000 7f6b2e000640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.321+0000 7f6b2e000640 1 -- 172.21.15.82:0/290561742 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd3dd6750 con 0x55cbd39fe390 2024-06-06T02:40:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.321+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.321+0000 7f6b2f400640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.322+0000 7f6b2e000640 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b200c5980 tx=0x7f6b200d2170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c99338769a903b8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.323+0000 7f6b1b400640 1 -- 172.21.15.82:0/290561742 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200c57c0 con 0x55cbd39fe390 2024-06-06T02:40:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.323+0000 7f6b1b400640 1 -- 172.21.15.82:0/290561742 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b20031430 con 0x55cbd39fe390 2024-06-06T02:40:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.323+0000 7f6b1b400640 1 -- 172.21.15.82:0/290561742 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200ec0e0 con 0x55cbd39fe390 2024-06-06T02:40:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/290561742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 msgr2=0x55cbd3dd9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b200c5980 tx=0x7f6b200d2170 comp rx=0 tx=0).stop 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/290561742 shutdown_connections 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd3a1f070 0x55cbd3dd9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3dd9950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/290561742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd39dd9f0 0x55cbd3dca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/290561742 >> 172.21.15.82:0/290561742 conn(0x55cbd3a13460 msgr2=0x55cbd3dc9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.325+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/290561742 shutdown_connections 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.326+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/290561742 wait complete. 2024-06-06T02:40:03.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.326+0000 7f6b3bc2e740 1 -- start start 2024-06-06T02:40:03.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.327+0000 7f6b3bc2e740 1 Processor -- start 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3de4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3ddfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3ddffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b34b0 con 0x55cbd39dd9f0 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b4920 con 0x55cbd3a1f070 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b3b80 con 0x55cbd39fe390 2024-06-06T02:40:03.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.329+0000 7f6b3bc2e740 10 client.0 _ll_register_callbacks cb 0x7f6b1c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:03.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.330+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3ddfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.330+0000 7f6b2e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3ddfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47982/0 (socket says 172.21.15.82:47982) 2024-06-06T02:40:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.330+0000 7f6b2ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3de4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.330+0000 7f6b2e000640 1 -- 172.21.15.82:0/2368643569 learned_addr learned my addr 172.21.15.82:0/2368643569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:03.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.330+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3ddffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.332+0000 7f6b2f400640 1 -- 172.21.15.82:0/2368643569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 msgr2=0x55cbd3ddfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.332+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3ddfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.332+0000 7f6b2f400640 1 -- 172.21.15.82:0/2368643569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 msgr2=0x55cbd3de4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.332+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3de4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.332+0000 7f6b2f400640 1 -- 172.21.15.82:0/2368643569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd3de0520 con 0x55cbd3a1f070 2024-06-06T02:40:03.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.333+0000 7f6b2f400640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3ddffe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0123c0 tx=0x7f6b1c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b1de7946426ae5d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:03.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.333+0000 7f6b18c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:03.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.333+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c005690 con 0x55cbd3a1f070 2024-06-06T02:40:03.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.333+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6b1c009df0 con 0x55cbd3a1f070 2024-06-06T02:40:03.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.334+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbd3d3bd30 con 0x55cbd3a1f070 2024-06-06T02:40:03.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.334+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6b1c0047a0 con 0x55cbd3a1f070 2024-06-06T02:40:03.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.334+0000 7f6b3bc2e740 10 client.25577 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:03.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.335+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cbd3e522b0 con 0x55cbd3a1f070 2024-06-06T02:40:03.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.335+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cbd3d3bd30 con 0x55cbd3a1f070 2024-06-06T02:40:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6b1c01ca10 con 0x55cbd3a1f070 2024-06-06T02:40:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 10 client.25577 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 10 client.25577 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:40:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 20 client.25577 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:03.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd3e52980 0x55cbd3e54da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:03.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 4 client.25577 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:40:03.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbd3d377d0 con 0x55cbd3e52980 2024-06-06T02:40:03.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.337+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd3e52980 0x55cbd3e54da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:03.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.338+0000 7f6b2ea00640 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd3e52980 0x55cbd3e54da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c49468e4c4a432 server_cookie=ba3ca69a5ecc0462 in_seq=0 out_seq=0 2024-06-06T02:40:03.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.338+0000 7f6b18c00640 10 client.25577 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:40:03.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.338+0000 7f6b18c00640 1 -- 172.21.15.82:0/2368643569 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbd3d377d0 con 0x55cbd3e52980 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.338+0000 7f6b18c00640 10 client.25577 handle_command_reply: tid=0 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.338+0000 7f6b3bc2e740 1 client.25577 shutdown 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 msgr2=0x55cbd3ddffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3ddffe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0123c0 tx=0x7f6b1c0046c0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 shutdown_connections 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55cbd3e52980 0x55cbd3e54da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbd3a1f070 0x55cbd3ddffe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbd39fe390 0x55cbd3ddfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 --2- 172.21.15.82:0/2368643569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cbd39dd9f0 0x55cbd3de4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.339+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 >> 172.21.15.82:0/2368643569 conn(0x55cbd3a13460 msgr2=0x55cbd3dd6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.341+0000 7f6b18c00640 0 client.25577 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.341+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 shutdown_connections 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.341+0000 7f6b3bc2e740 1 -- 172.21.15.82:0/2368643569 wait complete. 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.342+0000 7f6b3bc2e740 20 client.25577 trim_cache size 0 max 16384 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.343+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 msgr2=0x7f6b140b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.343+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 0x7f6b140b5000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6b30074590 tx=0x7f6b28009500 comp rx=0 tx=0).stop 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.343+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 msgr2=0x7f6b301a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:03.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.343+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b301a48e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009230 tx=0x7f6b20003b20 comp rx=0 tx=0).stop 2024-06-06T02:40:03.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 shutdown_connections 2024-06-06T02:40:03.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b30115cc0 0x7f6b301a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6b140b2af0 0x7f6b140b5000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b30113360 0x7f6b301a48e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 --2- 172.21.15.82:0/568753405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b301099f0 0x7f6b301a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:03.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.346+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 >> 172.21.15.82:0/568753405 conn(0x7f6b3006df60 msgr2=0x7f6b301160d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:03.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.347+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 shutdown_connections 2024-06-06T02:40:03.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:03.347+0000 7f6b35600640 1 -- 172.21.15.82:0/568753405 wait complete. 2024-06-06T02:40:04.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:04 smithi082 ceph-mon[31579]: pgmap v514: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 243 MiB/s wr, 98 op/s 2024-06-06T02:40:04.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:04 smithi103 ceph-mon[36349]: pgmap v514: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 243 MiB/s wr, 98 op/s 2024-06-06T02:40:04.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:04 smithi184 ceph-mon[36922]: pgmap v514: 97 pgs: 97 active+clean; 4.9 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 243 MiB/s wr, 98 op/s 2024-06-06T02:40:04.418 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T02:40:05.109 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:06.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:06 smithi103 ceph-mon[36349]: pgmap v515: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 258 MiB/s wr, 95 op/s 2024-06-06T02:40:06.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:06 smithi082 ceph-mon[31579]: pgmap v515: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 258 MiB/s wr, 95 op/s 2024-06-06T02:40:06.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:06 smithi184 ceph-mon[36922]: pgmap v515: 97 pgs: 97 active+clean; 5.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 258 MiB/s wr, 95 op/s 2024-06-06T02:40:07.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.911+0000 7fba29800640 1 -- 172.21.15.82:0/3021419997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba24106dc0 msgr2=0x7fba241072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.912+0000 7fba29800640 1 --2- 172.21.15.82:0/3021419997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba24106dc0 0x7fba241072a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009860 tx=0x7fba1c02a340 comp rx=0 tx=0).stop 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 -- 172.21.15.82:0/3021419997 shutdown_connections 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 --2- 172.21.15.82:0/3021419997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba24106dc0 0x7fba241072a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 --2- 172.21.15.82:0/3021419997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba241022d0 0x7fba24106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 --2- 172.21.15.82:0/3021419997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba24101980 0x7fba24101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 -- 172.21.15.82:0/3021419997 >> 172.21.15.82:0/3021419997 conn(0x7fba240fd6f0 msgr2=0x7fba240ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 -- 172.21.15.82:0/3021419997 shutdown_connections 2024-06-06T02:40:07.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.914+0000 7fba29800640 1 -- 172.21.15.82:0/3021419997 wait complete. 2024-06-06T02:40:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.915+0000 7fba29800640 1 Processor -- start 2024-06-06T02:40:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 -- start start 2024-06-06T02:40:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba241022d0 0x7fba241a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba24106dc0 0x7fba2419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba24119260 con 0x7fba24106dc0 2024-06-06T02:40:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba241190e0 con 0x7fba24101980 2024-06-06T02:40:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.916+0000 7fba29800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fba241193e0 con 0x7fba241022d0 2024-06-06T02:40:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58160/0 (socket says 172.21.15.82:58160) 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 -- 172.21.15.82:0/3835554827 learned_addr learned my addr 172.21.15.82:0/3835554827 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba1be00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba241022d0 0x7fba241a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 -- 172.21.15.82:0/3835554827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba241022d0 msgr2=0x7fba241a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba241022d0 0x7fba241a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 -- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba24106dc0 msgr2=0x7fba2419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba24106dc0 0x7fba2419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.917+0000 7fba23e00640 1 -- 172.21.15.82:0/3835554827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241a0280 con 0x7fba24101980 2024-06-06T02:40:07.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba23e00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba1400ebc0 tx=0x7fba1400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba21600640 1 -- 172.21.15.82:0/3835554827 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14010630 con 0x7fba24101980 2024-06-06T02:40:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba241a0570 con 0x7fba24101980 2024-06-06T02:40:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba21600640 1 -- 172.21.15.82:0/3835554827 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba14010c80 con 0x7fba24101980 2024-06-06T02:40:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba21600640 1 -- 172.21.15.82:0/3835554827 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14018b40 con 0x7fba24101980 2024-06-06T02:40:07.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.918+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba241ac770 con 0x7fba24101980 2024-06-06T02:40:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.922+0000 7fba21600640 1 -- 172.21.15.82:0/3835554827 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fba14018ce0 con 0x7fba24101980 2024-06-06T02:40:07.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.923+0000 7fba3149d740 1 Processor -- start 2024-06-06T02:40:07.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.923+0000 7fba3149d740 1 -- start start 2024-06-06T02:40:07.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.923+0000 7fba21600640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 0x7fba080b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba21600640 1 -- 172.21.15.82:0/3835554827 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fba140e28f0 con 0x7fba24101980 2024-06-06T02:40:07.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a60060520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a60060fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a5ffd4de0 con 0x561a5fcba070 2024-06-06T02:40:07.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561a5ffc4380 con 0x561a5fc911b0 2024-06-06T02:40:07.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba3149d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a5ffc83c0 con 0x561a5fc99390 2024-06-06T02:40:07.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba1be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba1be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58164/0 (socket says 172.21.15.82:58164) 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba1be00640 1 -- 172.21.15.82:0/2781547829 learned_addr learned my addr 172.21.15.82:0/2781547829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.924+0000 7fba28e00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 0x7fba080b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba23e00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a60060520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba28e00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a60060fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba1be00640 1 -- 172.21.15.82:0/2781547829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 msgr2=0x561a60060fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba1be00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a60060fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba1be00640 1 -- 172.21.15.82:0/2781547829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 msgr2=0x561a60060520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba1be00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a60060520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.925+0000 7fba1be00640 1 -- 172.21.15.82:0/2781547829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5fd25650 con 0x561a5fc911b0 2024-06-06T02:40:07.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba23e00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a60060520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba28e00640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 0x7fba080b4dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0057c0 tx=0x7fba1c0042f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba1be00640 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009a50 tx=0x7fba0c009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c23ee4e255683b7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba19600640 1 -- 172.21.15.82:0/2781547829 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00fca0 con 0x561a5fc911b0 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba19600640 1 -- 172.21.15.82:0/2781547829 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c00fe40 con 0x561a5fc911b0 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.926+0000 7fba19600640 1 -- 172.21.15.82:0/2781547829 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c01b870 con 0x561a5fc911b0 2024-06-06T02:40:07.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 -- 172.21.15.82:0/2781547829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 msgr2=0x561a60060a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009a50 tx=0x7fba0c009f10 comp rx=0 tx=0).stop 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 -- 172.21.15.82:0/2781547829 shutdown_connections 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a60060fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc911b0 0x561a60060a60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 --2- 172.21.15.82:0/2781547829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a60060520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 -- 172.21.15.82:0/2781547829 >> 172.21.15.82:0/2781547829 conn(0x561a5fcae460 msgr2=0x561a6005cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 -- 172.21.15.82:0/2781547829 shutdown_connections 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.928+0000 7fba3149d740 1 -- 172.21.15.82:0/2781547829 wait complete. 2024-06-06T02:40:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.929+0000 7fba3149d740 1 -- start start 2024-06-06T02:40:07.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.929+0000 7fba3149d740 1 Processor -- start 2024-06-06T02:40:07.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba3149d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 0x561a6006aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba3149d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba3149d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba1be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba23e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 0x561a6006aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.930+0000 7fba23e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 0x561a6006aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:48022/0 (socket says 172.21.15.82:48022) 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba3149d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a5fe28700 con 0x561a5fcba070 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba3149d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561a5ff616e0 con 0x561a5fc99390 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba3149d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561a6006d690 con 0x561a5fc911b0 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba1be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58176/0 (socket says 172.21.15.82:58176) 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba1be00640 1 -- 172.21.15.82:0/2717907329 learned_addr learned my addr 172.21.15.82:0/2717907329 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:07.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba3149d740 10 client.0 _ll_register_callbacks cb 0x561a5ff6dda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.931+0000 7fba28e00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 -- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 msgr2=0x561a6006aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 0x561a6006aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 -- 172.21.15.82:0/2717907329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 msgr2=0x561a600769c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a600769c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 -- 172.21.15.82:0/2717907329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a5ff8cf90 con 0x561a5fc99390 2024-06-06T02:40:07.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba28e00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a600769c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba1be00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba0c000c00 tx=0x7fba0c00fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ade96ae4baa286 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.932+0000 7fba12000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.933+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c02b060 con 0x561a5fc99390 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.933+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba0c00fe40 con 0x561a5fc99390 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.933+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fba0c011440 con 0x561a5fc99390 2024-06-06T02:40:07.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.933+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba0c011640 con 0x561a5fc99390 2024-06-06T02:40:07.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 10 client.25589 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:07.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a600795d0 con 0x561a5fc99390 2024-06-06T02:40:07.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c00fe40 con 0x561a5fc99390 2024-06-06T02:40:07.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba0c030070 con 0x561a5fc99390 2024-06-06T02:40:07.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 10 client.25589 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 10 client.25589 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 20 client.25589 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc789f0 0x561a6007c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 4 client.25589 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.934+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a5ffd6d30 con 0x561a5fc789f0 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.935+0000 7fba23e00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc789f0 0x561a6007c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.936+0000 7fba23e00640 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc789f0 0x561a6007c990 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39cc8f1062578adb server_cookie=c895345054e96d5c in_seq=0 out_seq=0 2024-06-06T02:40:07.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.936+0000 7fba12000640 10 client.25589 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:40:07.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.937+0000 7fba12000640 1 -- 172.21.15.82:0/2717907329 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561a5ffd6d30 con 0x561a5fc789f0 2024-06-06T02:40:07.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.937+0000 7fba12000640 10 client.25589 handle_command_reply: tid=0 2024-06-06T02:40:07.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.937+0000 7fba3149d740 1 client.25589 shutdown 2024-06-06T02:40:07.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.939+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 msgr2=0x561a6006afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.939+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba0c000c00 tx=0x7fba0c00fcd0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 shutdown_connections 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc789f0 0x561a6007c990 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fcba070 0x561a600769c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6006afd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 --2- 172.21.15.82:0/2717907329 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc911b0 0x561a6006aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 >> 172.21.15.82:0/2717907329 conn(0x561a5fcae460 msgr2=0x561a600604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba12000640 0 client.25589 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 shutdown_connections 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 1 -- 172.21.15.82:0/2717907329 wait complete. 2024-06-06T02:40:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.940+0000 7fba3149d740 20 client.25589 trim_cache size 0 max 16384 2024-06-06T02:40:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 Processor -- start 2024-06-06T02:40:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 -- start start 2024-06-06T02:40:07.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a60065170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fcba070 0x561a60076930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b76a0 con 0x561a5fc911b0 2024-06-06T02:40:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b4f70 con 0x561a5fcba070 2024-06-06T02:40:07.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.958+0000 7fba3149d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b2da0 con 0x561a5fc99390 2024-06-06T02:40:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a60065170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:48030/0 (socket says 172.21.15.82:48030) 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 -- 172.21.15.82:0/758444211 learned_addr learned my addr 172.21.15.82:0/758444211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba28e00640 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fcba070 0x561a60076930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 -- 172.21.15.82:0/758444211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fcba070 msgr2=0x561a60076930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fcba070 0x561a60076930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 -- 172.21.15.82:0/758444211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 msgr2=0x561a60065170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a60065170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.959+0000 7fba1be00640 1 -- 172.21.15.82:0/758444211 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6006ce90 con 0x561a5fc99390 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.960+0000 7fba1be00640 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0093d0 tx=0x7fba0c0115d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76a09b9b7a0f4f60 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.960+0000 7fba18c00640 1 -- 172.21.15.82:0/758444211 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c036030 con 0x561a5fc99390 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.960+0000 7fba18c00640 1 -- 172.21.15.82:0/758444211 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba0c011e40 con 0x561a5fc99390 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.960+0000 7fba18c00640 1 -- 172.21.15.82:0/758444211 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c02b040 con 0x561a5fc99390 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 -- 172.21.15.82:0/758444211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 msgr2=0x561a6006bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0093d0 tx=0x7fba0c0115d0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 -- 172.21.15.82:0/758444211 shutdown_connections 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fcba070 0x561a60076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fc99390 0x561a6006bfe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.961+0000 7fba3149d740 1 --2- 172.21.15.82:0/758444211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a60065170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.962+0000 7fba3149d740 1 -- 172.21.15.82:0/758444211 >> 172.21.15.82:0/758444211 conn(0x561a5fcae460 msgr2=0x561a600699f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.962+0000 7fba3149d740 1 -- 172.21.15.82:0/758444211 shutdown_connections 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.962+0000 7fba3149d740 1 -- 172.21.15.82:0/758444211 wait complete. 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.963+0000 7fba3149d740 1 -- start start 2024-06-06T02:40:07.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.963+0000 7fba3149d740 1 Processor -- start 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6007d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fcba070 0x561a6007d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b3430 con 0x561a5fc911b0 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b48a0 con 0x561a5fc99390 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fba241b3b00 con 0x561a5fcba070 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba3149d740 10 client.0 _ll_register_callbacks cb 0x7fba0c009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:07.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba23e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46778/0 (socket says 172.21.15.82:46778) 2024-06-06T02:40:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba23e00640 1 -- 172.21.15.82:0/4209471450 learned_addr learned my addr 172.21.15.82:0/4209471450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.964+0000 7fba1be00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6007d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba28e00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fcba070 0x561a6007d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 -- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fcba070 msgr2=0x561a6007d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fcba070 0x561a6007d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 -- 172.21.15.82:0/4209471450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 msgr2=0x561a6007d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6007d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 -- 172.21.15.82:0/4209471450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6007dc40 con 0x561a5fc911b0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba23e00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba140a5f50 tx=0x7fba1400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4192d936999af71d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.965+0000 7fba12000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.966+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140107d0 con 0x561a5fc911b0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.966+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fba14010970 con 0x561a5fc911b0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.966+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a5ffd27d0 con 0x561a5fc911b0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.967+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fba140a9130 con 0x561a5fc911b0 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.967+0000 7fba3149d740 10 client.15426 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:07.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.967+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a600e4b00 con 0x561a5fc911b0 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561a5ffd27d0 con 0x561a5fc911b0 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fba140a8db0 con 0x561a5fc911b0 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 10 client.15426 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 10 client.15426 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 20 client.15426 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc4dda0 0x561a600e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 4 client.15426 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:40:07.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.968+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a5ffcff10 con 0x561a5fc4dda0 2024-06-06T02:40:07.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.969+0000 7fba1be00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc4dda0 0x561a600e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba12000640 10 client.15426 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba1be00640 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc4dda0 0x561a600e71c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79ab9bc17c50cf7b server_cookie=25f53379f238f980 in_seq=0 out_seq=0 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba12000640 1 -- 172.21.15.82:0/4209471450 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a5ffcff10 con 0x561a5fc4dda0 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba12000640 10 client.15426 handle_command_reply: tid=0 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 client.15426 shutdown 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 msgr2=0x561a6007fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fba140a5f50 tx=0x7fba1400cf60 comp rx=0 tx=0).stop 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 shutdown_connections 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x561a5fc4dda0 0x561a600e71c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561a5fcba070 0x561a6007d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a5fc99390 0x561a6007d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 --2- 172.21.15.82:0/4209471450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a5fc911b0 0x561a6007fe90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba12000640 0 client.15426 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.970+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 >> 172.21.15.82:0/4209471450 conn(0x561a5fcae460 msgr2=0x561a60069030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.971+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 shutdown_connections 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.971+0000 7fba3149d740 1 -- 172.21.15.82:0/4209471450 wait complete. 2024-06-06T02:40:07.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.971+0000 7fba3149d740 20 client.15426 trim_cache size 0 max 16384 2024-06-06T02:40:07.973 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:40:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.971+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 msgr2=0x7fba080b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.971+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 0x7fba080b4dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0057c0 tx=0x7fba1c0042f0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 msgr2=0x7fba241a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba1400ebc0 tx=0x7fba1400c6a0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 shutdown_connections 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba24106dc0 0x7fba2419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fba080b28b0 0x7fba080b4dc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba241022d0 0x7fba241a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 --2- 172.21.15.82:0/3835554827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba24101980 0x7fba241a59c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 >> 172.21.15.82:0/3835554827 conn(0x7fba240fd6f0 msgr2=0x7fba241047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 shutdown_connections 2024-06-06T02:40:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:07.972+0000 7fba29800640 1 -- 172.21.15.82:0/3835554827 wait complete. 2024-06-06T02:40:08.363 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:08 smithi082 ceph-mon[31579]: pgmap v516: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 257 MiB/s wr, 92 op/s 2024-06-06T02:40:08.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:08 smithi103 ceph-mon[36349]: pgmap v516: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 257 MiB/s wr, 92 op/s 2024-06-06T02:40:08.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:08 smithi184 ceph-mon[36922]: pgmap v516: 97 pgs: 97 active+clean; 6.2 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 257 MiB/s wr, 92 op/s 2024-06-06T02:40:08.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T02:40:09.325 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:10.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:10 smithi103 ceph-mon[36349]: pgmap v517: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 236 MiB/s wr, 97 op/s 2024-06-06T02:40:10.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:10 smithi082 ceph-mon[31579]: pgmap v517: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 236 MiB/s wr, 97 op/s 2024-06-06T02:40:10.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:10 smithi184 ceph-mon[36922]: pgmap v517: 97 pgs: 97 active+clean; 6.6 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 236 MiB/s wr, 97 op/s 2024-06-06T02:40:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 -- 172.21.15.82:0/1582141592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63441033f0 msgr2=0x7f634410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 --2- 172.21.15.82:0/1582141592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63441033f0 0x7f634410f970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f633c009be0 tx=0x7f633c02a6d0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 -- 172.21.15.82:0/1582141592 shutdown_connections 2024-06-06T02:40:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 --2- 172.21.15.82:0/1582141592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63441033f0 0x7f634410f970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 --2- 172.21.15.82:0/1582141592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344102aa0 0x7f6344102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 --2- 172.21.15.82:0/1582141592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6344108ad0 0x7f6344108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.071+0000 7f6349e00640 1 -- 172.21.15.82:0/1582141592 >> 172.21.15.82:0/1582141592 conn(0x7f63440fe790 msgr2=0x7f6344100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.072+0000 7f6349e00640 1 -- 172.21.15.82:0/1582141592 shutdown_connections 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.072+0000 7f6349e00640 1 -- 172.21.15.82:0/1582141592 wait complete. 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.073+0000 7f6349e00640 1 Processor -- start 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.073+0000 7f6349e00640 1 -- start start 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6344102aa0 0x7f6344199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344108ad0 0x7f634419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112ce0 con 0x7f6344102aa0 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112b60 con 0x7f63441033f0 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.074+0000 7f6349e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112e60 con 0x7f6344108ad0 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40120/0 (socket says 172.21.15.82:40120) 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 -- 172.21.15.82:0/2248937170 learned_addr learned my addr 172.21.15.82:0/2248937170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6349400640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344108ad0 0x7f634419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6348a00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6344102aa0 0x7f6344199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 -- 172.21.15.82:0/2248937170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344108ad0 msgr2=0x7f634419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344108ad0 0x7f634419df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 -- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6344102aa0 msgr2=0x7f6344199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6344102aa0 0x7f6344199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.075+0000 7f6343e00640 1 -- 172.21.15.82:0/2248937170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634419e5b0 con 0x7f63441033f0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.076+0000 7f6343e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f633800d770 tx=0x7f633800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.076+0000 7f6341600640 1 -- 172.21.15.82:0/2248937170 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338017070 con 0x7f63441033f0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.076+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634419e8a0 con 0x7f63441033f0 2024-06-06T02:40:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.076+0000 7f6341600640 1 -- 172.21.15.82:0/2248937170 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f633800de80 con 0x7f63441033f0 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.076+0000 7f6341600640 1 -- 172.21.15.82:0/2248937170 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633800f620 con 0x7f63441033f0 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.077+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a6220 con 0x7f63441033f0 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.081+0000 7f6351932740 1 Processor -- start 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 -- start start 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466abc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466abce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565466a30de0 con 0x5654666f5390 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x565466a20380 con 0x565466716070 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.082+0000 7f6351932740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565466a243c0 con 0x5654666ed1b0 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6348a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6348a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55796/0 (socket says 172.21.15.82:55796) 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6348a00640 1 -- 172.21.15.82:0/2224479323 learned_addr learned my addr 172.21.15.82:0/2224479323 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6349400640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466abc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6343e00640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466abce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.083+0000 7f6341600640 1 -- 172.21.15.82:0/2248937170 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f63441033f0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6348a00640 1 -- 172.21.15.82:0/2224479323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 msgr2=0x565466abc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6348a00640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466abc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6348a00640 1 -- 172.21.15.82:0/2224479323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 msgr2=0x565466abce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6348a00640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466abce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6348a00640 1 -- 172.21.15.82:0/2224479323 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565466781650 con 0x5654666ed1b0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.084+0000 7f6349400640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466abc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.085+0000 7f6348a00640 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6330009bb0 tx=0x7f63300117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d39d1b20904ee272 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.085+0000 7f6336000640 1 -- 172.21.15.82:0/2224479323 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330012450 con 0x5654666ed1b0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.085+0000 7f6336000640 1 -- 172.21.15.82:0/2224479323 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6330012aa0 con 0x5654666ed1b0 2024-06-06T02:40:12.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.085+0000 7f6336000640 1 -- 172.21.15.82:0/2224479323 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633000fb20 con 0x5654666ed1b0 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.086+0000 7f6341600640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 0x7f632c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.086+0000 7f6341600640 1 -- 172.21.15.82:0/2248937170 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f63380e1cb0 con 0x7f63441033f0 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.086+0000 7f6351932740 1 -- 172.21.15.82:0/2224479323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 msgr2=0x565466abc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.086+0000 7f6351932740 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6330009bb0 tx=0x7f63300117b0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 -- 172.21.15.82:0/2224479323 shutdown_connections 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466abce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466abc940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 --2- 172.21.15.82:0/2224479323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466abc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 -- 172.21.15.82:0/2224479323 >> 172.21.15.82:0/2224479323 conn(0x56546670a460 msgr2=0x565466ab8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6349400640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 0x7f632c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 -- 172.21.15.82:0/2224479323 shutdown_connections 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 -- 172.21.15.82:0/2224479323 wait complete. 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.087+0000 7f6351932740 1 -- start start 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.088+0000 7f6349400640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 0x7f632c0b4e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f633c02acc0 tx=0x7f633c009320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.088+0000 7f6351932740 1 Processor -- start 2024-06-06T02:40:12.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.088+0000 7f6351932740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466acfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.088+0000 7f6351932740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466acffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6348a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466acfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6348a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466acfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55800/0 (socket says 172.21.15.82:55800) 2024-06-06T02:40:12.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6348a00640 1 -- 172.21.15.82:0/2132730180 learned_addr learned my addr 172.21.15.82:0/2132730180 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466ad4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565466884700 con 0x5654666f5390 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5654669bd6e0 con 0x565466716070 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x565466acdaa0 con 0x5654666ed1b0 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6351932740 10 client.0 _ll_register_callbacks cb 0x5654669c9da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6349400640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466ad4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.089+0000 7f6343e00640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466acffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 -- 172.21.15.82:0/2132730180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 msgr2=0x565466acfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466acfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 -- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 msgr2=0x565466acffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466acffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654669e8f90 con 0x565466716070 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6343e00640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466acffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f6349400640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466ad4050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f633c02abf0 tx=0x7f633c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bcfa0edc95fb392 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f632aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.090+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c044070 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f633c004240 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6330012aa0 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f633c036050 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f6351932740 10 client.25607 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565466ade030 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6330012aa0 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.091+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f633c03c040 con 0x565466716070 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 10 client.25607 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 10 client.25607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 20 client.25607 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666d49f0 0x565466ae1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 4 client.25607 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565466a32d30 con 0x5654666d49f0 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.092+0000 7f6348a00640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666d49f0 0x565466ae1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.093+0000 7f6348a00640 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666d49f0 0x565466ae1620 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad08f6859ac051c5 server_cookie=c4c26078d790e6a5 in_seq=0 out_seq=0 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.093+0000 7f632aa00640 10 client.25607 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f632aa00640 1 -- 172.21.15.82:0/2132730180 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x565466a32d30 con 0x5654666d49f0 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f632aa00640 10 client.25607 handle_command_reply: tid=0 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 client.25607 shutdown 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 msgr2=0x565466ad4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466ad4050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f633c02abf0 tx=0x7f633c02a6d0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 shutdown_connections 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565466716070 0x565466ad4050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666d49f0 0x565466ae1620 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466acffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 --2- 172.21.15.82:0/2132730180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666ed1b0 0x565466acfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.094+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 >> 172.21.15.82:0/2132730180 conn(0x56546670a460 msgr2=0x565466ab73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.095+0000 7f632aa00640 0 client.25607 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.095+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 shutdown_connections 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.095+0000 7f6351932740 1 -- 172.21.15.82:0/2132730180 wait complete. 2024-06-06T02:40:12.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.095+0000 7f6351932740 20 client.25607 trim_cache size 0 max 16384 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 Processor -- start 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 -- start start 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466accfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565466716070 0x565466ad3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63441aee00 con 0x5654666f5390 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63441ac6d0 con 0x5654666ed1b0 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.110+0000 7f6351932740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63441aa500 con 0x565466716070 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.111+0000 7f6343e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.111+0000 7f6343e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43874/0 (socket says 172.21.15.82:43874) 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.111+0000 7f6343e00640 1 -- 172.21.15.82:0/1078708244 learned_addr learned my addr 172.21.15.82:0/1078708244 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.111+0000 7f6349400640 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565466716070 0x565466ad3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.112+0000 7f6343e00640 1 -- 172.21.15.82:0/1078708244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565466716070 msgr2=0x565466ad3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.112+0000 7f6343e00640 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565466716070 0x565466ad3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.112+0000 7f6343e00640 1 -- 172.21.15.82:0/1078708244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 msgr2=0x565466accfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.112+0000 7f6343e00640 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466accfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.112+0000 7f6343e00640 1 -- 172.21.15.82:0/1078708244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565466ad0d50 con 0x5654666f5390 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.113+0000 7f6343e00640 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f63380a9220 tx=0x7f6338010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254c441a4ee5a712 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.113+0000 7f6335600640 1 -- 172.21.15.82:0/1078708244 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338021070 con 0x5654666f5390 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.113+0000 7f6335600640 1 -- 172.21.15.82:0/1078708244 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63380a9990 con 0x5654666f5390 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.113+0000 7f6335600640 1 -- 172.21.15.82:0/1078708244 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63380a5520 con 0x5654666f5390 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.114+0000 7f6351932740 1 -- 172.21.15.82:0/1078708244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 msgr2=0x565466aceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.114+0000 7f6351932740 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f63380a9220 tx=0x7f6338010c00 comp rx=0 tx=0).stop 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 -- 172.21.15.82:0/1078708244 shutdown_connections 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565466716070 0x565466ad3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5654666f5390 0x565466aceb10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 --2- 172.21.15.82:0/1078708244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466accfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 -- 172.21.15.82:0/1078708244 >> 172.21.15.82:0/1078708244 conn(0x56546670a460 msgr2=0x565466ab73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 -- 172.21.15.82:0/1078708244 shutdown_connections 2024-06-06T02:40:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.115+0000 7f6351932740 1 -- 172.21.15.82:0/1078708244 wait complete. 2024-06-06T02:40:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.116+0000 7f6351932740 1 -- start start 2024-06-06T02:40:12.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.116+0000 7f6351932740 1 Processor -- start 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466adb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666f5390 0x565466ad4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 0x565466ad5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f63441aab90 con 0x565466716070 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63441ac000 con 0x5654666ed1b0 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f63441ab260 con 0x5654666f5390 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6351932740 10 client.0 _ll_register_callbacks cb 0x7f6330005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6348a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466adb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6348a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466adb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40140/0 (socket says 172.21.15.82:40140) 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.117+0000 7f6348a00640 1 -- 172.21.15.82:0/3138784912 learned_addr learned my addr 172.21.15.82:0/3138784912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 0x565466ad5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6343e00640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666f5390 0x565466ad4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 -- 172.21.15.82:0/3138784912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666f5390 msgr2=0x565466ad4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666f5390 0x565466ad4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 -- 172.21.15.82:0/3138784912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 msgr2=0x565466adb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466adb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.118+0000 7f6349400640 1 -- 172.21.15.82:0/3138784912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565466ad5690 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.119+0000 7f6349400640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 0x565466ad5150 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f633c04bb60 tx=0x7f633c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2abbf3a0882b93a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.119+0000 7f632aa00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c064070 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f633c004770 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63380a9990 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f633c044040 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f6351932740 10 client.15444 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.120+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565466ad9f10 con 0x565466716070 2024-06-06T02:40:12.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.121+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63380a9990 con 0x565466716070 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.121+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f633c067030 con 0x565466716070 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.121+0000 7f6351932740 10 client.15444 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.121+0000 7f6351932740 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.122+0000 7f6351932740 20 client.15444 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.122+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666a9da0 0x565466b4c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.122+0000 7f6351932740 4 client.15444 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:40:12.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.122+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565466a2e7d0 con 0x5654666a9da0 2024-06-06T02:40:12.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.129+0000 7f6348a00640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666a9da0 0x565466b4c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.133+0000 7f6348a00640 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666a9da0 0x565466b4c170 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c146e1e9241adf18 server_cookie=bffabc53ccdc3e65 in_seq=0 out_seq=0 2024-06-06T02:40:12.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.133+0000 7f632aa00640 10 client.15444 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.133+0000 7f632aa00640 1 -- 172.21.15.82:0/3138784912 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565466a2e7d0 con 0x5654666a9da0 2024-06-06T02:40:12.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.133+0000 7f632aa00640 10 client.15444 handle_command_reply: tid=0 2024-06-06T02:40:12.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.133+0000 7f6351932740 1 client.15444 shutdown 2024-06-06T02:40:12.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.134+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 msgr2=0x565466ad5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.134+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 0x565466ad5150 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f633c04bb60 tx=0x7f633c004170 comp rx=0 tx=0).stop 2024-06-06T02:40:12.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.135+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 shutdown_connections 2024-06-06T02:40:12.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.135+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5654666a9da0 0x565466b4c170 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.136+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565466716070 0x565466ad5150 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.136+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5654666f5390 0x565466ad4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.136+0000 7f6351932740 1 --2- 172.21.15.82:0/3138784912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5654666ed1b0 0x565466adb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.136+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 >> 172.21.15.82:0/3138784912 conn(0x56546670a460 msgr2=0x565466ace8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.136+0000 7f632aa00640 0 client.15444 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.138+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 shutdown_connections 2024-06-06T02:40:12.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.138+0000 7f6351932740 1 -- 172.21.15.82:0/3138784912 wait complete. 2024-06-06T02:40:12.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.140+0000 7f6351932740 20 client.15444 trim_cache size 0 max 16384 2024-06-06T02:40:12.149 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:40:12.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.151+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 msgr2=0x7f632c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.151+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 0x7f632c0b4e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f633c02acc0 tx=0x7f633c009320 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.151+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 msgr2=0x7f6344199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.151+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f633800d770 tx=0x7f633800dc30 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 shutdown_connections 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f632c0b28f0 0x7f632c0b4e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6344108ad0 0x7f634419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63441033f0 0x7f6344199ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 --2- 172.21.15.82:0/2248937170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6344102aa0 0x7f6344199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.152+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 >> 172.21.15.82:0/2248937170 conn(0x7f63440fe790 msgr2=0x7f63440fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.155+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 shutdown_connections 2024-06-06T02:40:12.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:12.156+0000 7f6349e00640 1 -- 172.21.15.82:0/2248937170 wait complete. 2024-06-06T02:40:12.217 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:12 smithi082 ceph-mon[31579]: pgmap v518: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 254 MiB/s wr, 92 op/s 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.556+0000 7f93f5000640 1 -- 172.21.15.82:0/3556717340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f0108ff0 msgr2=0x7f93f0109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.556+0000 7f93f5000640 1 --2- 172.21.15.82:0/3556717340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f0108ff0 0x7f93f0109400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009ca0 tx=0x7f93e802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.557+0000 7f93f5000640 1 -- 172.21.15.82:0/3556717340 shutdown_connections 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.557+0000 7f93f5000640 1 --2- 172.21.15.82:0/3556717340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f0111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.557+0000 7f93f5000640 1 --2- 172.21.15.82:0/3556717340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f010a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.557+0000 7f93f5000640 1 --2- 172.21.15.82:0/3556717340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f0108ff0 0x7f93f0109400 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009ca0 tx=0x7f93e802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.557+0000 7f93f5000640 1 -- 172.21.15.82:0/3556717340 >> 172.21.15.82:0/3556717340 conn(0x7f93f0078220 msgr2=0x7f93f007a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.558+0000 7f93f5000640 1 -- 172.21.15.82:0/3556717340 shutdown_connections 2024-06-06T02:40:12.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.558+0000 7f93f5000640 1 -- 172.21.15.82:0/3556717340 wait complete. 2024-06-06T02:40:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.560+0000 7f93f5000640 1 Processor -- start 2024-06-06T02:40:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.561+0000 7f93f5000640 1 -- start start 2024-06-06T02:40:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.561+0000 7f93f5000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93f5000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93f5000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f01a4c80 0x7f93f01a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93f5000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0114b70 con 0x7f93f01a4c80 2024-06-06T02:40:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93f5000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f93f01149f0 con 0x7f93f010aa60 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93f5000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93f0114cf0 con 0x7f93f010a110 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93ef400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93ef400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55824/0 (socket says 172.21.15.82:55824) 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.562+0000 7f93ef400640 1 -- 172.21.15.82:0/3393233925 learned_addr learned my addr 172.21.15.82:0/3393233925 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93eea00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93efe00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f01a4c80 0x7f93f01a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93ef400640 1 -- 172.21.15.82:0/3393233925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 msgr2=0x7f93f019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93ef400640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93ef400640 1 -- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f01a4c80 msgr2=0x7f93f01a70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93ef400640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f01a4c80 0x7f93f01a70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.563+0000 7f93ef400640 1 -- 172.21.15.82:0/3393233925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f01a77d0 con 0x7f93f010a110 2024-06-06T02:40:12.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.564+0000 7f93eea00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.564+0000 7f93ef400640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93e802aeb0 tx=0x7f93e8005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.565+0000 7f93e7e00640 1 -- 172.21.15.82:0/3393233925 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8004040 con 0x7f93f010a110 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.565+0000 7f93e7e00640 1 -- 172.21.15.82:0/3393233925 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e8004690 con 0x7f93f010a110 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.565+0000 7f93e7e00640 1 -- 172.21.15.82:0/3393233925 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8030c50 con 0x7f93f010a110 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.565+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f01a7a60 con 0x7f93f010a110 2024-06-06T02:40:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.565+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f01a7f60 con 0x7f93f010a110 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.575+0000 7f93fd59f740 1 Processor -- start 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.575+0000 7f93fd59f740 1 -- start start 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3dd93480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 0x562f3dd9a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f3dd05480 con 0x562f3d9c52f0 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f3dcf4a20 con 0x562f3d9cd4d0 2024-06-06T02:40:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.576+0000 7f93fd59f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562f3dcf8a60 con 0x562f3d9ee1b0 2024-06-06T02:40:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.577+0000 7f93e7e00640 1 -- 172.21.15.82:0/3393233925 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f93e80041e0 con 0x7f93f010a110 2024-06-06T02:40:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.577+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.577+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55840/0 (socket says 172.21.15.82:55840) 2024-06-06T02:40:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.577+0000 7f93efe00640 1 -- 172.21.15.82:0/1668439625 learned_addr learned my addr 172.21.15.82:0/1668439625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.577+0000 7f93ef400640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3dd93480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.578+0000 7f93eea00640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 0x562f3dd9a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93ef400640 1 -- 172.21.15.82:0/1668439625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 msgr2=0x562f3dd92f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93ef400640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93ef400640 1 -- 172.21.15.82:0/1668439625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 msgr2=0x562f3dd9a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93ef400640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 0x562f3dd9a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93ef400640 1 -- 172.21.15.82:0/1668439625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3dcf18d0 con 0x562f3d9c52f0 2024-06-06T02:40:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93efe00640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.579+0000 7f93eea00640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 0x562f3dd9a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.580+0000 7f93ef400640 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3dd93480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93e8101040 tx=0x7f93e8109560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedb14e2670755a5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.580+0000 7f93e7e00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 0x7f93d40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.581+0000 7f93efe00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 0x7f93d40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.581+0000 7f93e7e00640 1 -- 172.21.15.82:0/3393233925 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f93e81035e0 con 0x7f93f010a110 2024-06-06T02:40:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.583+0000 7f93e4c00640 1 -- 172.21.15.82:0/1668439625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80c6a80 con 0x562f3d9c52f0 2024-06-06T02:40:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.583+0000 7f93efe00640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 0x7f93d40b4f00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f93e0012450 tx=0x7f93e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.587+0000 7f93e4c00640 1 -- 172.21.15.82:0/1668439625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e8110030 con 0x562f3d9c52f0 2024-06-06T02:40:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.587+0000 7f93e4c00640 1 -- 172.21.15.82:0/1668439625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ca330 con 0x562f3d9c52f0 2024-06-06T02:40:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.589+0000 7f93fd59f740 1 -- 172.21.15.82:0/1668439625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 msgr2=0x562f3dd93480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.589+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3dd93480 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93e8101040 tx=0x7f93e8109560 comp rx=0 tx=0).stop 2024-06-06T02:40:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.593+0000 7f93fd59f740 1 -- 172.21.15.82:0/1668439625 shutdown_connections 2024-06-06T02:40:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.594+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9cd4d0 0x562f3dd9a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.594+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3dd93480 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.595+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1668439625 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3dd92f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.595+0000 7f93fd59f740 1 -- 172.21.15.82:0/1668439625 >> 172.21.15.82:0/1668439625 conn(0x562f3d9e2300 msgr2=0x562f3dd8e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.596+0000 7f93fd59f740 1 -- 172.21.15.82:0/1668439625 shutdown_connections 2024-06-06T02:40:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.597+0000 7f93fd59f740 1 -- 172.21.15.82:0/1668439625 wait complete. 2024-06-06T02:40:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.600+0000 7f93fd59f740 1 -- start start 2024-06-06T02:40:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.602+0000 7f93fd59f740 1 Processor -- start 2024-06-06T02:40:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.603+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.604+0000 7f93ef400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.604+0000 7f93ef400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43924/0 (socket says 172.21.15.82:43924) 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.604+0000 7f93ef400640 1 -- 172.21.15.82:0/682202678 learned_addr learned my addr 172.21.15.82:0/682202678 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.604+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f3dc2fab0 con 0x562f3d9c52f0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f3dc92630 con 0x562f3d9ee1b0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562f3dd05480 con 0x562f3d9cd4d0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93fd59f740 10 client.0 _ll_register_callbacks cb 0x562f3dc98610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.605+0000 7f93efe00640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.606+0000 7f93ef400640 1 -- 172.21.15.82:0/682202678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9cd4d0 msgr2=0x562f3ddad820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.606+0000 7f93ef400640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.606+0000 7f93ef400640 1 -- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 msgr2=0x562f3ddb46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.607+0000 7f93ef400640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.607+0000 7f93ef400640 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3dcbf170 con 0x562f3d9c52f0 2024-06-06T02:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.607+0000 7f93efe00640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.607+0000 7f93d9600640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:40:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.607+0000 7f93ef400640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93e8003fd0 tx=0x7f93e802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ad78413cafb861 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.608+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e80ca510 con 0x562f3d9c52f0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.609+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f93e8030df0 con 0x562f3d9c52f0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.609+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93e8110030 con 0x562f3d9c52f0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.610+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93e80ca990 con 0x562f3d9c52f0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.610+0000 7f93fd59f740 10 client.15456 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.610+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f3da59790 con 0x562f3d9c52f0 2024-06-06T02:40:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93e8110030 con 0x562f3d9c52f0 2024-06-06T02:40:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93e80d3070 con 0x562f3d9c52f0 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 10 client.15456 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 20 client.15456 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3d9acd80 0x562f3ddba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 4 client.15456 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.611+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f3dd073d0 con 0x562f3d9acd80 2024-06-06T02:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.612+0000 7f93eea00640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3d9acd80 0x562f3ddba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.613+0000 7f93d9600640 10 client.15456 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:12 smithi103 ceph-mon[36349]: pgmap v518: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 254 MiB/s wr, 92 op/s 2024-06-06T02:40:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.616+0000 7f93eea00640 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3d9acd80 0x562f3ddba9f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cae7809f1dc1f8d server_cookie=660c4f8fcc471ee6 in_seq=0 out_seq=0 2024-06-06T02:40:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.618+0000 7f93d9600640 1 -- 172.21.15.82:0/682202678 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562f3dd073d0 con 0x562f3d9acd80 2024-06-06T02:40:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.618+0000 7f93d9600640 10 client.15456 handle_command_reply: tid=0 2024-06-06T02:40:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.618+0000 7f93fd59f740 1 client.15456 shutdown 2024-06-06T02:40:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 msgr2=0x562f3ddad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93e8003fd0 tx=0x7f93e802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 shutdown_connections 2024-06-06T02:40:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3d9acd80 0x562f3ddba9f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 --2- 172.21.15.82:0/682202678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9c52f0 0x562f3ddad2e0 secure :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f93e8003fd0 tx=0x7f93e802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 >> 172.21.15.82:0/682202678 conn(0x562f3d9e2300 msgr2=0x562f3dd8f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.620+0000 7f93d9600640 0 client.15456 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.622+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 shutdown_connections 2024-06-06T02:40:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.623+0000 7f93fd59f740 1 -- 172.21.15.82:0/682202678 wait complete. 2024-06-06T02:40:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.624+0000 7f93fd59f740 20 client.15456 trim_cache size 0 max 16384 2024-06-06T02:40:12.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:12 smithi184 ceph-mon[36922]: pgmap v518: 97 pgs: 97 active+clean; 7.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 254 MiB/s wr, 92 op/s 2024-06-06T02:40:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.661+0000 7f93fd59f740 1 Processor -- start 2024-06-06T02:40:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 -- start start 2024-06-06T02:40:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0010d40 con 0x562f3d9cd4d0 2024-06-06T02:40:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f93d000e610 con 0x562f3d9ee1b0 2024-06-06T02:40:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.662+0000 7f93fd59f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93d000c440 con 0x562f3d9821c0 2024-06-06T02:40:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.663+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.663+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55862/0 (socket says 172.21.15.82:55862) 2024-06-06T02:40:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.663+0000 7f93eea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.664+0000 7f93efe00640 1 -- 172.21.15.82:0/1099633202 learned_addr learned my addr 172.21.15.82:0/1099633202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.664+0000 7f93ef400640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.665+0000 7f93eea00640 1 -- 172.21.15.82:0/1099633202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 msgr2=0x562f3dd8f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.665+0000 7f93eea00640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.665+0000 7f93eea00640 1 -- 172.21.15.82:0/1099633202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 msgr2=0x562f3ddad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.665+0000 7f93eea00640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.666+0000 7f93eea00640 1 -- 172.21.15.82:0/1099633202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3dad2620 con 0x562f3d9ee1b0 2024-06-06T02:40:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.666+0000 7f93efe00640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:12.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.666+0000 7f93ef400640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.667+0000 7f93eea00640 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb45a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x562f3dd8efd0 tx=0x7f93dc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6853e2af1540c6d8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.667+0000 7f93dbe00640 1 -- 172.21.15.82:0/1099633202 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc004030 con 0x562f3d9ee1b0 2024-06-06T02:40:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.667+0000 7f93dbe00640 1 -- 172.21.15.82:0/1099633202 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93dc0035f0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.667+0000 7f93dbe00640 1 -- 172.21.15.82:0/1099633202 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc01a590 con 0x562f3d9ee1b0 2024-06-06T02:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.669+0000 7f93fd59f740 1 -- 172.21.15.82:0/1099633202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 msgr2=0x562f3ddb45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.669+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb45a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x562f3dd8efd0 tx=0x7f93dc005f90 comp rx=0 tx=0).stop 2024-06-06T02:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.669+0000 7f93fd59f740 1 -- 172.21.15.82:0/1099633202 shutdown_connections 2024-06-06T02:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.669+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9821c0 0x562f3dd8f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.670+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb45a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.670+0000 7f93fd59f740 1 --2- 172.21.15.82:0/1099633202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.670+0000 7f93fd59f740 1 -- 172.21.15.82:0/1099633202 >> 172.21.15.82:0/1099633202 conn(0x562f3d9e2300 msgr2=0x562f3ddad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.670+0000 7f93fd59f740 1 -- 172.21.15.82:0/1099633202 shutdown_connections 2024-06-06T02:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.670+0000 7f93fd59f740 1 -- 172.21.15.82:0/1099633202 wait complete. 2024-06-06T02:40:12.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.671+0000 7f93fd59f740 1 -- start start 2024-06-06T02:40:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.672+0000 7f93fd59f740 1 Processor -- start 2024-06-06T02:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.673+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9821c0 0x562f3ddb40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.673+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddb0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.673+0000 7f93fd59f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.673+0000 7f93fd59f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93d000cad0 con 0x562f3d9cd4d0 2024-06-06T02:40:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93fd59f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f93d000df40 con 0x562f3d9821c0 2024-06-06T02:40:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93fd59f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f93d000d1a0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93efe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55864/0 (socket says 172.21.15.82:55864) 2024-06-06T02:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93efe00640 1 -- 172.21.15.82:0/676653955 learned_addr learned my addr 172.21.15.82:0/676653955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.674+0000 7f93ef400640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9821c0 0x562f3ddb40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93fd59f740 10 client.0 _ll_register_callbacks cb 0x7f93e8004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93efe00640 1 -- 172.21.15.82:0/676653955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9821c0 msgr2=0x562f3ddb40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93efe00640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9821c0 0x562f3ddb40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93efe00640 1 -- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 msgr2=0x562f3ddb0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93eea00640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddb0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.675+0000 7f93efe00640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddb0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.676+0000 7f93efe00640 1 -- 172.21.15.82:0/676653955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3ddb4780 con 0x562f3d9ee1b0 2024-06-06T02:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.676+0000 7f93eea00640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddb0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.676+0000 7f93efe00640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93e001f9f0 tx=0x7f93e0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1bcb930f3556543 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.676+0000 7f93d9600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.677+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0011940 con 0x562f3d9ee1b0 2024-06-06T02:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.678+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f93e0011ae0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.678+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93dc0035f0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.681+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f93e0011d20 con 0x562f3d9ee1b0 2024-06-06T02:40:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.681+0000 7f93fd59f740 10 client.25648 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.681+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f3de21ff0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.683+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93dc0035f0 con 0x562f3d9ee1b0 2024-06-06T02:40:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.683+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f93e001d400 con 0x562f3d9ee1b0 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 10 client.25648 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 10 client.25648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 20 client.25648 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3de22a30 0x562f3de24e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 4 client.25648 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:40:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.685+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f3dd02e70 con 0x562f3de22a30 2024-06-06T02:40:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.687+0000 7f93ef400640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3de22a30 0x562f3de24e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:12.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.692+0000 7f93d9600640 10 client.25648 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.692+0000 7f93ef400640 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3de22a30 0x562f3de24e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1b43b23188ba51 server_cookie=745f35d3dc12cae5 in_seq=0 out_seq=0 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.709+0000 7f93d9600640 1 -- 172.21.15.82:0/676653955 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f3dd02e70 con 0x562f3de22a30 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.709+0000 7f93d9600640 10 client.25648 handle_command_reply: tid=0 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 client.25648 shutdown 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 msgr2=0x562f3ddb11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f93e001f9f0 tx=0x7f93e0017000 comp rx=0 tx=0).stop 2024-06-06T02:40:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 shutdown_connections 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f3d9ee1b0 0x562f3ddb11a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3de22a30 0x562f3de24e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3d9cd4d0 0x562f3ddb0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 --2- 172.21.15.82:0/676653955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3d9821c0 0x562f3ddb40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 >> 172.21.15.82:0/676653955 conn(0x562f3d9e2300 msgr2=0x562f3dd8f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.710+0000 7f93d9600640 0 client.25648 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.711+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 shutdown_connections 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.711+0000 7f93fd59f740 1 -- 172.21.15.82:0/676653955 wait complete. 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.711+0000 7f93fd59f740 20 client.25648 trim_cache size 0 max 16384 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:40:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 msgr2=0x7f93d40b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 0x7f93d40b4f00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f93e0012450 tx=0x7f93e0005f90 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 msgr2=0x7f93f019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93e802aeb0 tx=0x7f93e8005df0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 shutdown_connections 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f01a4c80 0x7f93f01a70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93f010aa60 0x7f93f019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93d40b29f0 0x7f93d40b4f00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 --2- 172.21.15.82:0/3393233925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93f010a110 0x7f93f019f7c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 >> 172.21.15.82:0/3393233925 conn(0x7f93f0078220 msgr2=0x7f93f010d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 shutdown_connections 2024-06-06T02:40:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:12.712+0000 7f93f5000640 1 -- 172.21.15.82:0/3393233925 wait complete. 2024-06-06T02:40:14.342 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T02:40:14.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T02:40:14.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:14 smithi082 ceph-mon[31579]: pgmap v519: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 244 MiB/s wr, 97 op/s 2024-06-06T02:40:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:14 smithi103 ceph-mon[36349]: pgmap v519: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 244 MiB/s wr, 97 op/s 2024-06-06T02:40:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:14 smithi184 ceph-mon[36922]: pgmap v519: 97 pgs: 97 active+clean; 7.4 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 244 MiB/s wr, 97 op/s 2024-06-06T02:40:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:16.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:16 smithi082 ceph-mon[31579]: pgmap v520: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 260 MiB/s wr, 94 op/s 2024-06-06T02:40:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:16 smithi103 ceph-mon[36349]: pgmap v520: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 260 MiB/s wr, 94 op/s 2024-06-06T02:40:16.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:16 smithi184 ceph-mon[36922]: pgmap v520: 97 pgs: 97 active+clean; 8.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 260 MiB/s wr, 94 op/s 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.633+0000 7f35f8e00640 1 -- 172.21.15.82:0/3818664153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f410a1a0 msgr2=0x7f35f4111b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.633+0000 7f35f8e00640 1 --2- 172.21.15.82:0/3818664153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f410a1a0 0x7f35f4111b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009cd0 tx=0x7f35ec02a910 comp rx=0 tx=0).stop 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.633+0000 7f35f8e00640 1 -- 172.21.15.82:0/3818664153 shutdown_connections 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.633+0000 7f35f8e00640 1 --2- 172.21.15.82:0/3818664153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f410a1a0 0x7f35f4111b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.634+0000 7f35f8e00640 1 --2- 172.21.15.82:0/3818664153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f4109850 0x7f35f4109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.634+0000 7f35f8e00640 1 --2- 172.21.15.82:0/3818664153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4104f20 0x7f35f4105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.634+0000 7f35f8e00640 1 -- 172.21.15.82:0/3818664153 >> 172.21.15.82:0/3818664153 conn(0x7f35f4100a00 msgr2=0x7f35f4102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.634+0000 7f35f8e00640 1 -- 172.21.15.82:0/3818664153 shutdown_connections 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.634+0000 7f35f8e00640 1 -- 172.21.15.82:0/3818664153 wait complete. 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.636+0000 7f35f8e00640 1 Processor -- start 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.636+0000 7f35f8e00640 1 -- start start 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.637+0000 7f35f8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 0x7f35f410efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35f8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35f8e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f410a1a0 0x7f35f410fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55880/0 (socket says 172.21.15.82:55880) 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35eaa00640 1 -- 172.21.15.82:0/531787887 learned_addr learned my addr 172.21.15.82:0/531787887 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.638+0000 7f35f3400640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 0x7f35f410efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4114eb0 con 0x7f35f410a1a0 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4114d30 con 0x7f35f4104f20 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35f4115030 con 0x7f35f4109850 2024-06-06T02:40:17.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35eaa00640 1 -- 172.21.15.82:0/531787887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 msgr2=0x7f35f410efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35eaa00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 0x7f35f410efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35eaa00640 1 -- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f410a1a0 msgr2=0x7f35f410fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.639+0000 7f35f3400640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 0x7f35f410efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.640+0000 7f35eaa00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f410a1a0 0x7f35f410fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.640+0000 7f35eaa00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f41a1580 con 0x7f35f4109850 2024-06-06T02:40:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.640+0000 7f35eaa00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c8c0 tx=0x7f35dc00cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.641+0000 7f35f0c00640 1 -- 172.21.15.82:0/531787887 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc007b30 con 0x7f35f4109850 2024-06-06T02:40:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.641+0000 7f35f0c00640 1 -- 172.21.15.82:0/531787887 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35dc007cd0 con 0x7f35f4109850 2024-06-06T02:40:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.641+0000 7f35f0c00640 1 -- 172.21.15.82:0/531787887 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0186e0 con 0x7f35f4109850 2024-06-06T02:40:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.641+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f41a1870 con 0x7f35f4109850 2024-06-06T02:40:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.641+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f41a1d60 con 0x7f35f4109850 2024-06-06T02:40:17.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.647+0000 7f3600b09740 1 Processor -- start 2024-06-06T02:40:17.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.648+0000 7f3600b09740 1 -- start start 2024-06-06T02:40:17.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.648+0000 7f3600b09740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.648+0000 7f3600b09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfa55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40226/0 (socket says 172.21.15.82:40226) 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f3600b09740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfa5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f35f3e00640 1 -- 172.21.15.82:0/3794877749 learned_addr learned my addr 172.21.15.82:0/3794877749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac1df19c60 con 0x55ac1dbde670 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac1df09200 con 0x55ac1dbff350 2024-06-06T02:40:17.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac1df0d240 con 0x55ac1dbd6490 2024-06-06T02:40:17.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 -- 172.21.15.82:0/3794877749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 msgr2=0x55ac1dfa55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:17.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.649+0000 7f35f3400640 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfa55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfa55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 -- 172.21.15.82:0/3794877749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 msgr2=0x55ac1dfa5af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfa5af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 -- 172.21.15.82:0/3794877749 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1dc6a930 con 0x55ac1dbff350 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3400640 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfa55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f0c00640 1 -- 172.21.15.82:0/531787887 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f35dc018880 con 0x7f35f4109850 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.650+0000 7f35f3e00640 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02af00 tx=0x7f35ec0098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=318f14920ae35e56 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.651+0000 7f35e8c00640 1 -- 172.21.15.82:0/3794877749 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec031660 con 0x55ac1dbff350 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.651+0000 7f35e8c00640 1 -- 172.21.15.82:0/3794877749 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec036040 con 0x55ac1dbff350 2024-06-06T02:40:17.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.651+0000 7f35e8c00640 1 -- 172.21.15.82:0/3794877749 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec004280 con 0x55ac1dbff350 2024-06-06T02:40:17.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 msgr2=0x55ac1dfa5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35ec02af00 tx=0x7f35ec0098b0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 shutdown_connections 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f35f0c00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 0x7f35d80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfa5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfa55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 --2- 172.21.15.82:0/3794877749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa5070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.652+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 >> 172.21.15.82:0/3794877749 conn(0x55ac1dbf3740 msgr2=0x55ac1dfa18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.653+0000 7f35f0c00640 1 -- 172.21.15.82:0/531787887 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f35dc0e2350 con 0x7f35f4109850 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.653+0000 7f35f3e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 0x7f35d80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.653+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 shutdown_connections 2024-06-06T02:40:17.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.653+0000 7f3600b09740 1 -- 172.21.15.82:0/3794877749 wait complete. 2024-06-06T02:40:17.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.654+0000 7f35f3e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 0x7f35d80b4d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009620 tx=0x7f35ec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.654+0000 7f3600b09740 1 -- start start 2024-06-06T02:40:17.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.655+0000 7f3600b09740 1 Processor -- start 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.655+0000 7f3600b09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfb1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.655+0000 7f3600b09740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f3600b09740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfaf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f3600b09740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ac1dd6d890 con 0x55ac1dbde670 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f3600b09740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac1dea62c0 con 0x55ac1dbff350 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f3600b09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ac1dfb2180 con 0x55ac1dbd6490 2024-06-06T02:40:17.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f3600b09740 10 client.0 _ll_register_callbacks cb 0x55ac1deab430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:17.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f35eaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfaf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f35f3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfb1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f35eaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43960/0 (socket says 172.21.15.82:43960) 2024-06-06T02:40:17.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.656+0000 7f35eaa00640 1 -- 172.21.15.82:0/4202821925 learned_addr learned my addr 172.21.15.82:0/4202821925 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 -- 172.21.15.82:0/4202821925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 msgr2=0x55ac1dfaf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfaf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 -- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 msgr2=0x55ac1dfb1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 -- 172.21.15.82:0/4202821925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1dfafd10 con 0x55ac1dbd6490 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35eaa00640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3e00640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfaf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35f3400640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfb1250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ac1dfa2b80 tx=0x7f35e400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae688ba9e9b423e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.657+0000 7f35e1600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4012860 con 0x55ac1dbd6490 2024-06-06T02:40:17.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f35e4012a00 con 0x55ac1dbd6490 2024-06-06T02:40:17.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35ec036040 con 0x55ac1dbd6490 2024-06-06T02:40:17.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35e4012c00 con 0x55ac1dbd6490 2024-06-06T02:40:17.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f3600b09740 10 client.25657 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac1dfbe4a0 con 0x55ac1dbd6490 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.658+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec036040 con 0x55ac1dbd6490 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f35e400f040 con 0x55ac1dbd6490 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 10 client.25657 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 10 client.25657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 20 client.25657 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1dbbdcd0 0x55ac1dfc1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 4 client.25657 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:17.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac1df1bbb0 con 0x55ac1dbbdcd0 2024-06-06T02:40:17.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.659+0000 7f35eaa00640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1dbbdcd0 0x55ac1dfc1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.660+0000 7f35eaa00640 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1dbbdcd0 0x55ac1dfc1a00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41e0afdd0519b4f server_cookie=6124a67555c7a8b5 in_seq=0 out_seq=0 2024-06-06T02:40:17.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.660+0000 7f35e1600640 10 client.25657 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:17.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.661+0000 7f35e1600640 1 -- 172.21.15.82:0/4202821925 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ac1df1bbb0 con 0x55ac1dbbdcd0 2024-06-06T02:40:17.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f35e1600640 10 client.25657 handle_command_reply: tid=0 2024-06-06T02:40:17.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 client.25657 shutdown 2024-06-06T02:40:17.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 msgr2=0x55ac1dfb1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfb1250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55ac1dfa2b80 tx=0x7f35e400b8e0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 shutdown_connections 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfaf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1dbbdcd0 0x55ac1dfc1a00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfb1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 --2- 172.21.15.82:0/4202821925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1dbd6490 0x55ac1dfb1250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.662+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 >> 172.21.15.82:0/4202821925 conn(0x55ac1dbf3740 msgr2=0x55ac1dfa4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.663+0000 7f35e1600640 0 client.25657 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:17.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.663+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 shutdown_connections 2024-06-06T02:40:17.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.663+0000 7f3600b09740 1 -- 172.21.15.82:0/4202821925 wait complete. 2024-06-06T02:40:17.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.664+0000 7f3600b09740 20 client.25657 trim_cache size 0 max 16384 2024-06-06T02:40:17.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.702+0000 7f3600b09740 1 Processor -- start 2024-06-06T02:40:17.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 -- start start 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfaf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bfdd0 con 0x55ac1dbde670 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bd6a0 con 0x55ac1dbff350 2024-06-06T02:40:17.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.703+0000 7f3600b09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bb4d0 con 0x55ac1db93080 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55888/0 (socket says 172.21.15.82:55888) 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 -- 172.21.15.82:0/1028080998 learned_addr learned my addr 172.21.15.82:0/1028080998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 -- 172.21.15.82:0/1028080998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 msgr2=0x55ac1dfa12a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa12a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 -- 172.21.15.82:0/1028080998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 msgr2=0x55ac1dfaf5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfaf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.704+0000 7f35f3e00640 1 -- 172.21.15.82:0/1028080998 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1dfadb70 con 0x55ac1db93080 2024-06-06T02:40:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.705+0000 7f35f3e00640 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e30 tx=0x7f35ec009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bcf04d1f9503f79 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.705+0000 7f35e3e00640 1 -- 172.21.15.82:0/1028080998 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec061070 con 0x55ac1db93080 2024-06-06T02:40:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.706+0000 7f35e3e00640 1 -- 172.21.15.82:0/1028080998 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec036070 con 0x55ac1db93080 2024-06-06T02:40:17.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.706+0000 7f35e3e00640 1 -- 172.21.15.82:0/1028080998 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec052790 con 0x55ac1db93080 2024-06-06T02:40:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 -- 172.21.15.82:0/1028080998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 msgr2=0x55ac1dfa17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e30 tx=0x7f35ec009470 comp rx=0 tx=0).stop 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 -- 172.21.15.82:0/1028080998 shutdown_connections 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfa17e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1dfa12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 --2- 172.21.15.82:0/1028080998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1dfaf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 -- 172.21.15.82:0/1028080998 >> 172.21.15.82:0/1028080998 conn(0x55ac1dbf3740 msgr2=0x55ac1dfaeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 -- 172.21.15.82:0/1028080998 shutdown_connections 2024-06-06T02:40:17.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.707+0000 7f3600b09740 1 -- 172.21.15.82:0/1028080998 wait complete. 2024-06-06T02:40:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.708+0000 7f3600b09740 1 -- start start 2024-06-06T02:40:17.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.708+0000 7f3600b09740 1 Processor -- start 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1e025180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1e0256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bbb60 con 0x55ac1dbde670 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bcfd0 con 0x55ac1dbff350 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f35f41bc230 con 0x55ac1db93080 2024-06-06T02:40:17.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f3600b09740 10 client.0 _ll_register_callbacks cb 0x7f35e4004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:17.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f35f3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f35f3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55896/0 (socket says 172.21.15.82:55896) 2024-06-06T02:40:17.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f35f3400640 1 -- 172.21.15.82:0/3107718201 learned_addr learned my addr 172.21.15.82:0/3107718201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:17.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f35f3400640 1 -- 172.21.15.82:0/3107718201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 msgr2=0x55ac1e0256c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.709+0000 7f35f3400640 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1e0256c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.710+0000 7f35f3400640 1 -- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 msgr2=0x55ac1e025180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.710+0000 7f35f3400640 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1e025180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.710+0000 7f35f3400640 1 -- 172.21.15.82:0/3107718201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1e025e50 con 0x55ac1db93080 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.710+0000 7f35f3400640 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35e4001eb0 tx=0x7f35e4011880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9437a1ad4fd2e83b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.711+0000 7f35e1600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.711+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4000e60 con 0x55ac1db93080 2024-06-06T02:40:17.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.711+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f35e4012da0 con 0x55ac1db93080 2024-06-06T02:40:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.712+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35ec036070 con 0x55ac1db93080 2024-06-06T02:40:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.712+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f35e4012660 con 0x55ac1db93080 2024-06-06T02:40:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.712+0000 7f3600b09740 10 client.25663 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.713+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ac1e03b1a0 con 0x55ac1db93080 2024-06-06T02:40:17.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.713+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35ec036070 con 0x55ac1db93080 2024-06-06T02:40:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.713+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f35e4005200 con 0x55ac1db93080 2024-06-06T02:40:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.714+0000 7f3600b09740 10 client.25663 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.714+0000 7f3600b09740 10 client.25663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:17.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.714+0000 7f3600b09740 20 client.25663 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:17.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.715+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1e03b950 0x55ac1e03dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:17.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.715+0000 7f3600b09740 4 client.25663 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T02:40:17.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.715+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac1df17650 con 0x55ac1e03b950 2024-06-06T02:40:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.715+0000 7f35eaa00640 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1e03b950 0x55ac1e03dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:17.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.718+0000 7f35eaa00640 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1e03b950 0x55ac1e03dd70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6f0df12a3cac248 server_cookie=d0bcc7b2f0c5b958 in_seq=0 out_seq=0 2024-06-06T02:40:17.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.718+0000 7f35e1600640 10 client.25663 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:17.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.730+0000 7f35e1600640 1 -- 172.21.15.82:0/3107718201 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac1df17650 con 0x55ac1e03b950 2024-06-06T02:40:17.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.730+0000 7f35e1600640 10 client.25663 handle_command_reply: tid=0 2024-06-06T02:40:17.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.731+0000 7f3600b09740 1 client.25663 shutdown 2024-06-06T02:40:17.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.732+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 msgr2=0x55ac1dfb7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.732+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35e4001eb0 tx=0x7f35e4011880 comp rx=0 tx=0).stop 2024-06-06T02:40:17.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.732+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 shutdown_connections 2024-06-06T02:40:17.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac1dbff350 0x55ac1e0256c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ac1e03b950 0x55ac1e03dd70 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ac1dbde670 0x55ac1e025180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f3600b09740 1 --2- 172.21.15.82:0/3107718201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ac1db93080 0x55ac1dfb7bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 >> 172.21.15.82:0/3107718201 conn(0x55ac1dbf3740 msgr2=0x55ac1dfa12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.733+0000 7f35e1600640 0 client.25663 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.736+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 shutdown_connections 2024-06-06T02:40:17.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.737+0000 7f3600b09740 1 -- 172.21.15.82:0/3107718201 wait complete. 2024-06-06T02:40:17.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.738+0000 7f3600b09740 20 client.25663 trim_cache size 0 max 16384 2024-06-06T02:40:17.738 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:40:17.739 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-06-06T02:40:17.739 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "8830f761-9df2-44b7-a7a2-f8831304b5fd", 2024-06-06T02:40:17.739 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-06-06T02:40:17.739 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:40:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.739+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 msgr2=0x7f35d80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 0x7f35d80b4d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009620 tx=0x7f35ec005fd0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 msgr2=0x7f35f410f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:17.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35dc00c8c0 tx=0x7f35dc00cd80 comp rx=0 tx=0).stop 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 shutdown_connections 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35f410a1a0 0x7f35f410fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f35d80b2830 0x7f35d80b4d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35f4109850 0x7f35f410f510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 --2- 172.21.15.82:0/531787887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35f4104f20 0x7f35f410efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 >> 172.21.15.82:0/531787887 conn(0x7f35f4100a00 msgr2=0x7f35f4102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.740+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 shutdown_connections 2024-06-06T02:40:17.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:17.741+0000 7f35f8e00640 1 -- 172.21.15.82:0/531787887 wait complete. 2024-06-06T02:40:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:18 smithi103 ceph-mon[36349]: pgmap v521: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 253 MiB/s wr, 92 op/s 2024-06-06T02:40:18.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:18 smithi082 ceph-mon[31579]: pgmap v521: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 253 MiB/s wr, 92 op/s 2024-06-06T02:40:18.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:18 smithi184 ceph-mon[36922]: pgmap v521: 97 pgs: 97 active+clean; 8.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 253 MiB/s wr, 92 op/s 2024-06-06T02:40:18.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:40:19.530 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:19.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub queued for path: / 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:40:19.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.619 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:19 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub queued for path: / 2024-06-06T02:40:19.631 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.632 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:40:19.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.633 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:19 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub queued for path: / 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:40:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:19.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:19 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:40:20.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:20 smithi082 ceph-mon[31579]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 234 MiB/s wr, 103 op/s 2024-06-06T02:40:20.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:20 smithi103 ceph-mon[36349]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 234 MiB/s wr, 103 op/s 2024-06-06T02:40:20.619 INFO:tasks.workunit.client.0.smithi082.stdout:fs setup took 47 secs 2024-06-06T02:40:20.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:20 smithi184 ceph-mon[36922]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 234 MiB/s wr, 103 op/s 2024-06-06T02:40:22.232 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:22 smithi082 ceph-mon[31579]: pgmap v523: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 251 MiB/s wr, 109 op/s 2024-06-06T02:40:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:22 smithi103 ceph-mon[36349]: pgmap v523: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 251 MiB/s wr, 109 op/s 2024-06-06T02:40:22.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:22 smithi184 ceph-mon[36922]: pgmap v523: 97 pgs: 97 active+clean; 9.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 251 MiB/s wr, 109 op/s 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.656+0000 7fa5f2400640 1 -- 172.21.15.82:0/2596859885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec102ee0 msgr2=0x7fa5ec1032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.656+0000 7fa5f2400640 1 --2- 172.21.15.82:0/2596859885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1032f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009890 tx=0x7fa5dc02a390 comp rx=0 tx=0).stop 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.657+0000 7fa5f2400640 1 -- 172.21.15.82:0/2596859885 shutdown_connections 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.657+0000 7fa5f2400640 1 --2- 172.21.15.82:0/2596859885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec10fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.657+0000 7fa5f2400640 1 --2- 172.21.15.82:0/2596859885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec107810 0x7fa5ec107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.657+0000 7fa5f2400640 1 --2- 172.21.15.82:0/2596859885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1032f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.657+0000 7fa5f2400640 1 -- 172.21.15.82:0/2596859885 >> 172.21.15.82:0/2596859885 conn(0x7fa5ec079cb0 msgr2=0x7fa5ec07a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.659+0000 7fa5f2400640 1 -- 172.21.15.82:0/2596859885 shutdown_connections 2024-06-06T02:40:22.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.659+0000 7fa5f2400640 1 -- 172.21.15.82:0/2596859885 wait complete. 2024-06-06T02:40:22.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.660+0000 7fa5f2400640 1 Processor -- start 2024-06-06T02:40:22.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.660+0000 7fa5f2400640 1 -- start start 2024-06-06T02:40:22.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.661+0000 7fa5f2400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.661+0000 7fa5f2400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 0x7fa5ec1a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.661+0000 7fa5f2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.661+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 0x7fa5ec1a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.661+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 0x7fa5ec1a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47104/0 (socket says 172.21.15.82:47104) 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5f2400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec112f10 con 0x7fa5ec102ee0 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5f2400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec112d90 con 0x7fa5ec108160 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5f2400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec113090 con 0x7fa5ec107810 2024-06-06T02:40:22.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5eaa00640 1 -- 172.21.15.82:0/3413578365 learned_addr learned my addr 172.21.15.82:0/3413578365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5eb400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.662+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 -- 172.21.15.82:0/3413578365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 msgr2=0x7fa5ec1a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 0x7fa5ec1a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 -- 172.21.15.82:0/3413578365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 msgr2=0x7fa5ec19ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec19ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 -- 172.21.15.82:0/3413578365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec19c0b0 con 0x7fa5ec102ee0 2024-06-06T02:40:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:22.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.663+0000 7fa5eb400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1a1820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a980 tx=0x7fa5dc030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.664+0000 7fa5e3e00640 1 -- 172.21.15.82:0/3413578365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc040020 con 0x7fa5ec102ee0 2024-06-06T02:40:22.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.665+0000 7fa5e3e00640 1 -- 172.21.15.82:0/3413578365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5dc038040 con 0x7fa5ec102ee0 2024-06-06T02:40:22.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.665+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5ec19c340 con 0x7fa5ec102ee0 2024-06-06T02:40:22.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.665+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5ec19c820 con 0x7fa5ec102ee0 2024-06-06T02:40:22.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.666+0000 7fa5e3e00640 1 -- 172.21.15.82:0/3413578365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc037070 con 0x7fa5ec102ee0 2024-06-06T02:40:22.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.669+0000 7fa5f8b04740 1 Processor -- start 2024-06-06T02:40:22.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.672+0000 7fa5e3e00640 1 -- 172.21.15.82:0/3413578365 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa5dc043020 con 0x7fa5ec102ee0 2024-06-06T02:40:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 -- start start 2024-06-06T02:40:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331c0070 0x562f33566380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f335668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f33566e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f334dae20 con 0x562f3319f390 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f334ca3c0 con 0x562f331c0070 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.678+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562f334ce400 con 0x562f331971b0 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.679+0000 7fa5eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f335668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.679+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f33566e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.679+0000 7fa5eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f335668c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47106/0 (socket says 172.21.15.82:47106) 2024-06-06T02:40:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.679+0000 7fa5eb400640 1 -- 172.21.15.82:0/1494362482 learned_addr learned my addr 172.21.15.82:0/1494362482 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:22.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.680+0000 7fa5e3e00640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 0x7fa5d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5e3e00640 1 -- 172.21.15.82:0/3413578365 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa5dc1023e0 con 0x7fa5ec102ee0 2024-06-06T02:40:22.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331c0070 0x562f33566380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1494362482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 msgr2=0x562f335668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f335668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1494362482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331c0070 msgr2=0x562f33566380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331c0070 0x562f33566380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.681+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1494362482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3322b650 con 0x562f3319f390 2024-06-06T02:40:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.682+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 0x7fa5d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.683+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f33566e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec076a10 tx=0x7fa5d80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ed66f69a50950f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.683+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 0x7fa5d00b4e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4007fd0 tx=0x7fa5e4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.684+0000 7fa5e0c00640 1 -- 172.21.15.82:0/1494362482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8005020 con 0x562f3319f390 2024-06-06T02:40:22.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.684+0000 7fa5e0c00640 1 -- 172.21.15.82:0/1494362482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d80047a0 con 0x562f3319f390 2024-06-06T02:40:22.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.684+0000 7fa5e0c00640 1 -- 172.21.15.82:0/1494362482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80126b0 con 0x562f3319f390 2024-06-06T02:40:22.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.691+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1494362482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 msgr2=0x562f33566e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.691+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f33566e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec076a10 tx=0x7fa5d80117b0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.692+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1494362482 shutdown_connections 2024-06-06T02:40:22.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.692+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f33566e00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.692+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f335668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.692+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1494362482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331c0070 0x562f33566380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.693+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1494362482 >> 172.21.15.82:0/1494362482 conn(0x562f331b4460 msgr2=0x562f33562bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.693+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1494362482 shutdown_connections 2024-06-06T02:40:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.693+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1494362482 wait complete. 2024-06-06T02:40:22.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.694+0000 7fa5f8b04740 1 -- start start 2024-06-06T02:40:22.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.694+0000 7fa5f8b04740 1 Processor -- start 2024-06-06T02:40:22.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33579810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3357de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f3332e700 con 0x562f331c0070 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562f33467720 con 0x562f3319f390 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x562f335734f0 con 0x562f331971b0 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.695+0000 7fa5f8b04740 10 client.0 _ll_register_callbacks cb 0x562f33473de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33579810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58256/0 (socket says 172.21.15.82:58256) 2024-06-06T02:40:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5eaa00640 1 -- 172.21.15.82:0/379178833 learned_addr learned my addr 172.21.15.82:0/379178833 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33579810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47114/0 (socket says 172.21.15.82:47114) 2024-06-06T02:40:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.696+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3357de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.697+0000 7fa5eaa00640 1 -- 172.21.15.82:0/379178833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 msgr2=0x562f33579810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.697+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33579810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.697+0000 7fa5eaa00640 1 -- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 msgr2=0x562f3357de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.697+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3357de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.698+0000 7fa5eaa00640 1 -- 172.21.15.82:0/379178833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f33492fd0 con 0x562f3319f390 2024-06-06T02:40:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.698+0000 7fa5ebe00640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3357de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:22.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.699+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8005a80 tx=0x7fa5d8004cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302261ab81ebb2bf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.699+0000 7fa5d5600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.699+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8028020 con 0x562f3319f390 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.699+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa5d80051a0 con 0x562f3319f390 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.700+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d80047a0 con 0x562f3319f390 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.700+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa5d801f040 con 0x562f3319f390 2024-06-06T02:40:22.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.700+0000 7fa5f8b04740 10 client.25640 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.700+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f33587de0 con 0x562f3319f390 2024-06-06T02:40:22.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.701+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d80047a0 con 0x562f3319f390 2024-06-06T02:40:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.701+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa5d8035020 con 0x562f3319f390 2024-06-06T02:40:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.701+0000 7fa5f8b04740 10 client.25640 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:22.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.701+0000 7fa5f8b04740 10 client.25640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.703+0000 7fa5f8b04740 20 client.25640 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.703+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3317e9f0 0x562f3358b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.703+0000 7fa5f8b04740 4 client.25640 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:22.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.703+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f334dcd70 con 0x562f3317e9f0 2024-06-06T02:40:22.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.706+0000 7fa5eb400640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3317e9f0 0x562f3358b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.708+0000 7fa5d5600640 10 client.25640 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:22.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.708+0000 7fa5eb400640 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3317e9f0 0x562f3358b140 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d79db9b409b21df server_cookie=68760885187c38d7 in_seq=0 out_seq=0 2024-06-06T02:40:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.713+0000 7fa5d5600640 1 -- 172.21.15.82:0/379178833 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x562f334dcd70 con 0x562f3317e9f0 2024-06-06T02:40:22.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.713+0000 7fa5d5600640 10 client.25640 handle_command_reply: tid=0 2024-06-06T02:40:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.713+0000 7fa5f8b04740 1 client.25640 shutdown 2024-06-06T02:40:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.714+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 msgr2=0x562f33579d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.714+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8005a80 tx=0x7fa5d8004cc0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 shutdown_connections 2024-06-06T02:40:22.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f3317e9f0 0x562f3358b140 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3357de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f33579d50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/379178833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33579810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5d5600640 0 client.25640 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:22.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.717+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 >> 172.21.15.82:0/379178833 conn(0x562f331b4460 msgr2=0x562f33568100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.721+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 shutdown_connections 2024-06-06T02:40:22.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.721+0000 7fa5f8b04740 1 -- 172.21.15.82:0/379178833 wait complete. 2024-06-06T02:40:22.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.721+0000 7fa5f8b04740 20 client.25640 trim_cache size 0 max 16384 2024-06-06T02:40:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.754+0000 7fa5f8b04740 1 Processor -- start 2024-06-06T02:40:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 -- start start 2024-06-06T02:40:22.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 0x562f33578550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f335729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 0x562f33562cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc010d50 con 0x562f3319f390 2024-06-06T02:40:22.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc00e620 con 0x562f331971b0 2024-06-06T02:40:22.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc00c450 con 0x562f331c0070 2024-06-06T02:40:22.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.756+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f335729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5ebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 0x562f33562cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5ebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 0x562f33562cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47116/0 (socket says 172.21.15.82:47116) 2024-06-06T02:40:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5ebe00640 1 -- 172.21.15.82:0/1503296942 learned_addr learned my addr 172.21.15.82:0/1503296942 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eb400640 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 0x562f33578550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1503296942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 msgr2=0x562f33562cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 0x562f33562cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1503296942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 msgr2=0x562f33578550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 0x562f33578550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1503296942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f33567780 con 0x562f3319f390 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eb400640 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 0x562f33578550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:22.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.758+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f335729c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800a010 tx=0x7fa5d80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949e4cff772b6458 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.760+0000 7fa5d7e00640 1 -- 172.21.15.82:0/1503296942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d803a030 con 0x562f3319f390 2024-06-06T02:40:22.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.760+0000 7fa5d7e00640 1 -- 172.21.15.82:0/1503296942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d80245a0 con 0x562f3319f390 2024-06-06T02:40:22.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.760+0000 7fa5d7e00640 1 -- 172.21.15.82:0/1503296942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8028040 con 0x562f3319f390 2024-06-06T02:40:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1503296942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 msgr2=0x562f335729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f335729c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800a010 tx=0x7fa5d80117b0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1503296942 shutdown_connections 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331c0070 0x562f33562cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f3319f390 0x562f335729c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1503296942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f331971b0 0x562f33578550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.761+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1503296942 >> 172.21.15.82:0/1503296942 conn(0x562f331b4460 msgr2=0x562f335625b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.763+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1503296942 shutdown_connections 2024-06-06T02:40:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.763+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1503296942 wait complete. 2024-06-06T02:40:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.763+0000 7fa5f8b04740 1 -- start start 2024-06-06T02:40:22.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.764+0000 7fa5f8b04740 1 Processor -- start 2024-06-06T02:40:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.765+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33590e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.765+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.765+0000 7fa5eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33590e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3358fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc00cae0 con 0x562f331c0070 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc00df50 con 0x562f3319f390 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc00d1b0 con 0x562f331971b0 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 10 client.0 _ll_register_callbacks cb 0x7fa5dc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:22.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5ebe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3358fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58282/0 (socket says 172.21.15.82:58282) 2024-06-06T02:40:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1462621579 learned_addr learned my addr 172.21.15.82:0/1462621579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1462621579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 msgr2=0x562f33590e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33590e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 msgr2=0x562f3358fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3358fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 -- 172.21.15.82:0/1462621579 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f33590210 con 0x562f3319f390 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eb400640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33590e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5eaa00640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80092a0 tx=0x7fa5d8009fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5058ce862b5b9dbf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5d5600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8044060 con 0x562f3319f390 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5d80245a0 con 0x562f3319f390 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.766+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa5d8024d10 con 0x562f3319f390 2024-06-06T02:40:22.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa5d803a040 con 0x562f3319f390 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 10 client.25643 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f335f2390 con 0x562f3319f390 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5d80245a0 con 0x562f3319f390 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa5d8035070 con 0x562f3319f390 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 10 client.25643 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 10 client.25643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 20 client.25643 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f33153da0 0x562f335f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 4 client.25643 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f334d8810 con 0x562f33153da0 2024-06-06T02:40:22.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.768+0000 7fa5eb400640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f33153da0 0x562f335f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.770+0000 7fa5eb400640 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f33153da0 0x562f335f4aa0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da329517f4edd13e server_cookie=439ff8c7688d0a7c in_seq=0 out_seq=0 2024-06-06T02:40:22.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.770+0000 7fa5d5600640 10 client.25643 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.770+0000 7fa5d5600640 1 -- 172.21.15.82:0/1462621579 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562f334d8810 con 0x562f33153da0 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.770+0000 7fa5d5600640 10 client.25643 handle_command_reply: tid=0 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.770+0000 7fa5f8b04740 1 client.25643 shutdown 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 msgr2=0x562f3358f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80092a0 tx=0x7fa5d8009fa0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 shutdown_connections 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x562f33153da0 0x562f335f4aa0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f331c0070 0x562f3358fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562f3319f390 0x562f3358f790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "8830f761-9df2-44b7-a7a2-f8831304b5fd": { 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "8830f761-9df2-44b7-a7a2-f8831304b5fd", 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:40:22.774 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 --2- 172.21.15.82:0/1462621579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562f331971b0 0x562f33590e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 >> 172.21.15.82:0/1462621579 conn(0x562f331b4460 msgr2=0x562f33567e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.772+0000 7fa5d5600640 0 client.25643 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.773+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 shutdown_connections 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.773+0000 7fa5f8b04740 1 -- 172.21.15.82:0/1462621579 wait complete. 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.773+0000 7fa5f8b04740 20 client.25643 trim_cache size 0 max 16384 2024-06-06T02:40:22.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.775+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 msgr2=0x7fa5d00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.775+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 0x7fa5d00b4e50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4007fd0 tx=0x7fa5e4004a60 comp rx=0 tx=0).stop 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.775+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 msgr2=0x7fa5ec1a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.775+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1a1820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc02a980 tx=0x7fa5dc030d70 comp rx=0 tx=0).stop 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 shutdown_connections 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5ec108160 0x7fa5ec19ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa5d00b2940 0x7fa5d00b4e50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5ec107810 0x7fa5ec1a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 --2- 172.21.15.82:0/3413578365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5ec102ee0 0x7fa5ec1a1820 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:22.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 >> 172.21.15.82:0/3413578365 conn(0x7fa5ec079cb0 msgr2=0x7fa5ec10e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:22.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 shutdown_connections 2024-06-06T02:40:22.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:40:22.776+0000 7fa5f2400640 1 -- 172.21.15.82:0/3413578365 wait complete. 2024-06-06T02:40:23.779 INFO:tasks.cephfs.filesystem:scrub status for tag:8830f761-9df2-44b7-a7a2-f8831304b5fd - {'path': '/', 'tag': '8830f761-9df2-44b7-a7a2-f8831304b5fd', 'options': 'recursive,force'} 2024-06-06T02:40:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:24 smithi103 ceph-mon[36349]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 257 MiB/s wr, 124 op/s 2024-06-06T02:40:24.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:24 smithi082 ceph-mon[31579]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 257 MiB/s wr, 124 op/s 2024-06-06T02:40:24.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:24 smithi184 ceph-mon[36922]: pgmap v524: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 257 MiB/s wr, 124 op/s 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.021+0000 7eff57200640 1 -- 172.21.15.82:0/2400212689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 msgr2=0x7eff501036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.021+0000 7eff57200640 1 --2- 172.21.15.82:0/2400212689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff501036e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7eff44009900 tx=0x7eff4402a440 comp rx=0 tx=0).stop 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff56800640 1 --2- 172.21.15.82:0/2400212689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50106580 0x7eff50106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 -- 172.21.15.82:0/2400212689 shutdown_connections 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 --2- 172.21.15.82:0/2400212689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50106580 0x7eff50106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 --2- 172.21.15.82:0/2400212689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50103c20 0x7eff50106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 --2- 172.21.15.82:0/2400212689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff501036e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 -- 172.21.15.82:0/2400212689 >> 172.21.15.82:0/2400212689 conn(0x7eff500fd0c0 msgr2=0x7eff500ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 -- 172.21.15.82:0/2400212689 shutdown_connections 2024-06-06T02:40:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.022+0000 7eff57200640 1 -- 172.21.15.82:0/2400212689 wait complete. 2024-06-06T02:40:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.023+0000 7eff57200640 1 Processor -- start 2024-06-06T02:40:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 -- start start 2024-06-06T02:40:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff5019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 0x7eff5019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff50114c50 con 0x7eff50103c20 2024-06-06T02:40:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff50114ad0 con 0x7eff501012c0 2024-06-06T02:40:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff57200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7eff50114dd0 con 0x7eff50106580 2024-06-06T02:40:26.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.024+0000 7eff56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff55e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff5019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47132/0 (socket says 172.21.15.82:47132) 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 -- 172.21.15.82:0/413372817 learned_addr learned my addr 172.21.15.82:0/413372817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff55400640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 0x7eff5019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 -- 172.21.15.82:0/413372817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 msgr2=0x7eff5019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff5019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 -- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 msgr2=0x7eff5019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 0x7eff5019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 -- 172.21.15.82:0/413372817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff501a7330 con 0x7eff50106580 2024-06-06T02:40:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff55400640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 0x7eff5019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.025+0000 7eff56800640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efd0 tx=0x7eff4c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.026+0000 7eff4aa00640 1 -- 172.21.15.82:0/413372817 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c003b70 con 0x7eff50106580 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.026+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff501a7620 con 0x7eff50106580 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.026+0000 7eff4aa00640 1 -- 172.21.15.82:0/413372817 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff4c003d10 con 0x7eff50106580 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.026+0000 7eff4aa00640 1 -- 172.21.15.82:0/413372817 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0108b0 con 0x7eff50106580 2024-06-06T02:40:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.026+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff501a7c40 con 0x7eff50106580 2024-06-06T02:40:26.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.029+0000 7eff5f7d3740 1 Processor -- start 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.034+0000 7eff4aa00640 1 -- 172.21.15.82:0/413372817 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7eff4c010a50 con 0x7eff50106580 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 -- start start 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x559576750480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x559576757340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595766c2480 con 0x55957638a4d0 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5595766b1a20 con 0x5595763ab1b0 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.035+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5595766b5a60 con 0x5595763822f0 2024-06-06T02:40:26.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58316/0 (socket says 172.21.15.82:58316) 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 -- 172.21.15.82:0/1772811595 learned_addr learned my addr 172.21.15.82:0/1772811595 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 -- 172.21.15.82:0/1772811595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 msgr2=0x559576750480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x559576750480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 -- 172.21.15.82:0/1772811595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 msgr2=0x559576757340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x559576757340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.036+0000 7eff55400640 1 -- 172.21.15.82:0/1772811595 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595766ae8d0 con 0x5595763ab1b0 2024-06-06T02:40:26.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff55400640 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff4000a990 tx=0x7eff4000ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779c08ea6bac5638 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff4aa00640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 0x7eff380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff3f000640 1 -- 172.21.15.82:0/1772811595 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4000fa60 con 0x5595763ab1b0 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff3f000640 1 -- 172.21.15.82:0/1772811595 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff40018070 con 0x5595763ab1b0 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff3f000640 1 -- 172.21.15.82:0/1772811595 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40012360 con 0x5595763ab1b0 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.037+0000 7eff4aa00640 1 -- 172.21.15.82:0/413372817 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7eff4c0e2700 con 0x7eff50106580 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1772811595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 msgr2=0x55957674ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7eff4000a990 tx=0x7eff4000ae50 comp rx=0 tx=0).stop 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1772811595 shutdown_connections 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x559576757340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x559576750480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1772811595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763ab1b0 0x55957674ff40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1772811595 >> 172.21.15.82:0/1772811595 conn(0x55957639f300 msgr2=0x55957674b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1772811595 shutdown_connections 2024-06-06T02:40:26.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.039+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1772811595 wait complete. 2024-06-06T02:40:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.040+0000 7eff5f7d3740 1 -- start start 2024-06-06T02:40:26.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.040+0000 7eff5f7d3740 1 Processor -- start 2024-06-06T02:40:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.042+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x55957676a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.042+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x55957676ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.042+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 0x559576771ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.042+0000 7eff55e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x55957676a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.042+0000 7eff55e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x55957676a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58318/0 (socket says 172.21.15.82:58318) 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff55e00640 1 -- 172.21.15.82:0/1927224475 learned_addr learned my addr 172.21.15.82:0/1927224475 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595765ecab0 con 0x55957638a4d0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55957664f630 con 0x5595763822f0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559576768d20 con 0x5595763ab1b0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff56800640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 0x559576771ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff5f7d3740 10 client.0 _ll_register_callbacks cb 0x559576655610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff55e00640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 0x7eff380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff56800640 1 -- 172.21.15.82:0/1927224475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 msgr2=0x55957676a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff56800640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x55957676a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff56800640 1 -- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 msgr2=0x55957676ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.043+0000 7eff56800640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x55957676ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.044+0000 7eff56800640 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957667c170 con 0x5595763ab1b0 2024-06-06T02:40:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.044+0000 7eff56800640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 0x559576771ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff4c005c40 tx=0x7eff4c0a9510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b8a1ad5a1b3af4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.044+0000 7eff33400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.044+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0a9ce0 con 0x5595763ab1b0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.044+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7eff4c0a62d0 con 0x5595763ab1b0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.045+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff40018070 con 0x5595763ab1b0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.045+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff4c0ae090 con 0x5595763ab1b0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.045+0000 7eff5f7d3740 10 client.25687 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.045+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559576416790 con 0x5595763ab1b0 2024-06-06T02:40:26.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff40018070 con 0x5595763ab1b0 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff4c01f020 con 0x5595763ab1b0 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 10 client.25687 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 10 client.25687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 20 client.25687 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559576369d80 0x559576777e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 4 client.25687 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595766c43d0 con 0x559576369d80 2024-06-06T02:40:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.046+0000 7eff55e00640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559576369d80 0x559576777e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.050+0000 7eff55e00640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 0x7eff380b4dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff44006010 tx=0x7eff44000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.051+0000 7eff55e00640 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559576369d80 0x559576777e80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f924a371c444cfe server_cookie=d8944566fa63336b in_seq=0 out_seq=0 2024-06-06T02:40:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.051+0000 7eff33400640 10 client.25687 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.055+0000 7eff33400640 1 -- 172.21.15.82:0/1927224475 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5595766c43d0 con 0x559576369d80 2024-06-06T02:40:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.055+0000 7eff33400640 10 client.25687 handle_command_reply: tid=0 2024-06-06T02:40:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.055+0000 7eff5f7d3740 1 client.25687 shutdown 2024-06-06T02:40:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.055+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 msgr2=0x559576771ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.055+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 0x559576771ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff4c005c40 tx=0x7eff4c0a9510 comp rx=0 tx=0).stop 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 shutdown_connections 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763ab1b0 0x559576771ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559576369d80 0x559576777e80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55957638a4d0 0x55957676ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1927224475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x55957676a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff33400640 0 client.25687 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 >> 172.21.15.82:0/1927224475 conn(0x55957639f300 msgr2=0x55957674b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.056+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 shutdown_connections 2024-06-06T02:40:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.057+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1927224475 wait complete. 2024-06-06T02:40:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.057+0000 7eff5f7d3740 20 client.25687 trim_cache size 0 max 16384 2024-06-06T02:40:26.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.088+0000 7eff5f7d3740 1 Processor -- start 2024-06-06T02:40:26.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 -- start start 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957674d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x5595767719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff501aa9f0 con 0x559576369d80 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff501a82c0 con 0x5595763822f0 2024-06-06T02:40:26.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.090+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7eff50072b70 con 0x55957638a4d0 2024-06-06T02:40:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.091+0000 7eff55e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957674d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.092+0000 7eff56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.092+0000 7eff56800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47158/0 (socket says 172.21.15.82:47158) 2024-06-06T02:40:26.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.092+0000 7eff56800640 1 -- 172.21.15.82:0/2234347068 learned_addr learned my addr 172.21.15.82:0/2234347068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.092+0000 7eff55400640 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x5595767719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff56800640 1 -- 172.21.15.82:0/2234347068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 msgr2=0x5595767719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff56800640 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x5595767719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff56800640 1 -- 172.21.15.82:0/2234347068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 msgr2=0x55957674d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff56800640 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957674d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff56800640 1 -- 172.21.15.82:0/2234347068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957648f620 con 0x55957638a4d0 2024-06-06T02:40:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.093+0000 7eff55e00640 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957674d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.094+0000 7eff56800640 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0a99e0 tx=0x7eff4c009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b91271f1f27185 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.094+0000 7eff3e600640 1 -- 172.21.15.82:0/2234347068 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0c9080 con 0x55957638a4d0 2024-06-06T02:40:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.094+0000 7eff3e600640 1 -- 172.21.15.82:0/2234347068 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff4c0b2b40 con 0x55957638a4d0 2024-06-06T02:40:26.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.095+0000 7eff3e600640 1 -- 172.21.15.82:0/2234347068 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0a8cd0 con 0x55957638a4d0 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 -- 172.21.15.82:0/2234347068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 msgr2=0x55957674a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0a99e0 tx=0x7eff4c009960 comp rx=0 tx=0).stop 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 -- 172.21.15.82:0/2234347068 shutdown_connections 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55957638a4d0 0x55957674a5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5595763822f0 0x5595767719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/2234347068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957674d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 -- 172.21.15.82:0/2234347068 >> 172.21.15.82:0/2234347068 conn(0x55957639f300 msgr2=0x559576749e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.098+0000 7eff5f7d3740 1 -- 172.21.15.82:0/2234347068 shutdown_connections 2024-06-06T02:40:26.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.099+0000 7eff5f7d3740 1 -- 172.21.15.82:0/2234347068 wait complete. 2024-06-06T02:40:26.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.100+0000 7eff5f7d3740 1 -- start start 2024-06-06T02:40:26.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.100+0000 7eff5f7d3740 1 Processor -- start 2024-06-06T02:40:26.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.101+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957676e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x55957676ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 0x5595767de600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff50073200 con 0x559576369d80 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff50074670 con 0x55957638a4d0 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff56800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 0x5595767de600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff55400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x55957676ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff56800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 0x5595767de600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58344/0 (socket says 172.21.15.82:58344) 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff56800640 1 -- 172.21.15.82:0/1359772277 learned_addr learned my addr 172.21.15.82:0/1359772277 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7eff500738d0 con 0x5595763822f0 2024-06-06T02:40:26.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.102+0000 7eff5f7d3740 10 client.0 _ll_register_callbacks cb 0x7eff4c0a9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.103+0000 7eff55400640 1 -- 172.21.15.82:0/1359772277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 msgr2=0x5595767de600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.103+0000 7eff55400640 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 0x5595767de600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.103+0000 7eff55400640 1 -- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 msgr2=0x55957676e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.103+0000 7eff55400640 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957676e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.103+0000 7eff55400640 1 -- 172.21.15.82:0/1359772277 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559576771bc0 con 0x5595763822f0 2024-06-06T02:40:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.104+0000 7eff55400640 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x55957676ebd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55957674d840 tx=0x7eff4000a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bb0ed670aa1b96c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.104+0000 7eff33400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.104+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff40022070 con 0x5595763822f0 2024-06-06T02:40:26.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.104+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7eff400139d0 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.105+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff4c0b2b40 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.105+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff40026400 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.105+0000 7eff5f7d3740 10 client.25693 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.105+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5595767df9f0 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.105+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff4c0b2b40 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.106+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff400305a0 con 0x5595763822f0 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.106+0000 7eff5f7d3740 10 client.25693 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.106+0000 7eff5f7d3740 10 client.25693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.106+0000 7eff5f7d3740 20 client.25693 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.106+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5595763ab1b0 0x5595767e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.107+0000 7eff5f7d3740 4 client.25693 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:40:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.107+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595766bfe70 con 0x5595763ab1b0 2024-06-06T02:40:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.107+0000 7eff55e00640 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5595763ab1b0 0x5595767e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.110+0000 7eff55e00640 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5595763ab1b0 0x5595767e20a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c2504da3430ac30 server_cookie=b82d650a77d65ea5 in_seq=0 out_seq=0 2024-06-06T02:40:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.110+0000 7eff33400640 10 client.25693 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.141+0000 7eff33400640 1 -- 172.21.15.82:0/1359772277 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595766bfe70 con 0x5595763ab1b0 2024-06-06T02:40:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.141+0000 7eff33400640 10 client.25693 handle_command_reply: tid=0 2024-06-06T02:40:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.141+0000 7eff5f7d3740 1 client.25693 shutdown 2024-06-06T02:40:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 msgr2=0x55957676ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x55957676ebd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55957674d840 tx=0x7eff4000a3f0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 shutdown_connections 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55957638a4d0 0x5595767de600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5595763822f0 0x55957676ebd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5595763ab1b0 0x5595767e20a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 --2- 172.21.15.82:0/1359772277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559576369d80 0x55957676e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff33400640 0 client.25693 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.142+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 >> 172.21.15.82:0/1359772277 conn(0x55957639f300 msgr2=0x55957674a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.143+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 shutdown_connections 2024-06-06T02:40:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.143+0000 7eff5f7d3740 1 -- 172.21.15.82:0/1359772277 wait complete. 2024-06-06T02:40:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.143+0000 7eff5f7d3740 20 client.25693 trim_cache size 0 max 16384 2024-06-06T02:40:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:40:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:40:26.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:40:26.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:40:26.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 msgr2=0x7eff380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 0x7eff380b4dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff44006010 tx=0x7eff44000bc0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 msgr2=0x7eff501a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00efd0 tx=0x7eff4c00c6a0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 shutdown_connections 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7eff380b28b0 0x7eff380b4dc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff50106580 0x7eff501a6cc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff50103c20 0x7eff5019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 --2- 172.21.15.82:0/413372817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff501012c0 0x7eff5019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.144+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 >> 172.21.15.82:0/413372817 conn(0x7eff500fd0c0 msgr2=0x7eff50102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.145+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 shutdown_connections 2024-06-06T02:40:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:26.145+0000 7eff57200640 1 -- 172.21.15.82:0/413372817 wait complete. 2024-06-06T02:40:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:26 smithi103 ceph-mon[36349]: pgmap v525: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 MiB/s wr, 121 op/s 2024-06-06T02:40:26.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:26 smithi082 ceph-mon[31579]: pgmap v525: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 MiB/s wr, 121 op/s 2024-06-06T02:40:26.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:26 smithi184 ceph-mon[36922]: pgmap v525: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 279 MiB/s wr, 121 op/s 2024-06-06T02:40:28.137 INFO:tasks.workunit.client.0.smithi082.stdout:Syncing()...7 sec 2024-06-06T02:40:28.138 INFO:tasks.workunit.client.0.smithi082.stdout:Starting Actual Benchmark At: Thu Jun 6 02:40:28 2024 2024-06-06T02:40:28.138 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:40:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:28 smithi103 ceph-mon[36349]: pgmap v526: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 292 MiB/s wr, 121 op/s 2024-06-06T02:40:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:28 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:40:28.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:28 smithi082 ceph-mon[31579]: pgmap v526: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 292 MiB/s wr, 121 op/s 2024-06-06T02:40:28.629 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:28 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:40:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:28 smithi184 ceph-mon[36922]: pgmap v526: 97 pgs: 97 active+clean; 11 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 292 MiB/s wr, 121 op/s 2024-06-06T02:40:28.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:28 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:40:29.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:29 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:40:29.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:29 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:40:29.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:29 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:40:29.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:29 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:40:29.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:29 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:40:29.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:29 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:40:29.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:29 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:40:29.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:29 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:40:29.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:29 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:40:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:30 smithi103 ceph-mon[36349]: pgmap v527: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 278 MiB/s wr, 118 op/s 2024-06-06T02:40:30.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:30 smithi082 ceph-mon[31579]: pgmap v527: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 278 MiB/s wr, 118 op/s 2024-06-06T02:40:30.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:30 smithi184 ceph-mon[36922]: pgmap v527: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 278 MiB/s wr, 118 op/s 2024-06-06T02:40:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:32 smithi103 ceph-mon[36349]: pgmap v528: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 275 MiB/s wr, 178 op/s 2024-06-06T02:40:32.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:32 smithi082 ceph-mon[31579]: pgmap v528: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 275 MiB/s wr, 178 op/s 2024-06-06T02:40:32.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:32 smithi184 ceph-mon[36922]: pgmap v528: 97 pgs: 97 active+clean; 12 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 275 MiB/s wr, 178 op/s 2024-06-06T02:40:33.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:40:33.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:40:33.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:40:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:40:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:40:33.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:40:33.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:40:33.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:40:33.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:40:34.519 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:34 smithi103 ceph-mon[36349]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 266 MiB/s wr, 1.68k op/s 2024-06-06T02:40:34.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:34 smithi082 ceph-mon[31579]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 266 MiB/s wr, 1.68k op/s 2024-06-06T02:40:34.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:34 smithi184 ceph-mon[36922]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 266 MiB/s wr, 1.68k op/s 2024-06-06T02:40:36.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:36 smithi103 ceph-mon[36349]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 244 MiB/s wr, 5.17k op/s 2024-06-06T02:40:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:36 smithi082 ceph-mon[31579]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 244 MiB/s wr, 5.17k op/s 2024-06-06T02:40:36.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:36 smithi184 ceph-mon[36922]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 244 MiB/s wr, 5.17k op/s 2024-06-06T02:40:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:38 smithi103 ceph-mon[36349]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 201 MiB/s wr, 7.12k op/s 2024-06-06T02:40:38.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:38 smithi082 ceph-mon[31579]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 201 MiB/s wr, 7.12k op/s 2024-06-06T02:40:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:38 smithi184 ceph-mon[36922]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 201 MiB/s wr, 7.12k op/s 2024-06-06T02:40:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 -- 172.21.15.82:0/1116281764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c103cd0 msgr2=0x7fa16c1040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 --2- 172.21.15.82:0/1116281764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c103cd0 0x7fa16c1040e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009900 tx=0x7fa15c02a410 comp rx=0 tx=0).stop 2024-06-06T02:40:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 -- 172.21.15.82:0/1116281764 shutdown_connections 2024-06-06T02:40:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 --2- 172.21.15.82:0/1116281764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c104620 0x7fa16c10af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 --2- 172.21.15.82:0/1116281764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c103cd0 0x7fa16c1040e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 --2- 172.21.15.82:0/1116281764 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa16c102bb0 0x7fa16c102fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.509+0000 7fa170e00640 1 -- 172.21.15.82:0/1116281764 >> 172.21.15.82:0/1116281764 conn(0x7fa16c0fe3d0 msgr2=0x7fa16c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.510+0000 7fa170e00640 1 -- 172.21.15.82:0/1116281764 shutdown_connections 2024-06-06T02:40:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.510+0000 7fa170e00640 1 -- 172.21.15.82:0/1116281764 wait complete. 2024-06-06T02:40:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.512+0000 7fa170e00640 1 Processor -- start 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.513+0000 7fa170e00640 1 -- start start 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c104620 0x7fa16c108ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa16c105270 0x7fa16c105750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c10e6d0 con 0x7fa16c104620 2024-06-06T02:40:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c10e550 con 0x7fa16c102bb0 2024-06-06T02:40:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa170e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c10e850 con 0x7fa16c105270 2024-06-06T02:40:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa169e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa169e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:46854/0 (socket says 172.21.15.82:46854) 2024-06-06T02:40:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.514+0000 7fa169e00640 1 -- 172.21.15.82:0/1365802824 learned_addr learned my addr 172.21.15.82:0/1365802824 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169400640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c104620 0x7fa16c108ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 -- 172.21.15.82:0/1365802824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa16c105270 msgr2=0x7fa16c105750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa16c105270 0x7fa16c105750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 -- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c104620 msgr2=0x7fa16c108ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c104620 0x7fa16c108ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 -- 172.21.15.82:0/1365802824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c19b220 con 0x7fa16c102bb0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.515+0000 7fa169e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa16400ea80 tx=0x7fa16400ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.516+0000 7fa162a00640 1 -- 172.21.15.82:0/1365802824 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16400ce40 con 0x7fa16c102bb0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.516+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c19b510 con 0x7fa16c102bb0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.516+0000 7fa162a00640 1 -- 172.21.15.82:0/1365802824 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa164011920 con 0x7fa16c102bb0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.516+0000 7fa162a00640 1 -- 172.21.15.82:0/1365802824 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16401aa20 con 0x7fa16c102bb0 2024-06-06T02:40:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.516+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c19ba60 con 0x7fa16c102bb0 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.521+0000 7fa177f91740 1 Processor -- start 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 -- start start 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 0x55d83e5fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2354d0 0x55d83e602100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d83e56d480 con 0x55d83e22d2f0 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d83e55ca20 con 0x55d83e2561b0 2024-06-06T02:40:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.522+0000 7fa177f91740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d83e560a60 con 0x55d83e2354d0 2024-06-06T02:40:39.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:46858/0 (socket says 172.21.15.82:46858) 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 -- 172.21.15.82:0/3352993251 learned_addr learned my addr 172.21.15.82:0/3352993251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa162a00640 1 -- 172.21.15.82:0/1365802824 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa16401abc0 con 0x7fa16c102bb0 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 -- 172.21.15.82:0/3352993251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2354d0 msgr2=0x55d83e602100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2354d0 0x55d83e602100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.526+0000 7fa16a800640 1 -- 172.21.15.82:0/3352993251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 msgr2=0x55d83e5fb240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:40:39.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.528+0000 7fa169e00640 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 0x55d83e5fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.528+0000 7fa16a800640 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 0x55d83e5fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.529+0000 7fa162a00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 0x7fa1500b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.529+0000 7fa16a800640 1 -- 172.21.15.82:0/3352993251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d83e5598d0 con 0x55d83e2561b0 2024-06-06T02:40:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.529+0000 7fa169e00640 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 0x55d83e5fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:40:39.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.529+0000 7fa162a00640 1 -- 172.21.15.82:0/1365802824 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa1640e28a0 con 0x7fa16c102bb0 2024-06-06T02:40:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.530+0000 7fa16a800640 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a8e0 tx=0x7fa15800ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22bf5bf97761e990 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.531+0000 7fa169400640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 0x7fa1500b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.531+0000 7fa157400640 1 -- 172.21.15.82:0/3352993251 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15800ccc0 con 0x55d83e2561b0 2024-06-06T02:40:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.531+0000 7fa157400640 1 -- 172.21.15.82:0/3352993251 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15800f900 con 0x55d83e2561b0 2024-06-06T02:40:39.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.531+0000 7fa157400640 1 -- 172.21.15.82:0/3352993251 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa158018980 con 0x55d83e2561b0 2024-06-06T02:40:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.533+0000 7fa169400640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 0x7fa1500b4cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c031420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.533+0000 7fa177f91740 1 -- 172.21.15.82:0/3352993251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 msgr2=0x55d83e5fad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.533+0000 7fa177f91740 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa15800a8e0 tx=0x7fa15800ada0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.534 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.534+0000 7fa177f91740 1 -- 172.21.15.82:0/3352993251 shutdown_connections 2024-06-06T02:40:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.534+0000 7fa177f91740 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2354d0 0x55d83e602100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.534+0000 7fa177f91740 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e22d2f0 0x55d83e5fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.534+0000 7fa177f91740 1 --2- 172.21.15.82:0/3352993251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e5fad00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.534+0000 7fa177f91740 1 -- 172.21.15.82:0/3352993251 >> 172.21.15.82:0/3352993251 conn(0x55d83e24a300 msgr2=0x55d83e5f66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.536+0000 7fa177f91740 1 -- 172.21.15.82:0/3352993251 shutdown_connections 2024-06-06T02:40:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.536+0000 7fa177f91740 1 -- 172.21.15.82:0/3352993251 wait complete. 2024-06-06T02:40:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.536+0000 7fa177f91740 1 -- start start 2024-06-06T02:40:39.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 Processor -- start 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e22d2f0 0x55d83e6044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d83e497ab0 con 0x55d83e2354d0 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d83e4fa630 con 0x55d83e22d2f0 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.537+0000 7fa177f91740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d83e602ad0 con 0x55d83e2561b0 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.539+0000 7fa177f91740 10 client.0 _ll_register_callbacks cb 0x55d83e500610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.538+0000 7fa16a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44872/0 (socket says 172.21.15.82:44872) 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 -- 172.21.15.82:0/3018389389 learned_addr learned my addr 172.21.15.82:0/3018389389 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 -- 172.21.15.82:0/3018389389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e22d2f0 msgr2=0x55d83e6044a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e22d2f0 0x55d83e6044a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 -- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 msgr2=0x55d83e6049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:39.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.540+0000 7fa16a800640 1 -- 172.21.15.82:0/3018389389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83e527170 con 0x55d83e2561b0 2024-06-06T02:40:39.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.541+0000 7fa16a800640 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa158018440 tx=0x7fa15800f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4de52808cb7d2a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.541+0000 7fa14be00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.541+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa158005040 con 0x55d83e2561b0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.541+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa1580051e0 con 0x55d83e2561b0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.542+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa15800f900 con 0x55d83e2561b0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.542+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa1580053e0 con 0x55d83e2561b0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 10 client.25699 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d83e2c1790 con 0x55d83e2561b0 2024-06-06T02:40:39.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15800f900 con 0x55d83e2561b0 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa1580187e0 con 0x55d83e2561b0 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 10 client.25699 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 10 client.25699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 20 client.25699 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.543+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e214d80 0x55d83e633930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.544+0000 7fa177f91740 4 client.25699 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.544+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d83e56f3d0 con 0x55d83e214d80 2024-06-06T02:40:39.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.545+0000 7fa169e00640 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e214d80 0x55d83e633930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.547+0000 7fa14be00640 10 client.25699 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:39.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.547+0000 7fa169e00640 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e214d80 0x55d83e633930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f63dcdb2d0672a server_cookie=96e83cad7630b8fd in_seq=0 out_seq=0 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.550+0000 7fa14be00640 1 -- 172.21.15.82:0/3018389389 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d83e56f3d0 con 0x55d83e214d80 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.550+0000 7fa14be00640 10 client.25699 handle_command_reply: tid=0 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.550+0000 7fa177f91740 1 client.25699 shutdown 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 msgr2=0x55d83e60b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa158018440 tx=0x7fa15800f840 comp rx=0 tx=0).stop 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 shutdown_connections 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e2561b0 0x55d83e60b8d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e214d80 0x55d83e633930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 --2- 172.21.15.82:0/3018389389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e22d2f0 0x55d83e6044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 >> 172.21.15.82:0/3018389389 conn(0x55d83e24a300 msgr2=0x55d83e5f75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.551+0000 7fa14be00640 0 client.25699 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.552+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 shutdown_connections 2024-06-06T02:40:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.553+0000 7fa177f91740 1 -- 172.21.15.82:0/3018389389 wait complete. 2024-06-06T02:40:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.554+0000 7fa177f91740 20 client.25699 trim_cache size 0 max 16384 2024-06-06T02:40:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 Processor -- start 2024-06-06T02:40:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 -- start start 2024-06-06T02:40:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e5f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 0x55d83e60bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1ab150 con 0x55d83e2561b0 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1a8a20 con 0x55d83e2354d0 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.593+0000 7fa177f91740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1a2820 con 0x55d83e22d2f0 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.594+0000 7fa169400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.594+0000 7fa169400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:46868/0 (socket says 172.21.15.82:46868) 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.594+0000 7fa169400640 1 -- 172.21.15.82:0/1542216708 learned_addr learned my addr 172.21.15.82:0/1542216708 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.594+0000 7fa16a800640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 0x55d83e60bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.594+0000 7fa169e00640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e5f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa169400640 1 -- 172.21.15.82:0/1542216708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 msgr2=0x55d83e5f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa169400640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e5f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa169400640 1 -- 172.21.15.82:0/1542216708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 msgr2=0x55d83e60bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa169400640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 0x55d83e60bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa169400640 1 -- 172.21.15.82:0/1542216708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d83e33a620 con 0x55d83e2354d0 2024-06-06T02:40:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.595+0000 7fa16a800640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 0x55d83e60bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:40:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.596+0000 7fa169400640 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005f70 tx=0x7fa15c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a77f5b6497ff5b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.596+0000 7fa156a00640 1 -- 172.21.15.82:0/1542216708 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c035050 con 0x55d83e2354d0 2024-06-06T02:40:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.596+0000 7fa156a00640 1 -- 172.21.15.82:0/1542216708 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15c04c070 con 0x55d83e2354d0 2024-06-06T02:40:39.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.596+0000 7fa156a00640 1 -- 172.21.15.82:0/1542216708 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15c047460 con 0x55d83e2354d0 2024-06-06T02:40:39.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.599+0000 7fa177f91740 1 -- 172.21.15.82:0/1542216708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 msgr2=0x55d83e60b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.599+0000 7fa177f91740 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa15c005f70 tx=0x7fa15c02a410 comp rx=0 tx=0).stop 2024-06-06T02:40:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 -- 172.21.15.82:0/1542216708 shutdown_connections 2024-06-06T02:40:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2561b0 0x55d83e60bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2354d0 0x55d83e60b860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 --2- 172.21.15.82:0/1542216708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e5f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 -- 172.21.15.82:0/1542216708 >> 172.21.15.82:0/1542216708 conn(0x55d83e24a300 msgr2=0x55d83e5f7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.600+0000 7fa177f91740 1 -- 172.21.15.82:0/1542216708 shutdown_connections 2024-06-06T02:40:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.601+0000 7fa177f91740 1 -- 172.21.15.82:0/1542216708 wait complete. 2024-06-06T02:40:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.602+0000 7fa177f91740 1 -- start start 2024-06-06T02:40:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.603+0000 7fa177f91740 1 Processor -- start 2024-06-06T02:40:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.605+0000 7fa177f91740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.605+0000 7fa177f91740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.606+0000 7fa177f91740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e6ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.606+0000 7fa177f91740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1a2eb0 con 0x55d83e2354d0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.606+0000 7fa169e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.606+0000 7fa169e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44886/0 (socket says 172.21.15.82:44886) 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.606+0000 7fa169e00640 1 -- 172.21.15.82:0/2167394139 learned_addr learned my addr 172.21.15.82:0/2167394139 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.607+0000 7fa16a800640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e6ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.607+0000 7fa169400640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.609+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1a8350 con 0x55d83e2561b0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.609+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c1a3580 con 0x55d83e22d2f0 2024-06-06T02:40:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.609+0000 7fa177f91740 10 client.0 _ll_register_callbacks cb 0x7fa15800f450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.610+0000 7fa169e00640 1 -- 172.21.15.82:0/2167394139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 msgr2=0x55d83e6ab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.610+0000 7fa169e00640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e6ab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.610+0000 7fa169e00640 1 -- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 msgr2=0x55d83e6095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.610+0000 7fa169e00640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.610+0000 7fa169e00640 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d83e6ab600 con 0x55d83e22d2f0 2024-06-06T02:40:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.612+0000 7fa169e00640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1640a70f0 tx=0x7fa1640a9720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27dff3d320822031 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.612+0000 7fa14be00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:40:39.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.613+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1640ae230 con 0x55d83e22d2f0 2024-06-06T02:40:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.613+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa164011ad0 con 0x55d83e22d2f0 2024-06-06T02:40:39.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.613+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa15c04c070 con 0x55d83e22d2f0 2024-06-06T02:40:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.614+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa1640b2ce0 con 0x55d83e22d2f0 2024-06-06T02:40:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.614+0000 7fa177f91740 10 client.25705 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:39.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.614+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d83e6ac830 con 0x55d83e22d2f0 2024-06-06T02:40:39.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15c04c070 con 0x55d83e22d2f0 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa164022030 con 0x55d83e22d2f0 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 10 client.25705 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 10 client.25705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 20 client.25705 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e1ea1c0 0x55d83e6af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 4 client.25705 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:40:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.615+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d83e56ae70 con 0x55d83e1ea1c0 2024-06-06T02:40:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.618+0000 7fa169400640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e1ea1c0 0x55d83e6af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.620+0000 7fa169400640 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e1ea1c0 0x55d83e6af1b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d99f234b57236df server_cookie=6830175a39db8121 in_seq=0 out_seq=0 2024-06-06T02:40:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.620+0000 7fa14be00640 10 client.25705 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.708+0000 7fa14be00640 1 -- 172.21.15.82:0/2167394139 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d83e56ae70 con 0x55d83e1ea1c0 2024-06-06T02:40:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.708+0000 7fa14be00640 10 client.25705 handle_command_reply: tid=0 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.708+0000 7fa177f91740 1 client.25705 shutdown 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.708+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 msgr2=0x55d83e609070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa1640a70f0 tx=0x7fa1640a9720 comp rx=0 tx=0).stop 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 shutdown_connections 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d83e2561b0 0x55d83e6ab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d83e1ea1c0 0x55d83e6af1b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d83e2354d0 0x55d83e6095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 --2- 172.21.15.82:0/2167394139 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d83e22d2f0 0x55d83e609070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa14be00640 0 client.25705 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 >> 172.21.15.82:0/2167394139 conn(0x55d83e24a300 msgr2=0x55d83e5f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 shutdown_connections 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 1 -- 172.21.15.82:0/2167394139 wait complete. 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.709+0000 7fa177f91740 20 client.25705 trim_cache size 0 max 16384 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:40:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.713+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 msgr2=0x7fa1500b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.713+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 0x7fa1500b4cf0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000c00 tx=0x7fa15c031420 comp rx=0 tx=0).stop 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 msgr2=0x7fa16c108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa16400ea80 tx=0x7fa16400ef40 comp rx=0 tx=0).stop 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 shutdown_connections 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa1500b27e0 0x7fa1500b4cf0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa16c105270 0x7fa16c105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa16c104620 0x7fa16c108ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 --2- 172.21.15.82:0/1365802824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa16c102bb0 0x7fa16c108720 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.714+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 >> 172.21.15.82:0/1365802824 conn(0x7fa16c0fe3d0 msgr2=0x7fa16c074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.715+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 shutdown_connections 2024-06-06T02:40:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:39.715+0000 7fa170e00640 1 -- 172.21.15.82:0/1365802824 wait complete. 2024-06-06T02:40:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:40 smithi103 ceph-mon[36349]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 158 MiB/s wr, 10.00k op/s 2024-06-06T02:40:40.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:40 smithi082 ceph-mon[31579]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 158 MiB/s wr, 10.00k op/s 2024-06-06T02:40:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:40 smithi184 ceph-mon[36922]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 158 MiB/s wr, 10.00k op/s 2024-06-06T02:40:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:42 smithi103 ceph-mon[36349]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 152 MiB/s wr, 14.34k op/s 2024-06-06T02:40:42.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:42 smithi082 ceph-mon[31579]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 152 MiB/s wr, 14.34k op/s 2024-06-06T02:40:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:42 smithi184 ceph-mon[36922]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 152 MiB/s wr, 14.34k op/s 2024-06-06T02:40:44.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:44 smithi103 ceph-mon[36349]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 153 MiB/s wr, 18.66k op/s 2024-06-06T02:40:44.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:44 smithi082 ceph-mon[31579]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 153 MiB/s wr, 18.66k op/s 2024-06-06T02:40:44.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:44 smithi184 ceph-mon[36922]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 153 MiB/s wr, 18.66k op/s 2024-06-06T02:40:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:46 smithi103 ceph-mon[36349]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 142 MiB/s wr, 20.60k op/s 2024-06-06T02:40:46.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:46 smithi082 ceph-mon[31579]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 142 MiB/s wr, 20.60k op/s 2024-06-06T02:40:46.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:46 smithi184 ceph-mon[36922]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 142 MiB/s wr, 20.60k op/s 2024-06-06T02:40:48.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:48 smithi082 ceph-mon[31579]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 143 MiB/s wr, 20.12k op/s 2024-06-06T02:40:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:48 smithi184 ceph-mon[36922]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 143 MiB/s wr, 20.12k op/s 2024-06-06T02:40:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:48 smithi103 ceph-mon[36349]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 143 MiB/s wr, 20.12k op/s 2024-06-06T02:40:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:50 smithi184 ceph-mon[36922]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 148 MiB/s wr, 20.44k op/s 2024-06-06T02:40:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:50 smithi103 ceph-mon[36349]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 148 MiB/s wr, 20.44k op/s 2024-06-06T02:40:50.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:50 smithi082 ceph-mon[31579]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 148 MiB/s wr, 20.44k op/s 2024-06-06T02:40:52.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:52 smithi184 ceph-mon[36922]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 156 MiB/s wr, 21.20k op/s 2024-06-06T02:40:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:52 smithi103 ceph-mon[36349]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 156 MiB/s wr, 21.20k op/s 2024-06-06T02:40:52.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:52 smithi082 ceph-mon[31579]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 156 MiB/s wr, 21.20k op/s 2024-06-06T02:40:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.061+0000 7f2acc200640 1 -- 172.21.15.82:0/4126725647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4103de0 msgr2=0x7f2ac4106200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.061+0000 7f2acc200640 1 --2- 172.21.15.82:0/4126725647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4103de0 0x7f2ac4106200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a440 comp rx=0 tx=0).stop 2024-06-06T02:40:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 -- 172.21.15.82:0/4126725647 shutdown_connections 2024-06-06T02:40:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 --2- 172.21.15.82:0/4126725647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4106740 0x7f2ac4106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 --2- 172.21.15.82:0/4126725647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4103de0 0x7f2ac4106200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 --2- 172.21.15.82:0/4126725647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4101480 0x7f2ac41038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 -- 172.21.15.82:0/4126725647 >> 172.21.15.82:0/4126725647 conn(0x7f2ac40fd2a0 msgr2=0x7f2ac40ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 -- 172.21.15.82:0/4126725647 shutdown_connections 2024-06-06T02:40:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.063+0000 7f2acc200640 1 -- 172.21.15.82:0/4126725647 wait complete. 2024-06-06T02:40:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.066+0000 7f2acc200640 1 Processor -- start 2024-06-06T02:40:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.068+0000 7f2acc200640 1 -- start start 2024-06-06T02:40:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.069+0000 7f2acc200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4101480 0x7f2ac4111950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2acc200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4103de0 0x7f2ac410fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2acc200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2acc200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4108300 con 0x7f2ac4103de0 2024-06-06T02:40:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2acc200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4108180 con 0x7f2ac4101480 2024-06-06T02:40:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2acc200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4108480 con 0x7f2ac4106740 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2aca200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2aca200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39770/0 (socket says 172.21.15.82:39770) 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2aca200640 1 -- 172.21.15.82:0/814041655 learned_addr learned my addr 172.21.15.82:0/814041655 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.070+0000 7f2ac9800640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4101480 0x7f2ac4111950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4103de0 0x7f2ac410fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 -- 172.21.15.82:0/814041655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4101480 msgr2=0x7f2ac4111950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4101480 0x7f2ac4111950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 -- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4103de0 msgr2=0x7f2ac410fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4103de0 0x7f2ac410fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 -- 172.21.15.82:0/814041655 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac4110aa0 con 0x7f2ac4106740 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.071+0000 7f2aca200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b970 tx=0x7f2abc00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.072+0000 7f2ac2000640 1 -- 172.21.15.82:0/814041655 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc019070 con 0x7f2ac4106740 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.072+0000 7f2ac2000640 1 -- 172.21.15.82:0/814041655 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2abc014440 con 0x7f2ac4106740 2024-06-06T02:40:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.072+0000 7f2ac2000640 1 -- 172.21.15.82:0/814041655 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0075d0 con 0x7f2ac4106740 2024-06-06T02:40:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.074+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac4110d90 con 0x7f2ac4106740 2024-06-06T02:40:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.075+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac41b0490 con 0x7f2ac4106740 2024-06-06T02:40:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.083+0000 7f2ad3170740 1 Processor -- start 2024-06-06T02:40:53.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.087+0000 7f2ad3170740 1 -- start start 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4d3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5602eb43e480 con 0x5602eb0fe2f0 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602eb42da20 con 0x5602eb1064d0 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ad3170740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5602eb431a60 con 0x5602eb1271b0 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.088+0000 7f2ac2000640 1 -- 172.21.15.82:0/814041655 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2abc00cb40 con 0x7f2ac4106740 2024-06-06T02:40:53.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.089+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46810/0 (socket says 172.21.15.82:46810) 2024-06-06T02:40:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 -- 172.21.15.82:0/2623103327 learned_addr learned my addr 172.21.15.82:0/2623103327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:53.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 -- 172.21.15.82:0/2623103327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 msgr2=0x5602eb4cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 -- 172.21.15.82:0/2623103327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 msgr2=0x5602eb4d3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.090+0000 7f2ac9800640 1 -- 172.21.15.82:0/2623103327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602eb42a8d0 con 0x5602eb0fe2f0 2024-06-06T02:40:53.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.091+0000 7f2ac9800640 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bcb0 tx=0x7f2ab00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ffe4ee4c1faabe server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.092+0000 7f2ac2000640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 0x7f2aac0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.092+0000 7f2ac2000640 1 -- 172.21.15.82:0/814041655 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2abc0e16f0 con 0x7f2ac4106740 2024-06-06T02:40:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.092+0000 7f2ab6a00640 1 -- 172.21.15.82:0/2623103327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0004020 con 0x5602eb0fe2f0 2024-06-06T02:40:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.092+0000 7f2ab6a00640 1 -- 172.21.15.82:0/2623103327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab00041c0 con 0x5602eb0fe2f0 2024-06-06T02:40:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.092+0000 7f2ab6a00640 1 -- 172.21.15.82:0/2623103327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0011680 con 0x5602eb0fe2f0 2024-06-06T02:40:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.093+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 0x7f2aac0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.094+0000 7f2ad3170740 1 -- 172.21.15.82:0/2623103327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 msgr2=0x5602eb4cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.094+0000 7f2ad3170740 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bcb0 tx=0x7f2ab00107a0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.095+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 0x7f2aac0b4df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8004aa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.097+0000 7f2ad3170740 1 -- 172.21.15.82:0/2623103327 shutdown_connections 2024-06-06T02:40:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.097+0000 7f2ad3170740 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.097+0000 7f2ad3170740 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0fe2f0 0x5602eb4cc240 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.097+0000 7f2ad3170740 1 --2- 172.21.15.82:0/2623103327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.097+0000 7f2ad3170740 1 -- 172.21.15.82:0/2623103327 >> 172.21.15.82:0/2623103327 conn(0x5602eb11b300 msgr2=0x5602eb4c76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.099+0000 7f2ad3170740 1 -- 172.21.15.82:0/2623103327 shutdown_connections 2024-06-06T02:40:53.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.100+0000 7f2ad3170740 1 -- 172.21.15.82:0/2623103327 wait complete. 2024-06-06T02:40:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.100+0000 7f2ad3170740 1 -- start start 2024-06-06T02:40:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.101+0000 7f2ad3170740 1 Processor -- start 2024-06-06T02:40:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.101+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.101+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.101+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 0x5602eb4ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2aca200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 0x5602eb4ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2aca200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 0x5602eb4ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:59086/0 (socket says 172.21.15.82:59086) 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ac8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ac8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39784/0 (socket says 172.21.15.82:39784) 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ad3170740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5602eb368ab0 con 0x5602eb1064d0 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ad3170740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602eb3cb630 con 0x5602eb0e5d80 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ad3170740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5602eb4e4ae0 con 0x5602eb1271b0 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.102+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46814/0 (socket says 172.21.15.82:46814) 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 -- 172.21.15.82:0/32355436 learned_addr learned my addr 172.21.15.82:0/32355436 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 -- 172.21.15.82:0/32355436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 msgr2=0x5602eb4e6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4e6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 -- 172.21.15.82:0/32355436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 msgr2=0x5602eb4ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 0x5602eb4ed9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ac9800640 1 -- 172.21.15.82:0/32355436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602eb3f8170 con 0x5602eb1064d0 2024-06-06T02:40:53.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.103+0000 7f2ad3170740 10 client.0 _ll_register_callbacks cb 0x5602eb3d1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.104+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab00041c0 con 0x5602eb1064d0 2024-06-06T02:40:53.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.104+0000 7f2ac9800640 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bcb0 tx=0x7f2ab000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3804268051235f8 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.104+0000 7f2aab400640 10 client.15507 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:40:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.105+0000 7f2aab400640 1 -- 172.21.15.82:0/32355436 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00035f0 con 0x5602eb1064d0 2024-06-06T02:40:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.105+0000 7f2aab400640 1 -- 172.21.15.82:0/32355436 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2ab0003790 con 0x5602eb1064d0 2024-06-06T02:40:53.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.105+0000 7f2aab400640 1 -- 172.21.15.82:0/32355436 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ab00039b0 con 0x5602eb1064d0 2024-06-06T02:40:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.107+0000 7f2ad3170740 10 client.15507 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:53.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.107+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5602eb192790 con 0x5602eb1064d0 2024-06-06T02:40:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2aab400640 1 -- 172.21.15.82:0/32355436 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2ab0005040 con 0x5602eb1064d0 2024-06-06T02:40:53.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 20 client.15507 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb0bb1c0 0x5602eb4f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 4 client.15507 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.108+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602eb4403d0 con 0x5602eb0bb1c0 2024-06-06T02:40:53.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.109+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb0bb1c0 0x5602eb4f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.110+0000 7f2aab400640 10 client.15507 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:53.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.110+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb0bb1c0 0x5602eb4f3880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1351d27cf45d249a server_cookie=524f065e3b1b8dd8 in_seq=0 out_seq=0 2024-06-06T02:40:53.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.114+0000 7f2aab400640 1 -- 172.21.15.82:0/32355436 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5602eb4403d0 con 0x5602eb0bb1c0 2024-06-06T02:40:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.114+0000 7f2aab400640 10 client.15507 handle_command_reply: tid=0 2024-06-06T02:40:53.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.114+0000 7f2ad3170740 1 client.15507 shutdown 2024-06-06T02:40:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 msgr2=0x5602eb4e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000bcb0 tx=0x7f2ab000bfd0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 shutdown_connections 2024-06-06T02:40:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb0e5d80 0x5602eb4ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4e6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb0bb1c0 0x5602eb4f3880 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 --2- 172.21.15.82:0/32355436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb1064d0 0x5602eb4e65a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 >> 172.21.15.82:0/32355436 conn(0x5602eb11b300 msgr2=0x5602eb4c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.117+0000 7f2aab400640 0 client.15507 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.118+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 shutdown_connections 2024-06-06T02:40:53.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.118+0000 7f2ad3170740 1 -- 172.21.15.82:0/32355436 wait complete. 2024-06-06T02:40:53.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.121+0000 7f2ad3170740 20 client.15507 trim_cache size 0 max 16384 2024-06-06T02:40:53.163 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.163+0000 7f2ad3170740 1 Processor -- start 2024-06-06T02:40:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 -- start start 2024-06-06T02:40:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4ede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac41b33f0 con 0x5602eb0e5d80 2024-06-06T02:40:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac41b0cc0 con 0x5602eb1064d0 2024-06-06T02:40:53.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.166+0000 7f2ad3170740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4072da0 con 0x5602eb1271b0 2024-06-06T02:40:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac9800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46830/0 (socket says 172.21.15.82:46830) 2024-06-06T02:40:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac9800640 1 -- 172.21.15.82:0/3909862465 learned_addr learned my addr 172.21.15.82:0/3909862465 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:53.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2aca200640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4ede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac9800640 1 -- 172.21.15.82:0/3909862465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 msgr2=0x5602eb4ede30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.168+0000 7f2ac9800640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4ede30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.169+0000 7f2ac9800640 1 -- 172.21.15.82:0/3909862465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 msgr2=0x5602eb4ed8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.169+0000 7f2ac9800640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4ed8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.169+0000 7f2ac9800640 1 -- 172.21.15.82:0/3909862465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602eb20b620 con 0x5602eb0e5d80 2024-06-06T02:40:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.169+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:40:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.170+0000 7f2ac9800640 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0003ce0 tx=0x7f2ab0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a73d44b8b4c964 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.172+0000 7f2ab6000640 1 -- 172.21.15.82:0/3909862465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0037070 con 0x5602eb0e5d80 2024-06-06T02:40:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.172+0000 7f2ab6000640 1 -- 172.21.15.82:0/3909862465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab00041c0 con 0x5602eb0e5d80 2024-06-06T02:40:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.172+0000 7f2ab6000640 1 -- 172.21.15.82:0/3909862465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0004a30 con 0x5602eb0e5d80 2024-06-06T02:40:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.173+0000 7f2ad3170740 1 -- 172.21.15.82:0/3909862465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 msgr2=0x5602eb4cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.173+0000 7f2ad3170740 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0003ce0 tx=0x7f2ab0021000 comp rx=0 tx=0).stop 2024-06-06T02:40:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 -- 172.21.15.82:0/3909862465 shutdown_connections 2024-06-06T02:40:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4ede30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4ed8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 --2- 172.21.15.82:0/3909862465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4cebe0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 -- 172.21.15.82:0/3909862465 >> 172.21.15.82:0/3909862465 conn(0x5602eb11b300 msgr2=0x5602eb4c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.174+0000 7f2ad3170740 1 -- 172.21.15.82:0/3909862465 shutdown_connections 2024-06-06T02:40:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.175+0000 7f2ad3170740 1 -- 172.21.15.82:0/3909862465 wait complete. 2024-06-06T02:40:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.176+0000 7f2ad3170740 1 -- start start 2024-06-06T02:40:53.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.176+0000 7f2ad3170740 1 Processor -- start 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.178+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4edf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4073410 con 0x5602eb0e5d80 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac41b0780 con 0x5602eb1064d0 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac4073ae0 con 0x5602eb1271b0 2024-06-06T02:40:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ad3170740 10 client.0 _ll_register_callbacks cb 0x7f2ab000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:40:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ac8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ac8e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:59118/0 (socket says 172.21.15.82:59118) 2024-06-06T02:40:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ac8e00640 1 -- 172.21.15.82:0/159020511 learned_addr learned my addr 172.21.15.82:0/159020511 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:40:53.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.179+0000 7f2ac9800640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.180+0000 7f2aca200640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.181+0000 7f2ac8e00640 1 -- 172.21.15.82:0/159020511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 msgr2=0x5602eb4eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.181+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.181+0000 7f2ac8e00640 1 -- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 msgr2=0x5602eb4edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:40:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.181+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.181+0000 7f2ac8e00640 1 -- 172.21.15.82:0/159020511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602eb4eb6a0 con 0x5602eb1064d0 2024-06-06T02:40:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.184+0000 7f2ac8e00640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8057fd0 tx=0x7f2ab8009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57db18e9831610b6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:40:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.184+0000 7f2aab400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:40:53.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.185+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8057330 con 0x5602eb1064d0 2024-06-06T02:40:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.186+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab00041c0 con 0x5602eb1064d0 2024-06-06T02:40:53.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.186+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2ab80574d0 con 0x5602eb1064d0 2024-06-06T02:40:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.187+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2ab80576d0 con 0x5602eb1064d0 2024-06-06T02:40:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.187+0000 7f2ad3170740 10 client.25691 fetch_fsmap learned FSMap version 27 2024-06-06T02:40:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.187+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602eb55b220 con 0x5602eb1064d0 2024-06-06T02:40:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab00041c0 con 0x5602eb1064d0 2024-06-06T02:40:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2ab8049040 con 0x5602eb1064d0 2024-06-06T02:40:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 10 client.25691 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:40:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:40:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 20 client.25691 populate_metadata read hostname 'smithi082' 2024-06-06T02:40:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb55bb80 0x5602eb55dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:40:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 4 client.25691 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:40:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.188+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602eb43be70 con 0x5602eb55bb80 2024-06-06T02:40:53.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.190+0000 7f2ac9800640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb55bb80 0x5602eb55dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:40:53.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.193+0000 7f2aab400640 10 client.25691 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:53.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.193+0000 7f2ac9800640 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb55bb80 0x5602eb55dfa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4ab69ba70aacc84 server_cookie=1a721eb58ab41dbe in_seq=0 out_seq=0 2024-06-06T02:40:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2aab400640 1 -- 172.21.15.82:0/159020511 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602eb43be70 con 0x5602eb55bb80 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2aab400640 10 client.25691 handle_command_reply: tid=0 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2ad3170740 1 client.25691 shutdown 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 msgr2=0x5602eb4eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8057fd0 tx=0x7f2ab8009260 comp rx=0 tx=0).stop 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 shutdown_connections 2024-06-06T02:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.427+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5602eb1271b0 0x5602eb4eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.428+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602eb1064d0 0x5602eb4eab20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.428+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5602eb55bb80 0x5602eb55dfa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.428+0000 7f2ad3170740 1 --2- 172.21.15.82:0/159020511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5602eb0e5d80 0x5602eb4edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.428+0000 7f2aab400640 0 client.25691 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.428+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 >> 172.21.15.82:0/159020511 conn(0x5602eb11b300 msgr2=0x5602eb4c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.429+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 shutdown_connections 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.429+0000 7f2ad3170740 1 -- 172.21.15.82:0/159020511 wait complete. 2024-06-06T02:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.429+0000 7f2ad3170740 20 client.25691 trim_cache size 0 max 16384 2024-06-06T02:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:40:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 msgr2=0x7f2aac0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 0x7f2aac0b4df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8004aa0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 msgr2=0x7f2ac4110530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b970 tx=0x7f2abc00be30 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 shutdown_connections 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2aac0b28e0 0x7f2aac0b4df0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ac4106740 0x7f2ac4110530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ac4103de0 0x7f2ac410fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 --2- 172.21.15.82:0/814041655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ac4101480 0x7f2ac4111950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.433+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 >> 172.21.15.82:0/814041655 conn(0x7f2ac40fd2a0 msgr2=0x7f2ac40fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.434+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 shutdown_connections 2024-06-06T02:40:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:40:53.434+0000 7f2acc200640 1 -- 172.21.15.82:0/814041655 wait complete. 2024-06-06T02:40:53.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:40:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:40:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:54 smithi184 ceph-mon[36922]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 152 MiB/s wr, 20.27k op/s 2024-06-06T02:40:54.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:54 smithi082 ceph-mon[31579]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 152 MiB/s wr, 20.27k op/s 2024-06-06T02:40:54.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:54 smithi103 ceph-mon[36349]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 152 MiB/s wr, 20.27k op/s 2024-06-06T02:40:56.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:56 smithi103 ceph-mon[36349]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 158 MiB/s wr, 20.87k op/s 2024-06-06T02:40:56.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:56 smithi082 ceph-mon[31579]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 158 MiB/s wr, 20.87k op/s 2024-06-06T02:40:56.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:56 smithi184 ceph-mon[36922]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 158 MiB/s wr, 20.87k op/s 2024-06-06T02:40:58.699 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:40:58 smithi184 ceph-mon[36922]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 143 MiB/s wr, 19.17k op/s 2024-06-06T02:40:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:40:58 smithi103 ceph-mon[36349]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 143 MiB/s wr, 19.17k op/s 2024-06-06T02:40:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:40:58 smithi082 ceph-mon[31579]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 143 MiB/s wr, 19.17k op/s 2024-06-06T02:41:00.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:00 smithi082 ceph-mon[31579]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 145 MiB/s wr, 19.63k op/s 2024-06-06T02:41:00.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:00 smithi103 ceph-mon[36349]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 145 MiB/s wr, 19.63k op/s 2024-06-06T02:41:00.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:00 smithi184 ceph-mon[36922]: pgmap v542: 97 pgs: 97 active+clean; 13 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 145 MiB/s wr, 19.63k op/s 2024-06-06T02:41:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:02 smithi103 ceph-mon[36349]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 154 MiB/s wr, 20.73k op/s 2024-06-06T02:41:02.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:02 smithi082 ceph-mon[31579]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 154 MiB/s wr, 20.73k op/s 2024-06-06T02:41:02.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:02 smithi184 ceph-mon[36922]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 154 MiB/s wr, 20.73k op/s 2024-06-06T02:41:04.845 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:04 smithi082 ceph-mon[31579]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 153 MiB/s wr, 19.98k op/s 2024-06-06T02:41:04.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:04 smithi103 ceph-mon[36349]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 153 MiB/s wr, 19.98k op/s 2024-06-06T02:41:04.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:04 smithi184 ceph-mon[36922]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 153 MiB/s wr, 19.98k op/s 2024-06-06T02:41:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.813+0000 7fe15e200640 1 -- 172.21.15.82:0/3107007493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15810a290 msgr2=0x7fe15810a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.813+0000 7fe156000640 1 -- 172.21.15.82:0/3107007493 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144035020 con 0x7fe15810a290 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.813+0000 7fe15e200640 1 --2- 172.21.15.82:0/3107007493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15810a290 0x7fe15810a760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe144009930 tx=0x7fe14402a4b0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 -- 172.21.15.82:0/3107007493 shutdown_connections 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 --2- 172.21.15.82:0/3107007493 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe158111330 0x7fe158113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 --2- 172.21.15.82:0/3107007493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe15810a290 0x7fe15810a760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 --2- 172.21.15.82:0/3107007493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe158109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 -- 172.21.15.82:0/3107007493 >> 172.21.15.82:0/3107007493 conn(0x7fe15806fbe0 msgr2=0x7fe158072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 -- 172.21.15.82:0/3107007493 shutdown_connections 2024-06-06T02:41:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.814+0000 7fe15e200640 1 -- 172.21.15.82:0/3107007493 wait complete. 2024-06-06T02:41:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.816+0000 7fe15e200640 1 Processor -- start 2024-06-06T02:41:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.817+0000 7fe15e200640 1 -- start start 2024-06-06T02:41:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.818+0000 7fe15e200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.818+0000 7fe15e200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 0x7fe1581a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.818+0000 7fe157400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe157400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56862/0 (socket says 172.21.15.82:56862) 2024-06-06T02:41:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe157400640 1 -- 172.21.15.82:0/594886290 learned_addr learned my addr 172.21.15.82:0/594886290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe158111330 0x7fe1581ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe158116f30 con 0x7fe158109940 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe158116db0 con 0x7fe158111330 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe1581170b0 con 0x7fe15810a290 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe156a00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 0x7fe1581a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.819+0000 7fe157e00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe158111330 0x7fe1581ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe157400640 1 -- 172.21.15.82:0/594886290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 msgr2=0x7fe1581a40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe157400640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 0x7fe1581a40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe157400640 1 -- 172.21.15.82:0/594886290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe158111330 msgr2=0x7fe1581ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe157400640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe158111330 0x7fe1581ab060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe157400640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1581ab6d0 con 0x7fe158109940 2024-06-06T02:41:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.820+0000 7fe156a00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 0x7fe1581a40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.822+0000 7fe157400640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe14800d950 tx=0x7fe14800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.822+0000 7fe14fe00640 1 -- 172.21.15.82:0/594886290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148017020 con 0x7fe158109940 2024-06-06T02:41:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.823+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15819c630 con 0x7fe158109940 2024-06-06T02:41:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.823+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15819cbd0 con 0x7fe158109940 2024-06-06T02:41:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.823+0000 7fe14fe00640 1 -- 172.21.15.82:0/594886290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe148009c30 con 0x7fe158109940 2024-06-06T02:41:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.823+0000 7fe14fe00640 1 -- 172.21.15.82:0/594886290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14801c660 con 0x7fe158109940 2024-06-06T02:41:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.834+0000 7fe1651b5740 1 Processor -- start 2024-06-06T02:41:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.834+0000 7fe1651b5740 1 -- start start 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.837+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdeed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.837+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.838+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.838+0000 7fe1651b5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbd61480 con 0x55ffdba212f0 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.838+0000 7fe1651b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbd50a20 con 0x55ffdba294d0 2024-06-06T02:41:06.838 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.838+0000 7fe1651b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbd54a60 con 0x55ffdba4a1b0 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.841+0000 7fe156a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.841+0000 7fe156a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40178/0 (socket says 172.21.15.82:40178) 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.841+0000 7fe156a00640 1 -- 172.21.15.82:0/2916769599 learned_addr learned my addr 172.21.15.82:0/2916769599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.841+0000 7fe157e00640 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdeed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.841+0000 7fe14fe00640 1 -- 172.21.15.82:0/594886290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe14801a020 con 0x7fe158109940 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.842+0000 7fe156a00640 1 -- 172.21.15.82:0/2916769599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 msgr2=0x55ffdbdeed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.842+0000 7fe156a00640 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdeed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.842+0000 7fe156a00640 1 -- 172.21.15.82:0/2916769599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 msgr2=0x55ffdbdef240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:41:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.843+0000 7fe157400640 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.843+0000 7fe156a00640 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdef240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.843+0000 7fe156a00640 1 -- 172.21.15.82:0/2916769599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdbd4d8d0 con 0x55ffdba294d0 2024-06-06T02:41:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.843+0000 7fe156a00640 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe144009930 tx=0x7fe14403eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae97e923b4394f0a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.844+0000 7fe143e00640 1 -- 172.21.15.82:0/2916769599 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14404d070 con 0x55ffdba294d0 2024-06-06T02:41:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.844+0000 7fe143e00640 1 -- 172.21.15.82:0/2916769599 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe144004230 con 0x55ffdba294d0 2024-06-06T02:41:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.844+0000 7fe143e00640 1 -- 172.21.15.82:0/2916769599 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144035050 con 0x55ffdba294d0 2024-06-06T02:41:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 -- 172.21.15.82:0/2916769599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 msgr2=0x55ffdbdf6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe144009930 tx=0x7fe14403eed0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 -- 172.21.15.82:0/2916769599 shutdown_connections 2024-06-06T02:41:06.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf6100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2916769599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdeed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.847+0000 7fe1651b5740 1 -- 172.21.15.82:0/2916769599 >> 172.21.15.82:0/2916769599 conn(0x55ffdba3e300 msgr2=0x55ffdbdea6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:06.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.848+0000 7fe14fe00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 0x7fe13c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.849+0000 7fe156a00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 0x7fe13c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.849+0000 7fe1651b5740 1 -- 172.21.15.82:0/2916769599 shutdown_connections 2024-06-06T02:41:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.850+0000 7fe14fe00640 1 -- 172.21.15.82:0/594886290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe1480e2110 con 0x7fe158109940 2024-06-06T02:41:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.851+0000 7fe1651b5740 1 -- 172.21.15.82:0/2916769599 wait complete. 2024-06-06T02:41:06.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.852+0000 7fe156a00640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 0x7fe13c0b4e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55ffdbdeb440 tx=0x7fe14402a4b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.854+0000 7fe1651b5740 1 -- start start 2024-06-06T02:41:06.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.855+0000 7fe1651b5740 1 Processor -- start 2024-06-06T02:41:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.860+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba212f0 0x55ffdbdf82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.860+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.860+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.860+0000 7fe157400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba212f0 0x55ffdbdf82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe156a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe156a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36532/0 (socket says 172.21.15.82:36532) 2024-06-06T02:41:06.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe156a00640 1 -- 172.21.15.82:0/2763796498 learned_addr learned my addr 172.21.15.82:0/2763796498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbc8bab0 con 0x55ffdba4a1b0 2024-06-06T02:41:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbcee630 con 0x55ffdba212f0 2024-06-06T02:41:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55ffdbdf6a70 con 0x55ffdba294d0 2024-06-06T02:41:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.861+0000 7fe1651b5740 10 client.0 _ll_register_callbacks cb 0x55ffdbcf4610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:06.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.862+0000 7fe156a00640 1 -- 172.21.15.82:0/2763796498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba212f0 msgr2=0x55ffdbdf82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.862+0000 7fe156a00640 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba212f0 0x55ffdbdf82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.862+0000 7fe156a00640 1 -- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 msgr2=0x55ffdbdff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.862+0000 7fe156a00640 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.862+0000 7fe156a00640 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdbd1b170 con 0x55ffdba294d0 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.863+0000 7fe156a00640 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe144009900 tx=0x7fe14403eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc7b2bdcc324bb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.863+0000 7fe140c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.864+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144062030 con 0x55ffdba294d0 2024-06-06T02:41:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.864+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe1440035f0 con 0x55ffdba294d0 2024-06-06T02:41:06.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.864+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe144004230 con 0x55ffdba294d0 2024-06-06T02:41:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.867+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe14404d040 con 0x55ffdba294d0 2024-06-06T02:41:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.867+0000 7fe1651b5740 10 client.25735 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:06.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.867+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffdbab5790 con 0x55ffdba294d0 2024-06-06T02:41:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:06 smithi103 ceph-mon[36349]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 165 MiB/s wr, 20.89k op/s 2024-06-06T02:41:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.867+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe144004230 con 0x55ffdba294d0 2024-06-06T02:41:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe14405dc10 con 0x55ffdba294d0 2024-06-06T02:41:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 10 client.25735 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 10 client.25735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 20 client.25735 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdba08d80 0x55ffdbe057e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 4 client.25735 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.868+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffdbd633d0 con 0x55ffdba08d80 2024-06-06T02:41:06.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.870+0000 7fe157400640 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdba08d80 0x55ffdbe057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:06 smithi082 ceph-mon[31579]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 165 MiB/s wr, 20.89k op/s 2024-06-06T02:41:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.872+0000 7fe140c00640 10 client.25735 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.872+0000 7fe157400640 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdba08d80 0x55ffdbe057e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63762ce5b924191b server_cookie=5f73da29e021f6a6 in_seq=0 out_seq=0 2024-06-06T02:41:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.877+0000 7fe140c00640 1 -- 172.21.15.82:0/2763796498 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ffdbd633d0 con 0x55ffdba08d80 2024-06-06T02:41:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.877+0000 7fe140c00640 10 client.25735 handle_command_reply: tid=0 2024-06-06T02:41:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.877+0000 7fe1651b5740 1 client.25735 shutdown 2024-06-06T02:41:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.877+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 msgr2=0x55ffdbdf8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.877+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe144009900 tx=0x7fe14403eed0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 shutdown_connections 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdba08d80 0x55ffdbe057e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba294d0 0x55ffdbdf8830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2763796498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba212f0 0x55ffdbdf82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 >> 172.21.15.82:0/2763796498 conn(0x55ffdba3e300 msgr2=0x55ffdbdeb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.878+0000 7fe140c00640 0 client.25735 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.879+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 shutdown_connections 2024-06-06T02:41:06.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.879+0000 7fe1651b5740 1 -- 172.21.15.82:0/2763796498 wait complete. 2024-06-06T02:41:06.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.879+0000 7fe1651b5740 20 client.25735 trim_cache size 0 max 16384 2024-06-06T02:41:06.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:06 smithi184 ceph-mon[36922]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 165 MiB/s wr, 20.89k op/s 2024-06-06T02:41:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.917+0000 7fe1651b5740 1 Processor -- start 2024-06-06T02:41:06.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.917+0000 7fe1651b5740 1 -- start start 2024-06-06T02:41:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe138010d90 con 0x55ffdba4a1b0 2024-06-06T02:41:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe13800e660 con 0x55ffdba294d0 2024-06-06T02:41:06.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe1651b5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe13800c490 con 0x55ffdba212f0 2024-06-06T02:41:06.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.918+0000 7fe157400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36538/0 (socket says 172.21.15.82:36538) 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 -- 172.21.15.82:0/1759138237 learned_addr learned my addr 172.21.15.82:0/1759138237 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe156a00640 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 -- 172.21.15.82:0/1759138237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 msgr2=0x55ffdbdf75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 -- 172.21.15.82:0/1759138237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 msgr2=0x55ffdbdff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.919+0000 7fe157400640 1 -- 172.21.15.82:0/1759138237 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffdbb2e620 con 0x55ffdba212f0 2024-06-06T02:41:06.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.920+0000 7fe157400640 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1480a6960 tx=0x7fe148010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e21588c46115c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.923+0000 7fe143400640 1 -- 172.21.15.82:0/1759138237 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480a96f0 con 0x55ffdba212f0 2024-06-06T02:41:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.923+0000 7fe143400640 1 -- 172.21.15.82:0/1759138237 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1480adaa0 con 0x55ffdba212f0 2024-06-06T02:41:06.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.923+0000 7fe143400640 1 -- 172.21.15.82:0/1759138237 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480b20c0 con 0x55ffdba212f0 2024-06-06T02:41:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.924+0000 7fe1651b5740 1 -- 172.21.15.82:0/1759138237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 msgr2=0x55ffdbdef660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.924+0000 7fe1651b5740 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe1480a6960 tx=0x7fe148010cb0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 -- 172.21.15.82:0/1759138237 shutdown_connections 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba4a1b0 0x55ffdbdff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdf75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 --2- 172.21.15.82:0/1759138237 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba212f0 0x55ffdbdef660 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 -- 172.21.15.82:0/1759138237 >> 172.21.15.82:0/1759138237 conn(0x55ffdba3e300 msgr2=0x55ffdbdf6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 -- 172.21.15.82:0/1759138237 shutdown_connections 2024-06-06T02:41:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.929+0000 7fe1651b5740 1 -- 172.21.15.82:0/1759138237 wait complete. 2024-06-06T02:41:06.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.930+0000 7fe1651b5740 1 -- start start 2024-06-06T02:41:06.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.931+0000 7fe1651b5740 1 Processor -- start 2024-06-06T02:41:06.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.933+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdfcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdfd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe1651b5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe1651b5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe13800cb20 con 0x55ffdba212f0 2024-06-06T02:41:06.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe1651b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe13800df90 con 0x55ffdba294d0 2024-06-06T02:41:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe157e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe157e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36548/0 (socket says 172.21.15.82:36548) 2024-06-06T02:41:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.934+0000 7fe157e00640 1 -- 172.21.15.82:0/2286534216 learned_addr learned my addr 172.21.15.82:0/2286534216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.935+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe13800d1f0 con 0x55ffdba4a1b0 2024-06-06T02:41:06.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.935+0000 7fe1651b5740 10 client.0 _ll_register_callbacks cb 0x7fe14403ee20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.936+0000 7fe157e00640 1 -- 172.21.15.82:0/2286534216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 msgr2=0x55ffdbdfd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.936+0000 7fe157e00640 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdfd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.936+0000 7fe157e00640 1 -- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 msgr2=0x55ffdbdfcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.936+0000 7fe157e00640 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdfcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:06.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.936+0000 7fe157e00640 1 -- 172.21.15.82:0/2286534216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffdbe00160 con 0x55ffdba4a1b0 2024-06-06T02:41:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.937+0000 7fe157e00640 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1500105f0 tx=0x7fe150010ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab6ca7ca27590b9 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:06.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.937+0000 7fe140c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:06.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.939+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15000e980 con 0x55ffdba4a1b0 2024-06-06T02:41:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.939+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe15000eb20 con 0x55ffdba4a1b0 2024-06-06T02:41:06.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.940+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1480adaa0 con 0x55ffdba4a1b0 2024-06-06T02:41:06.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.942+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe15000ed20 con 0x55ffdba4a1b0 2024-06-06T02:41:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.942+0000 7fe1651b5740 10 client.25741 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.942+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffdbe6d530 con 0x55ffdba4a1b0 2024-06-06T02:41:06.943 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.943+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1480adaa0 con 0x55ffdba4a1b0 2024-06-06T02:41:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.944+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe15000f040 con 0x55ffdba4a1b0 2024-06-06T02:41:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 10 client.25741 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:06.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 10 client.25741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 20 client.25741 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdb9de1c0 0x55ffdbe6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 4 client.25741 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:41:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.945+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffdbd5ee70 con 0x55ffdb9de1c0 2024-06-06T02:41:06.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.946+0000 7fe157400640 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdb9de1c0 0x55ffdbe6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.948+0000 7fe157400640 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdb9de1c0 0x55ffdbe6ffb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9e9d32b04d5869 server_cookie=3d5d5b7382c94c21 in_seq=0 out_seq=0 2024-06-06T02:41:06.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:06.948+0000 7fe140c00640 10 client.25741 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:07.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.152+0000 7fe140c00640 1 -- 172.21.15.82:0/2286534216 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffdbd5ee70 con 0x55ffdb9de1c0 2024-06-06T02:41:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.152+0000 7fe140c00640 10 client.25741 handle_command_reply: tid=0 2024-06-06T02:41:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.152+0000 7fe1651b5740 1 client.25741 shutdown 2024-06-06T02:41:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 msgr2=0x55ffdbe6bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:07.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1500105f0 tx=0x7fe150010ab0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 shutdown_connections 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ffdba4a1b0 0x55ffdbe6bf60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ffdba294d0 0x55ffdbdfd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55ffdb9de1c0 0x55ffdbe6ffb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe140c00640 0 client.25741 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:07.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.153+0000 7fe1651b5740 1 --2- 172.21.15.82:0/2286534216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffdba212f0 0x55ffdbdfcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.154+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 >> 172.21.15.82:0/2286534216 conn(0x55ffdba3e300 msgr2=0x55ffdbdef430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.154+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 shutdown_connections 2024-06-06T02:41:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.154+0000 7fe1651b5740 1 -- 172.21.15.82:0/2286534216 wait complete. 2024-06-06T02:41:07.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.155+0000 7fe1651b5740 20 client.25741 trim_cache size 0 max 16384 2024-06-06T02:41:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:41:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:41:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:41:07.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:41:07.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.157+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 msgr2=0x7fe13c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.157+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 0x7fe13c0b4e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55ffdbdeb440 tx=0x7fe14402a4b0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.157+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 msgr2=0x7fe1581a3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.157+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe14800d950 tx=0x7fe14800de10 comp rx=0 tx=0).stop 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 shutdown_connections 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe158111330 0x7fe1581ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe13c0b2920 0x7fe13c0b4e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe15810a290 0x7fe1581a40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 --2- 172.21.15.82:0/594886290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158109940 0x7fe1581a3b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 >> 172.21.15.82:0/594886290 conn(0x7fe15806fbe0 msgr2=0x7fe158072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.158+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 shutdown_connections 2024-06-06T02:41:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:07.159+0000 7fe15e200640 1 -- 172.21.15.82:0/594886290 wait complete. 2024-06-06T02:41:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:08 smithi103 ceph-mon[36349]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 139 MiB/s wr, 17.36k op/s 2024-06-06T02:41:08.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:08 smithi082 ceph-mon[31579]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 139 MiB/s wr, 17.36k op/s 2024-06-06T02:41:08.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:08 smithi184 ceph-mon[36922]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 139 MiB/s wr, 17.36k op/s 2024-06-06T02:41:10.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.045+0000 7f5d3da00640 1 -- 172.21.15.82:0/645034609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38109a10 msgr2=0x7f5d38109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.045+0000 7f5d3da00640 1 --2- 172.21.15.82:0/645034609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38109a10 0x7f5d38109e20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009930 tx=0x7f5d2402a480 comp rx=0 tx=0).stop 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.048+0000 7f5d3da00640 1 -- 172.21.15.82:0/645034609 shutdown_connections 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.048+0000 7f5d3da00640 1 --2- 172.21.15.82:0/645034609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3810a360 0x7f5d38111cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.048+0000 7f5d3da00640 1 --2- 172.21.15.82:0/645034609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d38109a10 0x7f5d38109e20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.048+0000 7f5d3da00640 1 --2- 172.21.15.82:0/645034609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d381054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.048+0000 7f5d3da00640 1 -- 172.21.15.82:0/645034609 >> 172.21.15.82:0/645034609 conn(0x7f5d38100b40 msgr2=0x7f5d38102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.050+0000 7f5d3da00640 1 -- 172.21.15.82:0/645034609 shutdown_connections 2024-06-06T02:41:10.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.050+0000 7f5d3da00640 1 -- 172.21.15.82:0/645034609 wait complete. 2024-06-06T02:41:10.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.055+0000 7f5d3da00640 1 Processor -- start 2024-06-06T02:41:10.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.056+0000 7f5d3da00640 1 -- start start 2024-06-06T02:41:10.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.056+0000 7f5d3da00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.057+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.057+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:36568/0 (socket says 172.21.15.82:36568) 2024-06-06T02:41:10.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.057+0000 7f5d36a00640 1 -- 172.21.15.82:0/1728266833 learned_addr learned my addr 172.21.15.82:0/1728266833 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:10.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.057+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 0x7f5d3806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.057+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3810a360 0x7f5d3806f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.058+0000 7f5d36000640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 0x7f5d3806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.059+0000 7f5d37400640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3810a360 0x7f5d3806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.059+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3806ca80 con 0x7f5d38109a10 2024-06-06T02:41:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.059+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3806c900 con 0x7f5d3810a360 2024-06-06T02:41:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.059+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3806cc00 con 0x7f5d381050e0 2024-06-06T02:41:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36a00640 1 -- 172.21.15.82:0/1728266833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3810a360 msgr2=0x7f5d3806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36a00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3810a360 0x7f5d3806f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36a00640 1 -- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 msgr2=0x7f5d3806ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36a00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 0x7f5d3806ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36a00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d381b0570 con 0x7f5d381050e0 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.060+0000 7f5d36000640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 0x7f5d3806ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.061+0000 7f5d36a00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b450 tx=0x7f5d2800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.061+0000 7f5d2f400640 1 -- 172.21.15.82:0/1728266833 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28015020 con 0x7f5d381050e0 2024-06-06T02:41:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.061+0000 7f5d2f400640 1 -- 172.21.15.82:0/1728266833 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d28011d40 con 0x7f5d381050e0 2024-06-06T02:41:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.061+0000 7f5d2f400640 1 -- 172.21.15.82:0/1728266833 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f340 con 0x7f5d381050e0 2024-06-06T02:41:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.061+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d381b0860 con 0x7f5d381050e0 2024-06-06T02:41:10.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.062+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d381b0d20 con 0x7f5d381050e0 2024-06-06T02:41:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.072+0000 7f5d440b7740 1 Processor -- start 2024-06-06T02:41:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.078+0000 7f5d440b7740 1 -- start start 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d618339e20 con 0x55d617ffe390 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d6183293c0 con 0x55d617ff61b0 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d440b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d61832d400 con 0x55d61801f070 2024-06-06T02:41:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.079+0000 7f5d2f400640 1 -- 172.21.15.82:0/1728266833 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5d28018020 con 0x7f5d381050e0 2024-06-06T02:41:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.080+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.080+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40232/0 (socket says 172.21.15.82:40232) 2024-06-06T02:41:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.080+0000 7f5d36a00640 1 -- 172.21.15.82:0/3742711628 learned_addr learned my addr 172.21.15.82:0/3742711628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.081+0000 7f5d36000640 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.081+0000 7f5d36a00640 1 -- 172.21.15.82:0/3742711628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 msgr2=0x55d6183c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.081+0000 7f5d36a00640 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.082+0000 7f5d36a00640 1 -- 172.21.15.82:0/3742711628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 msgr2=0x55d6183c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.082+0000 7f5d2f400640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 0x7f5d1c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.082+0000 7f5d36a00640 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.082+0000 7f5d2f400640 1 -- 172.21.15.82:0/1728266833 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5d280e1c00 con 0x7f5d381050e0 2024-06-06T02:41:10.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.082+0000 7f5d36a00640 1 -- 172.21.15.82:0/3742711628 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d61808a650 con 0x55d617ff61b0 2024-06-06T02:41:10.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.083+0000 7f5d36a00640 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a91b0 tx=0x7f5d280108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18b206003cd8df server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.084+0000 7f5d23e00640 1 -- 172.21.15.82:0/3742711628 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280a8ff0 con 0x55d617ff61b0 2024-06-06T02:41:10.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.084+0000 7f5d23e00640 1 -- 172.21.15.82:0/3742711628 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d28010eb0 con 0x55d617ff61b0 2024-06-06T02:41:10.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.084+0000 7f5d23e00640 1 -- 172.21.15.82:0/3742711628 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280a8990 con 0x55d617ff61b0 2024-06-06T02:41:10.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.085+0000 7f5d440b7740 1 -- 172.21.15.82:0/3742711628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 msgr2=0x55d6183c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.085+0000 7f5d440b7740 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d280a91b0 tx=0x7f5d280108d0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d37400640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 0x7f5d1c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 -- 172.21.15.82:0/3742711628 shutdown_connections 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183c58c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 --2- 172.21.15.82:0/3742711628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 -- 172.21.15.82:0/3742711628 >> 172.21.15.82:0/3742711628 conn(0x55d618013460 msgr2=0x55d6183c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 -- 172.21.15.82:0/3742711628 shutdown_connections 2024-06-06T02:41:10.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.088+0000 7f5d440b7740 1 -- 172.21.15.82:0/3742711628 wait complete. 2024-06-06T02:41:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.089+0000 7f5d440b7740 1 -- start start 2024-06-06T02:41:10.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.090+0000 7f5d440b7740 1 Processor -- start 2024-06-06T02:41:10.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.092+0000 7f5d37400640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 0x7f5d1c0b4e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55d6183c25a0 tx=0x7f5d30004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.093+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.093+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.093+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d440b7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d61818d700 con 0x55d617ffe390 2024-06-06T02:41:10.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d440b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d6182c6720 con 0x55d61801f070 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d440b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d6183d2430 con 0x55d617ff61b0 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d440b7740 10 client.0 _ll_register_callbacks cb 0x55d6182d2de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d37400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d37400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40244/0 (socket says 172.21.15.82:40244) 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.094+0000 7f5d37400640 1 -- 172.21.15.82:0/100559584 learned_addr learned my addr 172.21.15.82:0/100559584 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d36a00640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 -- 172.21.15.82:0/100559584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 msgr2=0x55d6183d8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 -- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 msgr2=0x55d6183d8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 -- 172.21.15.82:0/100559584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6182f1fd0 con 0x55d61801f070 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d37400640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d30010010 tx=0x7f5d30007520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c433f0c04b39313e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.095+0000 7f5d20c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:41:10.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.096+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3001be50 con 0x55d61801f070 2024-06-06T02:41:10.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.096+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5d3001bc50 con 0x55d61801f070 2024-06-06T02:41:10.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.096+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d61833bd70 con 0x55d61801f070 2024-06-06T02:41:10.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.096+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d30026480 con 0x55d61801f070 2024-06-06T02:41:10.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.096+0000 7f5d440b7740 10 client.25715 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:10.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.097+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d6183e6df0 con 0x55d61801f070 2024-06-06T02:41:10.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.097+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d61833bd70 con 0x55d61801f070 2024-06-06T02:41:10.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.097+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d3001d5d0 con 0x55d61801f070 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.097+0000 7f5d440b7740 10 client.25715 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.097+0000 7f5d440b7740 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.098+0000 7f5d440b7740 20 client.25715 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.098+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fdd9f0 0x55d6183ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.098+0000 7f5d440b7740 4 client.25715 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.098+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d618337810 con 0x55d617fdd9f0 2024-06-06T02:41:10.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.103+0000 7f5d36a00640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fdd9f0 0x55d6183ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.104+0000 7f5d36a00640 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fdd9f0 0x55d6183ea3e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2198f4b77b71494e server_cookie=fc3a5ea6c752a622 in_seq=0 out_seq=0 2024-06-06T02:41:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.104+0000 7f5d20c00640 10 client.25715 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.105+0000 7f5d20c00640 1 -- 172.21.15.82:0/100559584 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d618337810 con 0x55d617fdd9f0 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.105+0000 7f5d20c00640 10 client.25715 handle_command_reply: tid=0 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 client.25715 shutdown 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 msgr2=0x55d6183dcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d30010010 tx=0x7f5d30007520 comp rx=0 tx=0).stop 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 shutdown_connections 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d61801f070 0x55d6183dcdf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fdd9f0 0x55d6183ea3e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d20c00640 0 client.25715 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183d8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 --2- 172.21.15.82:0/100559584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.106+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 >> 172.21.15.82:0/100559584 conn(0x55d618013460 msgr2=0x55d6183c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.107+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 shutdown_connections 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.108+0000 7f5d440b7740 1 -- 172.21.15.82:0/100559584 wait complete. 2024-06-06T02:41:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.108+0000 7f5d440b7740 20 client.25715 trim_cache size 0 max 16384 2024-06-06T02:41:10.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.147+0000 7f5d440b7740 1 Processor -- start 2024-06-06T02:41:10.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.147+0000 7f5d440b7740 1 -- start start 2024-06-06T02:41:10.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 0x55d6183dcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b7820 con 0x55d61801f070 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b50f0 con 0x55d617ffe390 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d440b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b2f40 con 0x55d617ff61b0 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d36000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d36000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40246/0 (socket says 172.21.15.82:40246) 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.148+0000 7f5d36000640 1 -- 172.21.15.82:0/2769489398 learned_addr learned my addr 172.21.15.82:0/2769489398 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:10.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.149+0000 7f5d37400640 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 0x55d6183dcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.149+0000 7f5d36000640 1 -- 172.21.15.82:0/2769489398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 msgr2=0x55d6183d19c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.150+0000 7f5d36000640 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.150+0000 7f5d36000640 1 -- 172.21.15.82:0/2769489398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 msgr2=0x55d6183dcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.150+0000 7f5d36000640 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 0x55d6183dcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.150+0000 7f5d36000640 1 -- 172.21.15.82:0/2769489398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6183bd2e0 con 0x55d617ffe390 2024-06-06T02:41:10.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.150+0000 7f5d37400640 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 0x55d6183dcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:10.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.151+0000 7f5d36000640 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006010 tx=0x7f5d24004310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854727b0efe3606b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.152+0000 7f5d23400640 1 -- 172.21.15.82:0/2769489398 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24035040 con 0x55d617ffe390 2024-06-06T02:41:10.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.152+0000 7f5d23400640 1 -- 172.21.15.82:0/2769489398 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d240054b0 con 0x55d617ffe390 2024-06-06T02:41:10.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.152+0000 7f5d23400640 1 -- 172.21.15.82:0/2769489398 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24003850 con 0x55d617ffe390 2024-06-06T02:41:10.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.154+0000 7f5d440b7740 1 -- 172.21.15.82:0/2769489398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 msgr2=0x55d6183c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.154+0000 7f5d440b7740 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5d24006010 tx=0x7f5d24004310 comp rx=0 tx=0).stop 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 -- 172.21.15.82:0/2769489398 shutdown_connections 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d61801f070 0x55d6183dcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ffe390 0x55d6183c7630 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 --2- 172.21.15.82:0/2769489398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d617ff61b0 0x55d6183d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 -- 172.21.15.82:0/2769489398 >> 172.21.15.82:0/2769489398 conn(0x55d618013460 msgr2=0x55d6183c6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 -- 172.21.15.82:0/2769489398 shutdown_connections 2024-06-06T02:41:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.155+0000 7f5d440b7740 1 -- 172.21.15.82:0/2769489398 wait complete. 2024-06-06T02:41:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.156+0000 7f5d440b7740 1 -- start start 2024-06-06T02:41:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.156+0000 7f5d440b7740 1 Processor -- start 2024-06-06T02:41:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183e4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d440b7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183ef740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183e4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d36a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183e4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40258/0 (socket says 172.21.15.82:40258) 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d36a00640 1 -- 172.21.15.82:0/1341538718 learned_addr learned my addr 172.21.15.82:0/1341538718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.158+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183efc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d37400640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b35b0 con 0x55d617ffe390 2024-06-06T02:41:10.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b4a20 con 0x55d617ff61b0 2024-06-06T02:41:10.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b3c80 con 0x55d61801f070 2024-06-06T02:41:10.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d440b7740 10 client.0 _ll_register_callbacks cb 0x7f5d30007a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.159+0000 7f5d36000640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d37400640 1 -- 172.21.15.82:0/1341538718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 msgr2=0x55d6183e4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d37400640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183e4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d37400640 1 -- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 msgr2=0x55d6183ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d37400640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183ef740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d37400640 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6183f0240 con 0x55d61801f070 2024-06-06T02:41:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.160+0000 7f5d36000640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:41:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.161+0000 7f5d20c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.161+0000 7f5d37400640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183efc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d3001dbe0 tx=0x7f5d3001d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2fba5af029d78a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30035040 con 0x55d61801f070 2024-06-06T02:41:10.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f5d30026620 con 0x55d61801f070 2024-06-06T02:41:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d240054b0 con 0x55d61801f070 2024-06-06T02:41:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d300107d0 con 0x55d61801f070 2024-06-06T02:41:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d440b7740 10 client.25750 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:10.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.162+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d6183e3290 con 0x55d61801f070 2024-06-06T02:41:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.163+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d240054b0 con 0x55d61801f070 2024-06-06T02:41:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.163+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d30005550 con 0x55d61801f070 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 10 client.25750 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 20 client.25750 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fb2da0 0x55d618455170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 4 client.25750 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.164+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d618334f50 con 0x55d617fb2da0 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.165+0000 7f5d36a00640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fb2da0 0x55d618455170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.166+0000 7f5d20c00640 10 client.25750 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.166+0000 7f5d36a00640 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fb2da0 0x55d618455170 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71928f4153adaa2d server_cookie=46b6dd570420cf48 in_seq=0 out_seq=0 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.166+0000 7f5d20c00640 1 -- 172.21.15.82:0/1341538718 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d618334f50 con 0x55d617fb2da0 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.166+0000 7f5d20c00640 10 client.25750 handle_command_reply: tid=0 2024-06-06T02:41:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.167+0000 7f5d440b7740 1 client.25750 shutdown 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.167+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 msgr2=0x55d6183efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.167+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183efc80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d3001dbe0 tx=0x7f5d3001d750 comp rx=0 tx=0).stop 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 shutdown_connections 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d61801f070 0x55d6183efc80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d617fb2da0 0x55d618455170 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d617ffe390 0x55d6183ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 --2- 172.21.15.82:0/1341538718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d617ff61b0 0x55d6183e4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 >> 172.21.15.82:0/1341538718 conn(0x55d618013460 msgr2=0x55d6183c5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d20c00640 0 client.25750 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 shutdown_connections 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 1 -- 172.21.15.82:0/1341538718 wait complete. 2024-06-06T02:41:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.168+0000 7f5d440b7740 20 client.25750 trim_cache size 0 max 16384 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.169+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 msgr2=0x7f5d1c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.169+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 0x7f5d1c0b4e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55d6183c25a0 tx=0x7f5d30004a40 comp rx=0 tx=0).stop 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.169+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 msgr2=0x7f5d3806e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.169+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800b450 tx=0x7f5d2800b910 comp rx=0 tx=0).stop 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 shutdown_connections 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5d3810a360 0x7f5d3806f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d38109a10 0x7f5d3806ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f5d1c0b2980 0x7f5d1c0b4e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 --2- 172.21.15.82:0/1728266833 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d381050e0 0x7f5d3806e6d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.172+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 >> 172.21.15.82:0/1728266833 conn(0x7f5d38100b40 msgr2=0x7f5d38101230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:10.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.173+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 shutdown_connections 2024-06-06T02:41:10.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:10.173+0000 7f5d3da00640 1 -- 172.21.15.82:0/1728266833 wait complete. 2024-06-06T02:41:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:10 smithi103 ceph-mon[36349]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 146 MiB/s wr, 17.97k op/s 2024-06-06T02:41:10.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:10 smithi082 ceph-mon[31579]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 146 MiB/s wr, 17.97k op/s 2024-06-06T02:41:10.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:10 smithi184 ceph-mon[36922]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 146 MiB/s wr, 17.97k op/s 2024-06-06T02:41:12.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T02:41:12.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:41:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:12 smithi103 ceph-mon[36349]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 153 MiB/s wr, 18.62k op/s 2024-06-06T02:41:12.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:12 smithi082 ceph-mon[31579]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 153 MiB/s wr, 18.62k op/s 2024-06-06T02:41:12.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:12 smithi184 ceph-mon[36922]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 153 MiB/s wr, 18.62k op/s 2024-06-06T02:41:13.109 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:41:14.809 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:14 smithi082 ceph-mon[31579]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 145 MiB/s wr, 17.82k op/s 2024-06-06T02:41:14.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:14 smithi184 ceph-mon[36922]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 145 MiB/s wr, 17.82k op/s 2024-06-06T02:41:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:14 smithi103 ceph-mon[36349]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 145 MiB/s wr, 17.82k op/s 2024-06-06T02:41:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:16 smithi184 ceph-mon[36922]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 152 MiB/s wr, 19.53k op/s 2024-06-06T02:41:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:16 smithi103 ceph-mon[36349]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 152 MiB/s wr, 19.53k op/s 2024-06-06T02:41:17.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:16 smithi082 ceph-mon[31579]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 152 MiB/s wr, 19.53k op/s 2024-06-06T02:41:18.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:18 smithi184 ceph-mon[36922]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 128 MiB/s wr, 16.73k op/s 2024-06-06T02:41:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:18 smithi103 ceph-mon[36349]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 128 MiB/s wr, 16.73k op/s 2024-06-06T02:41:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:18 smithi082 ceph-mon[31579]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 128 MiB/s wr, 16.73k op/s 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 -- 172.21.15.82:0/3619305930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac109840 msgr2=0x7f0fac111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 --2- 172.21.15.82:0/3619305930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac109840 0x7f0fac111550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009ca0 tx=0x7f0fa402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 -- 172.21.15.82:0/3619305930 shutdown_connections 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 --2- 172.21.15.82:0/3619305930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac109840 0x7f0fac111550 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 --2- 172.21.15.82:0/3619305930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac108dc0 0x7f0fac1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 --2- 172.21.15.82:0/3619305930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 0x7f0fac10ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 -- 172.21.15.82:0/3619305930 >> 172.21.15.82:0/3619305930 conn(0x7f0fac0783f0 msgr2=0x7f0fac107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 -- 172.21.15.82:0/3619305930 shutdown_connections 2024-06-06T02:41:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.527+0000 7f0fb3000640 1 -- 172.21.15.82:0/3619305930 wait complete. 2024-06-06T02:41:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.529+0000 7f0fb3000640 1 Processor -- start 2024-06-06T02:41:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 -- start start 2024-06-06T02:41:20.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 0x7f0fac19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 0x7f0fac19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 0x7f0fac1a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac114e70 con 0x7f0fac109840 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac114cf0 con 0x7f0fac108dc0 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.530+0000 7f0fb3000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac114ff0 con 0x7f0fac10a820 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.531+0000 7f0fabe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 0x7f0fac19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.531+0000 7f0fabe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 0x7f0fac19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51110/0 (socket says 172.21.15.82:51110) 2024-06-06T02:41:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.531+0000 7f0fabe00640 1 -- 172.21.15.82:0/152057138 learned_addr learned my addr 172.21.15.82:0/152057138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.531+0000 7f0fb1000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 0x7f0fac1a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.531+0000 7f0fab400640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 0x7f0fac19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.532+0000 7f0fab400640 1 -- 172.21.15.82:0/152057138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 msgr2=0x7f0fac1a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.532+0000 7f0fab400640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 0x7f0fac1a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.532+0000 7f0fab400640 1 -- 172.21.15.82:0/152057138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 msgr2=0x7f0fac19f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.532+0000 7f0fab400640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 0x7f0fac19f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.532+0000 7f0fab400640 1 -- 172.21.15.82:0/152057138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac1a72e0 con 0x7f0fac109840 2024-06-06T02:41:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.533+0000 7f0fab400640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 0x7f0fac19fce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e9f0 tx=0x7f0f9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.534+0000 7f0fa8c00640 1 -- 172.21.15.82:0/152057138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800ccc0 con 0x7f0fac109840 2024-06-06T02:41:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.534+0000 7f0fa8c00640 1 -- 172.21.15.82:0/152057138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f980108e0 con 0x7f0fac109840 2024-06-06T02:41:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.534+0000 7f0fa8c00640 1 -- 172.21.15.82:0/152057138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98018880 con 0x7f0fac109840 2024-06-06T02:41:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.535+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac1a75d0 con 0x7f0fac109840 2024-06-06T02:41:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.535+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac1a7ad0 con 0x7f0fac109840 2024-06-06T02:41:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.541+0000 7f0fb9ff6740 1 Processor -- start 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.541+0000 7f0fb9ff6740 1 -- start start 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.541+0000 7f0fa8c00640 1 -- 172.21.15.82:0/152057138 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0f98010430 con 0x7f0fac109840 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a592f0 0x563819e27240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e2e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563819d99480 con 0x563819a614d0 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563819d88a20 con 0x563819a592f0 2024-06-06T02:41:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563819d8ca60 con 0x563819a821b0 2024-06-06T02:41:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb1000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb1000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51788/0 (socket says 172.21.15.82:51788) 2024-06-06T02:41:20.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.542+0000 7f0fb1000640 1 -- 172.21.15.82:0/3006897446 learned_addr learned my addr 172.21.15.82:0/3006897446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.543+0000 7f0fb1000640 1 -- 172.21.15.82:0/3006897446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a592f0 msgr2=0x563819e27240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:41:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.543+0000 7f0fb1000640 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a592f0 0x563819e27240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.543+0000 7f0fb1000640 1 -- 172.21.15.82:0/3006897446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 msgr2=0x563819e2e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.543+0000 7f0fb1000640 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.543+0000 7f0fb1000640 1 -- 172.21.15.82:0/3006897446 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563819d858d0 con 0x563819a821b0 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.545+0000 7f0fa8c00640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 0x7f0f900b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.545+0000 7f0fb1000640 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009ca0 tx=0x7f0fa40010f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec73a1d9854ea5e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.546+0000 7f0fa8c00640 1 -- 172.21.15.82:0/152057138 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0f980e2600 con 0x7f0fac109840 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.546+0000 7f0fabe00640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 0x7f0f900b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.546+0000 7f0fa1600640 1 -- 172.21.15.82:0/3006897446 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4031450 con 0x563819a821b0 2024-06-06T02:41:20.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.546+0000 7f0fa1600640 1 -- 172.21.15.82:0/3006897446 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa4036030 con 0x563819a821b0 2024-06-06T02:41:20.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.546+0000 7f0fa1600640 1 -- 172.21.15.82:0/3006897446 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4031450 con 0x563819a821b0 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.548+0000 7f0fabe00640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 0x7f0f900b4ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563819e27db0 tx=0x7f0f9c00a300 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.549+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3006897446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 msgr2=0x563819e26d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.549+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009ca0 tx=0x7f0fa40010f0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.550+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3006897446 shutdown_connections 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.550+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e2e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.550+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a592f0 0x563819e27240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.550+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3006897446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a821b0 0x563819e26d00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.550+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3006897446 >> 172.21.15.82:0/3006897446 conn(0x563819a76300 msgr2=0x563819e226b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:20.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.551+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3006897446 shutdown_connections 2024-06-06T02:41:20.551 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.551+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3006897446 wait complete. 2024-06-06T02:41:20.551 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.552+0000 7f0fb9ff6740 1 -- start start 2024-06-06T02:41:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.554+0000 7f0fb9ff6740 1 Processor -- start 2024-06-06T02:41:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e41340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e48770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563819cc3ab0 con 0x563819a821b0 2024-06-06T02:41:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563819d26630 con 0x563819a614d0 2024-06-06T02:41:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x563819e3f900 con 0x563819a592f0 2024-06-06T02:41:20.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.555+0000 7f0fb9ff6740 10 client.0 _ll_register_callbacks cb 0x563819d2c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.556+0000 7f0fb1000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e48770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.557+0000 7f0fab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.557+0000 7f0fab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51132/0 (socket says 172.21.15.82:51132) 2024-06-06T02:41:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.557+0000 7f0fab400640 1 -- 172.21.15.82:0/484121332 learned_addr learned my addr 172.21.15.82:0/484121332 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:20.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.557+0000 7f0fabe00640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e41340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fab400640 1 -- 172.21.15.82:0/484121332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 msgr2=0x563819e41340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fab400640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e41340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fab400640 1 -- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 msgr2=0x563819e48770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fab400640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e48770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fab400640 1 -- 172.21.15.82:0/484121332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563819d53170 con 0x563819a614d0 2024-06-06T02:41:20.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.559+0000 7f0fabe00640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e41340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.560+0000 7f0fab400640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f980a5c60 tx=0x7f0f98010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b559928b41e48609 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.560+0000 7f0f96000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:41:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.562+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f980aa2e0 con 0x563819a614d0 2024-06-06T02:41:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.562+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0f980a8e40 con 0x563819a614d0 2024-06-06T02:41:20.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.562+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fa4036030 con 0x563819a614d0 2024-06-06T02:41:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.563+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0f980c3070 con 0x563819a614d0 2024-06-06T02:41:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.563+0000 7f0fb9ff6740 10 client.25730 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:20.562 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.563+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563819aed790 con 0x563819a614d0 2024-06-06T02:41:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.563+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa4036030 con 0x563819a614d0 2024-06-06T02:41:20.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.564+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0f980e20b0 con 0x563819a614d0 2024-06-06T02:41:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.565+0000 7f0fb9ff6740 10 client.25730 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.565+0000 7f0fb9ff6740 10 client.25730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.566+0000 7f0fb9ff6740 20 client.25730 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.566+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a40d80 0x563819e4ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.566+0000 7f0fb9ff6740 4 client.25730 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.566+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563819d9b3d0 con 0x563819a40d80 2024-06-06T02:41:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.568+0000 7f0fabe00640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a40d80 0x563819e4ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.570+0000 7f0f96000640 10 client.25730 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.570+0000 7f0fabe00640 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a40d80 0x563819e4ea20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04058463fc90e65 server_cookie=9dc70b5d765c8ee9 in_seq=0 out_seq=0 2024-06-06T02:41:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.573+0000 7f0f96000640 1 -- 172.21.15.82:0/484121332 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563819d9b3d0 con 0x563819a40d80 2024-06-06T02:41:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.573+0000 7f0f96000640 10 client.25730 handle_command_reply: tid=0 2024-06-06T02:41:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.573+0000 7f0fb9ff6740 1 client.25730 shutdown 2024-06-06T02:41:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 msgr2=0x563819e41880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f980a5c60 tx=0x7f0f98010860 comp rx=0 tx=0).stop 2024-06-06T02:41:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 shutdown_connections 2024-06-06T02:41:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a40d80 0x563819e4ea20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e48770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e41880 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/484121332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e41340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0f96000640 0 client.25730 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.574+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 >> 172.21.15.82:0/484121332 conn(0x563819a76300 msgr2=0x563819e235b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.575+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 shutdown_connections 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.575+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/484121332 wait complete. 2024-06-06T02:41:20.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.576+0000 7f0fb9ff6740 20 client.25730 trim_cache size 0 max 16384 2024-06-06T02:41:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.627+0000 7f0fb9ff6740 1 Processor -- start 2024-06-06T02:41:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.627+0000 7f0fb9ff6740 1 -- start start 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.627+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.627+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e2a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac1aaa70 con 0x563819a821b0 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac1a8340 con 0x563819a614d0 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac072cd0 con 0x563819a592f0 2024-06-06T02:41:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fabe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51148/0 (socket says 172.21.15.82:51148) 2024-06-06T02:41:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.628+0000 7f0fab400640 1 -- 172.21.15.82:0/3202532546 learned_addr learned my addr 172.21.15.82:0/3202532546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.629+0000 7f0fb1000640 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e2a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fabe00640 1 -- 172.21.15.82:0/3202532546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 msgr2=0x563819e48700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fabe00640 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fabe00640 1 -- 172.21.15.82:0/3202532546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 msgr2=0x563819e2a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fabe00640 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e2a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fabe00640 1 -- 172.21.15.82:0/3202532546 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563819b66620 con 0x563819a592f0 2024-06-06T02:41:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.630+0000 7f0fab400640 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.631+0000 7f0fabe00640 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e23b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563819e4f0f0 tx=0x7f0f9c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2545b9cd743d4c7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.631+0000 7f0fa0c00640 1 -- 172.21.15.82:0/3202532546 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c016070 con 0x563819a592f0 2024-06-06T02:41:20.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.632+0000 7f0fa0c00640 1 -- 172.21.15.82:0/3202532546 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f9c0054d0 con 0x563819a592f0 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.632+0000 7f0fa0c00640 1 -- 172.21.15.82:0/3202532546 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c030470 con 0x563819a592f0 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.633+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3202532546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 msgr2=0x563819e23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.633+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e23b80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x563819e4f0f0 tx=0x7f0f9c012000 comp rx=0 tx=0).stop 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.633+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3202532546 shutdown_connections 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.633+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a821b0 0x563819e2a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.634+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a614d0 0x563819e48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.634+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/3202532546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e23b80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.634+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3202532546 >> 172.21.15.82:0/3202532546 conn(0x563819a76300 msgr2=0x563819e23470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.634+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3202532546 shutdown_connections 2024-06-06T02:41:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.634+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/3202532546 wait complete. 2024-06-06T02:41:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.635+0000 7f0fb9ff6740 1 -- start start 2024-06-06T02:41:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.636+0000 7f0fb9ff6740 1 Processor -- start 2024-06-06T02:41:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.636+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0733a0 con 0x563819a614d0 2024-06-06T02:41:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac074810 con 0x563819a821b0 2024-06-06T02:41:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac073a70 con 0x563819a592f0 2024-06-06T02:41:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb9ff6740 10 client.0 _ll_register_callbacks cb 0x7f0f980a95c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:20.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fb1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51156/0 (socket says 172.21.15.82:51156) 2024-06-06T02:41:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.637+0000 7f0fabe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fabe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51824/0 (socket says 172.21.15.82:51824) 2024-06-06T02:41:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fabe00640 1 -- 172.21.15.82:0/2554316421 learned_addr learned my addr 172.21.15.82:0/2554316421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:20.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fab400640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fb1000640 1 -- 172.21.15.82:0/2554316421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 msgr2=0x563819e454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fb1000640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e454b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fb1000640 1 -- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 msgr2=0x563819e459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fb1000640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.640+0000 7f0fb1000640 1 -- 172.21.15.82:0/2554316421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563819e48970 con 0x563819a821b0 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.641+0000 7f0fb1000640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005e30 tx=0x7f0fa402b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e2078c3535233d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:20.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.641+0000 7f0f96000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:41:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.641+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4054070 con 0x563819a821b0 2024-06-06T02:41:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.642+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f9c0054d0 con 0x563819a821b0 2024-06-06T02:41:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.642+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0fa4004040 con 0x563819a821b0 2024-06-06T02:41:20.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.642+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0fa404a040 con 0x563819a821b0 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.642+0000 7f0fb9ff6740 10 client.25736 fetch_fsmap learned FSMap version 27 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.642+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563819eb6610 con 0x563819a821b0 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0fa4036040 con 0x563819a821b0 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0fa4043070 con 0x563819a821b0 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 10 client.25736 fetch_fsmap finished waiting for FSMap version 27 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 10 client.25736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:20.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 20 client.25736 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a161c0 0x563819eb8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 4 client.25736 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.643+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0f9c0054d0 con 0x563819a161c0 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.644+0000 7f0fabe00640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a161c0 0x563819eb8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.646+0000 7f0fabe00640 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a161c0 0x563819eb8cf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728f6b8b017ef4ef server_cookie=32ec81623e938582 in_seq=0 out_seq=0 2024-06-06T02:41:20.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:20.647+0000 7f0f96000640 10 client.25736 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:20.926 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:20 smithi082 ceph-mon[31579]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 122 MiB/s wr, 15.83k op/s 2024-06-06T02:41:21.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:20 smithi103 ceph-mon[36349]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 122 MiB/s wr, 15.83k op/s 2024-06-06T02:41:21.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:20 smithi184 ceph-mon[36922]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 122 MiB/s wr, 15.83k op/s 2024-06-06T02:41:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.467+0000 7f0f96000640 1 -- 172.21.15.82:0/2554316421 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0f9c0054d0 con 0x563819a161c0 2024-06-06T02:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.467+0000 7f0f96000640 10 client.25736 handle_command_reply: tid=0 2024-06-06T02:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.467+0000 7f0fb9ff6740 1 client.25736 shutdown 2024-06-06T02:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 msgr2=0x563819eb5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005e30 tx=0x7f0fa402b040 comp rx=0 tx=0).stop 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 shutdown_connections 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563819a821b0 0x563819eb5140 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x563819a161c0 0x563819eb8cf0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563819a614d0 0x563819e459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 --2- 172.21.15.82:0/2554316421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563819a592f0 0x563819e454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 >> 172.21.15.82:0/2554316421 conn(0x563819a76300 msgr2=0x563819e2aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.468+0000 7f0f96000640 0 client.25736 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.469+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 shutdown_connections 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.469+0000 7f0fb9ff6740 1 -- 172.21.15.82:0/2554316421 wait complete. 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.469+0000 7f0fb9ff6740 20 client.25736 trim_cache size 0 max 16384 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:41:21.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:41:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:41:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:41:21.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.471+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 msgr2=0x7f0f900b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.471+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 0x7f0f900b4ec0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563819e27db0 tx=0x7f0f9c00a300 comp rx=0 tx=0).stop 2024-06-06T02:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.471+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 msgr2=0x7f0fac19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.471+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 0x7f0fac19fce0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e9f0 tx=0x7f0f9800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 shutdown_connections 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0f900b29b0 0x7f0f900b4ec0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac10a820 0x7f0fac1a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fac109840 0x7f0fac19fce0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 --2- 172.21.15.82:0/152057138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fac108dc0 0x7f0fac19f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.472+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 >> 172.21.15.82:0/152057138 conn(0x7f0fac0783f0 msgr2=0x7f0fac10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:21.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.473+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 shutdown_connections 2024-06-06T02:41:21.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:21.473+0000 7f0fb3000640 1 -- 172.21.15.82:0/152057138 wait complete. 2024-06-06T02:41:21.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.592+0000 7f9649c00640 1 -- 172.21.15.82:0/741155263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96441050f0 msgr2=0x7f9644105500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.592+0000 7f9649c00640 1 --2- 172.21.15.82:0/741155263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96441050f0 0x7f9644105500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f963c009c10 tx=0x7f963c02a720 comp rx=0 tx=0).stop 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 -- 172.21.15.82:0/741155263 shutdown_connections 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 --2- 172.21.15.82:0/741155263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f964410a370 0x7f9644111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 --2- 172.21.15.82:0/741155263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f9644109e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 --2- 172.21.15.82:0/741155263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96441050f0 0x7f9644105500 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 -- 172.21.15.82:0/741155263 >> 172.21.15.82:0/741155263 conn(0x7f9644100b70 msgr2=0x7f9644102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:21.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.593+0000 7f9649c00640 1 -- 172.21.15.82:0/741155263 shutdown_connections 2024-06-06T02:41:21.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.594+0000 7f9649c00640 1 -- 172.21.15.82:0/741155263 wait complete. 2024-06-06T02:41:21.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.595+0000 7f9649c00640 1 Processor -- start 2024-06-06T02:41:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.597+0000 7f9649c00640 1 -- start start 2024-06-06T02:41:21.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.597+0000 7f9649c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 0x7f964410f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.597+0000 7f9649c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:21.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9649c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 0x7f964410fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9642000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9642000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51180/0 (socket says 172.21.15.82:51180) 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9643400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 0x7f964410fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9643400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 0x7f964410fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:51840/0 (socket says 172.21.15.82:51840) 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.598+0000 7f9642a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 0x7f964410f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 0x7f964410f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33226/0 (socket says 172.21.15.82:33226) 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 -- 172.21.15.82:0/1588292581 learned_addr learned my addr 172.21.15.82:0/1588292581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:21.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96441150e0 con 0x7f96441050f0 2024-06-06T02:41:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9644114f60 con 0x7f9644109a20 2024-06-06T02:41:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9644115260 con 0x7f964410a370 2024-06-06T02:41:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 -- 172.21.15.82:0/1588292581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 msgr2=0x7f964410fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 0x7f964410fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 -- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 msgr2=0x7f964410f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:21.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 0x7f964410f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:21.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.599+0000 7f9642000640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96441ac0b0 con 0x7f9644109a20 2024-06-06T02:41:21.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.600+0000 7f9642000640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f963000e9f0 tx=0x7f963000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:21.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.600+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000ccc0 con 0x7f9644109a20 2024-06-06T02:41:21.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.601+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96300108e0 con 0x7f9644109a20 2024-06-06T02:41:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.602+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96441ac3a0 con 0x7f9644109a20 2024-06-06T02:41:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.603+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96441ac930 con 0x7f9644109a20 2024-06-06T02:41:21.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.603+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96300187e0 con 0x7f9644109a20 2024-06-06T02:41:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.607+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9624005290 con 0x7f9644109a20 2024-06-06T02:41:21.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.611+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9630010430 con 0x7f9644109a20 2024-06-06T02:41:21.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.613+0000 7f963b400640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 0x7f96280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:21.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.614+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f96300e2490 con 0x7f9644109a20 2024-06-06T02:41:21.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.614+0000 7f9642a00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 0x7f96280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.618+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f96300aa1b0 con 0x7f9644109a20 2024-06-06T02:41:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:21.620+0000 7f9642a00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 0x7f96280b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099a0 tx=0x7f963c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:22.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.102+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9624005580 con 0x7f9644109a20 2024-06-06T02:41:22.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.103+0000 7f963b400640 1 -- 172.21.15.82:0/1588292581 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11872 (secure 0 0 0) 0x7f96300a9ab0 con 0x7f9644109a20 2024-06-06T02:41:22.103 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:41:22.103 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:39:12.567026+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:41:22.104 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2024-06-06T02:41:22.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.106+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 msgr2=0x7f96280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:22.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.106+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 0x7f96280b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f963c0099a0 tx=0x7f963c000f40 comp rx=0 tx=0).stop 2024-06-06T02:41:22.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.106+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 msgr2=0x7f964410f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:22.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.106+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f963000e9f0 tx=0x7f963000edf0 comp rx=0 tx=0).stop 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 shutdown_connections 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f96280b28b0 0x7f96280b4dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f964410a370 0x7f964410fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9644109a20 0x7f964410f740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 --2- 172.21.15.82:0/1588292581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96441050f0 0x7f964410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 >> 172.21.15.82:0/1588292581 conn(0x7f9644100b70 msgr2=0x7f9644102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 shutdown_connections 2024-06-06T02:41:22.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:22.110+0000 7f9649c00640 1 -- 172.21.15.82:0/1588292581 wait complete. 2024-06-06T02:41:23.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:22 smithi103 ceph-mon[36349]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 141 MiB/s wr, 18.58k op/s 2024-06-06T02:41:23.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:22 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1588292581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:41:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:22 smithi082 ceph-mon[31579]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 141 MiB/s wr, 18.58k op/s 2024-06-06T02:41:23.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:22 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1588292581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:41:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:22 smithi184 ceph-mon[36922]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 141 MiB/s wr, 18.58k op/s 2024-06-06T02:41:23.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:22 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1588292581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:41:23.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T02:41:24.085 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:41:24.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:23 smithi103 ceph-mon[36349]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 124 MiB/s wr, 16.59k op/s 2024-06-06T02:41:24.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:23 smithi082 ceph-mon[31579]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 124 MiB/s wr, 16.59k op/s 2024-06-06T02:41:24.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:23 smithi184 ceph-mon[36922]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 124 MiB/s wr, 16.59k op/s 2024-06-06T02:41:26.302 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:26 smithi082 ceph-mon[31579]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 131 MiB/s wr, 17.59k op/s 2024-06-06T02:41:26.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:26 smithi103 ceph-mon[36349]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 131 MiB/s wr, 17.59k op/s 2024-06-06T02:41:26.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:26 smithi184 ceph-mon[36922]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 131 MiB/s wr, 17.59k op/s 2024-06-06T02:41:28.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:28 smithi103 ceph-mon[36349]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 MiB/s wr, 15.73k op/s 2024-06-06T02:41:28.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:28 smithi082 ceph-mon[31579]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 MiB/s wr, 15.73k op/s 2024-06-06T02:41:28.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:28 smithi184 ceph-mon[36922]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 118 MiB/s wr, 15.73k op/s 2024-06-06T02:41:30.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:30 smithi103 ceph-mon[36349]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 111 MiB/s wr, 14.98k op/s 2024-06-06T02:41:30.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:30 smithi082 ceph-mon[31579]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 111 MiB/s wr, 14.98k op/s 2024-06-06T02:41:30.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:30 smithi184 ceph-mon[36922]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 111 MiB/s wr, 14.98k op/s 2024-06-06T02:41:32.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:32 smithi103 ceph-mon[36349]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 135 MiB/s wr, 18.60k op/s 2024-06-06T02:41:32.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:32 smithi082 ceph-mon[31579]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 135 MiB/s wr, 18.60k op/s 2024-06-06T02:41:32.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:32 smithi184 ceph-mon[36922]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 135 MiB/s wr, 18.60k op/s 2024-06-06T02:41:33.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:33 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:41:33.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:33 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:41:33.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:33 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:41:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:34 smithi103 ceph-mon[36349]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 107 MiB/s wr, 15.27k op/s 2024-06-06T02:41:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:34 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:34.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:34 smithi082 ceph-mon[31579]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 107 MiB/s wr, 15.27k op/s 2024-06-06T02:41:34.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:34 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:34 smithi184 ceph-mon[36922]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 107 MiB/s wr, 15.27k op/s 2024-06-06T02:41:34.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:34 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.834+0000 7f6be6600640 1 -- 172.21.15.82:0/1986412041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 msgr2=0x7f6be0119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.834+0000 7f6be6600640 1 --2- 172.21.15.82:0/1986412041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be0119f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009be0 tx=0x7f6bd802a770 comp rx=0 tx=0).stop 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 -- 172.21.15.82:0/1986412041 shutdown_connections 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 --2- 172.21.15.82:0/1986412041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be0119f30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 --2- 172.21.15.82:0/1986412041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be010c2a0 0x7f6be010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 --2- 172.21.15.82:0/1986412041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be0109940 0x7f6be010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 -- 172.21.15.82:0/1986412041 >> 172.21.15.82:0/1986412041 conn(0x7f6be006fbe0 msgr2=0x7f6be0072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 -- 172.21.15.82:0/1986412041 shutdown_connections 2024-06-06T02:41:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.835+0000 7f6be6600640 1 -- 172.21.15.82:0/1986412041 wait complete. 2024-06-06T02:41:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.837+0000 7f6be6600640 1 Processor -- start 2024-06-06T02:41:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.837+0000 7f6be6600640 1 -- start start 2024-06-06T02:41:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0109940 0x7f6be0116c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 0x7f6be0117140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be011d510 con 0x7f6be0109940 2024-06-06T02:41:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6be011d390 con 0x7f6be010ee40 2024-06-06T02:41:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6be6600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6be011d690 con 0x7f6be010c2a0 2024-06-06T02:41:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34934/0 (socket says 172.21.15.82:34934) 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6bdfe00640 1 -- 172.21.15.82:0/4214783057 learned_addr learned my addr 172.21.15.82:0/4214783057 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6bdf400640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0109940 0x7f6be0116c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.839+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 0x7f6be0117140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdfe00640 1 -- 172.21.15.82:0/4214783057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 msgr2=0x7f6be0117140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 0x7f6be0117140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdfe00640 1 -- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0109940 msgr2=0x7f6be0116c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0109940 0x7f6be0116c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdfe00640 1 -- 172.21.15.82:0/4214783057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be0118710 con 0x7f6be010ee40 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.840+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 0x7f6be0117140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.841+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009b30 tx=0x7f6bd8030d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.842+0000 7f6bd7e00640 1 -- 172.21.15.82:0/4214783057 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8041020 con 0x7f6be010ee40 2024-06-06T02:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.847+0000 7f6bd7e00640 1 -- 172.21.15.82:0/4214783057 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd80318f0 con 0x7f6be010ee40 2024-06-06T02:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.847+0000 7f6bd7e00640 1 -- 172.21.15.82:0/4214783057 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8036040 con 0x7f6be010ee40 2024-06-06T02:41:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.849+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01189a0 con 0x7f6be010ee40 2024-06-06T02:41:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.849+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be0118e40 con 0x7f6be010ee40 2024-06-06T02:41:34.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.855+0000 7f6bd7e00640 1 -- 172.21.15.82:0/4214783057 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f6bd8044020 con 0x7f6be010ee40 2024-06-06T02:41:34.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.858+0000 7f6bed5ec740 1 Processor -- start 2024-06-06T02:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.859+0000 7f6bd7e00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 0x7f6bc40b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.859+0000 7f6bd7e00640 1 -- 172.21.15.82:0/4214783057 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6bd8102b80 con 0x7f6be010ee40 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 -- start start 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11941fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119427100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d119392480 con 0x55d11907b1b0 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d119381a20 con 0x55d11905a4d0 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.860+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d119385a60 con 0x55d1190522f0 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119427100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:55446/0 (socket says 172.21.15.82:55446) 2024-06-06T02:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 -- 172.21.15.82:0/4100555975 learned_addr learned my addr 172.21.15.82:0/4100555975 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119427100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34940/0 (socket says 172.21.15.82:34940) 2024-06-06T02:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdf400640 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11941fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 -- 172.21.15.82:0/4100555975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 msgr2=0x55d119427100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119427100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 -- 172.21.15.82:0/4100555975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 msgr2=0x55d11941fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11941fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 -- 172.21.15.82:0/4100555975 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d11937e8d0 con 0x55d1190522f0 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.861+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000aa40 tx=0x7f6bd000af00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7fd0c730cbf132 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.862+0000 7f6bd4c00640 1 -- 172.21.15.82:0/4100555975 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000fb40 con 0x55d1190522f0 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.862+0000 7f6bd4c00640 1 -- 172.21.15.82:0/4100555975 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd0018070 con 0x55d1190522f0 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.862+0000 7f6bd4c00640 1 -- 172.21.15.82:0/4100555975 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00125c0 con 0x55d1190522f0 2024-06-06T02:41:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.862+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 0x7f6bc40b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.864+0000 7f6bed5ec740 1 -- 172.21.15.82:0/4100555975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 msgr2=0x55d119420240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.864+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000aa40 tx=0x7f6bd000af00 comp rx=0 tx=0).stop 2024-06-06T02:41:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.864+0000 7f6bdea00640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 0x7f6bc40b4df0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0013fd0 tx=0x7f6bd0013e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.866+0000 7f6bed5ec740 1 -- 172.21.15.82:0/4100555975 shutdown_connections 2024-06-06T02:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119427100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119420240 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/4100555975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11941fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 -- 172.21.15.82:0/4100555975 >> 172.21.15.82:0/4100555975 conn(0x55d11906f300 msgr2=0x55d11941b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 -- 172.21.15.82:0/4100555975 shutdown_connections 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.867+0000 7f6bed5ec740 1 -- 172.21.15.82:0/4100555975 wait complete. 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.868+0000 7f6bed5ec740 1 -- start start 2024-06-06T02:41:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.868+0000 7f6bed5ec740 1 Processor -- start 2024-06-06T02:41:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119429410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119429950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d1192bcab0 con 0x55d11907b1b0 2024-06-06T02:41:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d11931f630 con 0x55d11905a4d0 2024-06-06T02:41:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.869+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d119427ad0 con 0x55d1190522f0 2024-06-06T02:41:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.870+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.870+0000 7f6bed5ec740 10 client.0 _ll_register_callbacks cb 0x55d119325610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.871+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55074/0 (socket says 172.21.15.82:55074) 2024-06-06T02:41:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.871+0000 7f6bdfe00640 1 -- 172.21.15.82:0/1339602541 learned_addr learned my addr 172.21.15.82:0/1339602541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.871+0000 7f6bdf400640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119429410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.871+0000 7f6bdea00640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119429950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.871+0000 7f6bdf400640 1 -- 172.21.15.82:0/1339602541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 msgr2=0x55d119429950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.872+0000 7f6bdf400640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119429950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.872+0000 7f6bdf400640 1 -- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 msgr2=0x55d119430840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.872+0000 7f6bdf400640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.872+0000 7f6bdf400640 1 -- 172.21.15.82:0/1339602541 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d11934c170 con 0x55d1190522f0 2024-06-06T02:41:34.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.872+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:34.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.874+0000 7f6bdf400640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119429410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6be00747c0 tx=0x7f6bcc010810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71443cc4a910e31 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.874+0000 7f6bc9600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc005220 con 0x55d1190522f0 2024-06-06T02:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6bcc0053c0 con 0x55d1190522f0 2024-06-06T02:41:34.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd0018070 con 0x55d1190522f0 2024-06-06T02:41:34.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bcc0055c0 con 0x55d1190522f0 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bed5ec740 10 client.25783 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d1190e6790 con 0x55d1190522f0 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.875+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd0018070 con 0x55d1190522f0 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7f6bcc00f040 con 0x55d1190522f0 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 10 client.25783 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 10 client.25783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 20 client.25783 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d119039d80 0x55d119436ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 4 client.25783 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1193943d0 con 0x55d119039d80 2024-06-06T02:41:34.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.876+0000 7f6bdea00640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d119039d80 0x55d119436ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.878+0000 7f6bc9600640 10 client.25783 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:34.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.878+0000 7f6bdea00640 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d119039d80 0x55d119436ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24856a52d42d278 server_cookie=c6037b4105173f64 in_seq=0 out_seq=0 2024-06-06T02:41:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.880+0000 7f6bc9600640 1 -- 172.21.15.82:0/1339602541 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d1193943d0 con 0x55d119039d80 2024-06-06T02:41:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.880+0000 7f6bc9600640 10 client.25783 handle_command_reply: tid=0 2024-06-06T02:41:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.880+0000 7f6bed5ec740 1 client.25783 shutdown 2024-06-06T02:41:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.881+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 msgr2=0x55d119429410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.881+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119429410 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6be00747c0 tx=0x7f6bcc010810 comp rx=0 tx=0).stop 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 shutdown_connections 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d119039d80 0x55d119436ca0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d119430840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d119429950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1339602541 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119429410 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 >> 172.21.15.82:0/1339602541 conn(0x55d11906f300 msgr2=0x55d11941c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bc9600640 0 client.25783 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 shutdown_connections 2024-06-06T02:41:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1339602541 wait complete. 2024-06-06T02:41:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.883+0000 7f6bed5ec740 20 client.25783 trim_cache size 0 max 16384 2024-06-06T02:41:34.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 Processor -- start 2024-06-06T02:41:34.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 -- start start 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d11941b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11905a4d0 0x55d1194307d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01c4200 con 0x55d11905a4d0 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01c1ad0 con 0x55d11907b1b0 2024-06-06T02:41:34.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.926+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01bf900 con 0x55d1190522f0 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34962/0 (socket says 172.21.15.82:34962) 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 -- 172.21.15.82:0/1159965081 learned_addr learned my addr 172.21.15.82:0/1159965081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 -- 172.21.15.82:0/1159965081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 msgr2=0x55d11941b750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d11941b750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.927+0000 7f6bdfe00640 1 -- 172.21.15.82:0/1159965081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11905a4d0 msgr2=0x55d1194307d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:41:34.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.928+0000 7f6bdea00640 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11905a4d0 0x55d1194307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.928+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11905a4d0 0x55d1194307d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.928+0000 7f6bdfe00640 1 -- 172.21.15.82:0/1159965081 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d11915f620 con 0x55d11907b1b0 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.928+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006010 tx=0x7f6bd80ca920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd69636bae59d0c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.928+0000 7f6bcbe00640 1 -- 172.21.15.82:0/1159965081 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80d2fc0 con 0x55d11907b1b0 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.929+0000 7f6bcbe00640 1 -- 172.21.15.82:0/1159965081 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd80ce0b0 con 0x55d11907b1b0 2024-06-06T02:41:34.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.929+0000 7f6bcbe00640 1 -- 172.21.15.82:0/1159965081 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8003b70 con 0x55d11907b1b0 2024-06-06T02:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1159965081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 msgr2=0x55d119430d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:34.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006010 tx=0x7f6bd80ca920 comp rx=0 tx=0).stop 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1159965081 shutdown_connections 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11907b1b0 0x55d119430d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11905a4d0 0x55d1194307d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/1159965081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d11941b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1159965081 >> 172.21.15.82:0/1159965081 conn(0x55d11906f300 msgr2=0x55d11941b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:34.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1159965081 shutdown_connections 2024-06-06T02:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.931+0000 7f6bed5ec740 1 -- 172.21.15.82:0/1159965081 wait complete. 2024-06-06T02:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.932+0000 7f6bed5ec740 1 -- start start 2024-06-06T02:41:34.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.932+0000 7f6bed5ec740 1 Processor -- start 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119430b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11942dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01bff90 con 0x55d11907b1b0 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01c1400 con 0x55d11905a4d0 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01c0660 con 0x55d1190522f0 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bed5ec740 10 client.0 _ll_register_callbacks cb 0x7f6bcc00ec60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bdea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bdea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34978/0 (socket says 172.21.15.82:34978) 2024-06-06T02:41:34.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.934+0000 7f6bdea00640 1 -- 172.21.15.82:0/446546881 learned_addr learned my addr 172.21.15.82:0/446546881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdea00640 1 -- 172.21.15.82:0/446546881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 msgr2=0x55d119430b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdea00640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119430b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdea00640 1 -- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 msgr2=0x55d11942dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdfe00640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11942dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdea00640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11942dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:34.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.935+0000 7f6bdea00640 1 -- 172.21.15.82:0/446546881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d11949d460 con 0x55d11905a4d0 2024-06-06T02:41:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.937+0000 7f6bdea00640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6bd001dcd0 tx=0x7f6bd0012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c8357b353e61a4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:34.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.937+0000 7f6bc9600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:41:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.938+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0012560 con 0x55d11905a4d0 2024-06-06T02:41:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.940+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6bd0012b70 con 0x55d11905a4d0 2024-06-06T02:41:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.940+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd80ce0b0 con 0x55d11905a4d0 2024-06-06T02:41:34.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.940+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bd0012d70 con 0x55d11905a4d0 2024-06-06T02:41:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.940+0000 7f6bed5ec740 10 client.25760 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:34.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.940+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d11949e6c0 con 0x55d11905a4d0 2024-06-06T02:41:34.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.941+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd80ce0b0 con 0x55d11905a4d0 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7f6bd003d050 con 0x55d11905a4d0 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 10 client.25760 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 10 client.25760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 20 client.25760 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d11900f1c0 0x55d1194a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:34.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 4 client.25760 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:41:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.944+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d11938fe70 con 0x55d11900f1c0 2024-06-06T02:41:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.945+0000 7f6bdf400640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d11900f1c0 0x55d1194a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.946+0000 7f6bdf400640 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d11900f1c0 0x55d1194a0ef0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=838e547bdc61f0af server_cookie=24c866402e40f787 in_seq=0 out_seq=0 2024-06-06T02:41:34.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:34.946+0000 7f6bc9600640 10 client.25760 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:35.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.042+0000 7f6bc9600640 1 -- 172.21.15.82:0/446546881 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d11938fe70 con 0x55d11900f1c0 2024-06-06T02:41:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.042+0000 7f6bc9600640 10 client.25760 handle_command_reply: tid=0 2024-06-06T02:41:35.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.042+0000 7f6bed5ec740 1 client.25760 shutdown 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 msgr2=0x55d11942d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6bd001dcd0 tx=0x7f6bd0012820 comp rx=0 tx=0).stop 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 shutdown_connections 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d11900f1c0 0x55d1194a0ef0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d11907b1b0 0x55d11942dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d11905a4d0 0x55d11942d700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 --2- 172.21.15.82:0/446546881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d1190522f0 0x55d119430b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bc9600640 0 client.25760 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 >> 172.21.15.82:0/446546881 conn(0x55d11906f300 msgr2=0x55d119422df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 shutdown_connections 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.043+0000 7f6bed5ec740 1 -- 172.21.15.82:0/446546881 wait complete. 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.044+0000 7f6bed5ec740 20 client.25760 trim_cache size 0 max 16384 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:41:35.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:41:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:41:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:41:35.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.045+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 msgr2=0x7f6bc40b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.045+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 0x7f6bc40b4df0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0013fd0 tx=0x7f6bd0013e40 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.045+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 msgr2=0x7f6be01180a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.045+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009b30 tx=0x7f6bd8030d70 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 shutdown_connections 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6be010ee40 0x7f6be01180a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f6bc40b28e0 0x7f6bc40b4df0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6be010c2a0 0x7f6be0117140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 --2- 172.21.15.82:0/4214783057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0109940 0x7f6be0116c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 >> 172.21.15.82:0/4214783057 conn(0x7f6be006fbe0 msgr2=0x7f6be010a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.046+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 shutdown_connections 2024-06-06T02:41:35.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:35.047+0000 7f6be6600640 1 -- 172.21.15.82:0/4214783057 wait complete. 2024-06-06T02:41:35.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:41:35.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:41:35.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:41:35.375 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:41:35.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:41:35.376 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:41:35.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:41:35.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:41:35.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:41:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:36 smithi184 ceph-mon[36922]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 111 MiB/s wr, 15.95k op/s 2024-06-06T02:41:37.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:36 smithi103 ceph-mon[36349]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 111 MiB/s wr, 15.95k op/s 2024-06-06T02:41:37.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:36 smithi082 ceph-mon[31579]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 111 MiB/s wr, 15.95k op/s 2024-06-06T02:41:39.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:38 smithi103 ceph-mon[36349]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 97 MiB/s wr, 13.97k op/s 2024-06-06T02:41:39.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:38 smithi082 ceph-mon[31579]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 97 MiB/s wr, 13.97k op/s 2024-06-06T02:41:39.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:38 smithi184 ceph-mon[36922]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 97 MiB/s wr, 13.97k op/s 2024-06-06T02:41:40.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:39 smithi103 ceph-mon[36349]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 81 MiB/s wr, 11.82k op/s 2024-06-06T02:41:40.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:39 smithi082 ceph-mon[31579]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 81 MiB/s wr, 11.82k op/s 2024-06-06T02:41:40.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:39 smithi184 ceph-mon[36922]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 81 MiB/s wr, 11.82k op/s 2024-06-06T02:41:42.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:42 smithi103 ceph-mon[36349]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 MiB/s wr, 14.82k op/s 2024-06-06T02:41:42.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:42 smithi082 ceph-mon[31579]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 MiB/s wr, 14.82k op/s 2024-06-06T02:41:42.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:42 smithi184 ceph-mon[36922]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 99 MiB/s wr, 14.82k op/s 2024-06-06T02:41:44.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:44 smithi103 ceph-mon[36349]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 85 MiB/s wr, 12.99k op/s 2024-06-06T02:41:44.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:44 smithi082 ceph-mon[31579]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 85 MiB/s wr, 12.99k op/s 2024-06-06T02:41:44.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:44 smithi184 ceph-mon[36922]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 85 MiB/s wr, 12.99k op/s 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.225+0000 7fe034800640 1 -- 172.21.15.82:0/1327397140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c1024a0 msgr2=0x7fe02c1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.226+0000 7fe034800640 1 --2- 172.21.15.82:0/1327397140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c1024a0 0x7fe02c1069d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009930 tx=0x7fe01c02a4d0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.226+0000 7fe034800640 1 -- 172.21.15.82:0/1327397140 shutdown_connections 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 --2- 172.21.15.82:0/1327397140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c106f90 0x7fe02c107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 --2- 172.21.15.82:0/1327397140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c1024a0 0x7fe02c1069d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 --2- 172.21.15.82:0/1327397140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c101b50 0x7fe02c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 -- 172.21.15.82:0/1327397140 >> 172.21.15.82:0/1327397140 conn(0x7fe02c078a80 msgr2=0x7fe02c078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 -- 172.21.15.82:0/1327397140 shutdown_connections 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.227+0000 7fe034800640 1 -- 172.21.15.82:0/1327397140 wait complete. 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.231+0000 7fe034800640 1 Processor -- start 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.232+0000 7fe034800640 1 -- start start 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.233+0000 7fe034800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.233+0000 7fe034800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 0x7fe02c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.233+0000 7fe031e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.234+0000 7fe031e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38056/0 (socket says 172.21.15.82:38056) 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.235+0000 7fe031e00640 1 -- 172.21.15.82:0/250898450 learned_addr learned my addr 172.21.15.82:0/250898450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.235+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 0x7fe02c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.235+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1194d0 con 0x7fe02c1024a0 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.236+0000 7fe032800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 0x7fe02c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.236+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c119350 con 0x7fe02c106f90 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.237+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c119650 con 0x7fe02c101b50 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.237+0000 7fe031400640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 0x7fe02c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.238+0000 7fe032800640 1 -- 172.21.15.82:0/250898450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 msgr2=0x7fe02c074230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.238+0000 7fe032800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.238+0000 7fe032800640 1 -- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 msgr2=0x7fe02c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.238+0000 7fe032800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 0x7fe02c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.238+0000 7fe032800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c06e0c0 con 0x7fe02c106f90 2024-06-06T02:41:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.239+0000 7fe031e00640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.239+0000 7fe031400640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 0x7fe02c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.239+0000 7fe032800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 0x7fe02c06d8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe02800be20 tx=0x7fe02800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.240+0000 7fe026a00640 1 -- 172.21.15.82:0/250898450 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028019070 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.240+0000 7fe026a00640 1 -- 172.21.15.82:0/250898450 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0280148f0 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.240+0000 7fe026a00640 1 -- 172.21.15.82:0/250898450 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe028012840 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.240+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c071d60 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.240+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c0722a0 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.250+0000 7fe03aecf740 1 Processor -- start 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.251+0000 7fe026a00640 1 -- 172.21.15.82:0/250898450 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe02801c070 con 0x7fe02c106f90 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.253+0000 7fe026a00640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 0x7fe0140b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.254+0000 7fe03aecf740 1 -- start start 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe031400640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 0x7fe0140b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb81f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb4501b0 0x55baeb81f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55baeb793de0 con 0x55baeb479070 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55baeb783380 con 0x55baeb4501b0 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.255+0000 7fe03aecf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55baeb7873c0 con 0x55baeb458390 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.257+0000 7fe031e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb81f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.257+0000 7fe026a00640 1 -- 172.21.15.82:0/250898450 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe0280a5680 con 0x7fe02c106f90 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.257+0000 7fe032800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.257+0000 7fe032800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38072/0 (socket says 172.21.15.82:38072) 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.257+0000 7fe032800640 1 -- 172.21.15.82:0/4046312711 learned_addr learned my addr 172.21.15.82:0/4046312711 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.258+0000 7fe032800640 1 -- 172.21.15.82:0/4046312711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb4501b0 msgr2=0x55baeb81f880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:41:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.258+0000 7fe032800640 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb4501b0 0x55baeb81f880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.258+0000 7fe032800640 1 -- 172.21.15.82:0/4046312711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 msgr2=0x55baeb81f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.259+0000 7fe032800640 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb81f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.259+0000 7fe032800640 1 -- 172.21.15.82:0/4046312711 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baeb4e4650 con 0x55baeb458390 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.259+0000 7fe031e00640 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb81f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.260+0000 7fe032800640 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0280a5bc0 tx=0x7fe0280b06a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3198c2a981c5b7ab server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.260+0000 7fe01b400640 1 -- 172.21.15.82:0/4046312711 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280a5880 con 0x55baeb458390 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.261+0000 7fe01b400640 1 -- 172.21.15.82:0/4046312711 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0280ad390 con 0x55baeb458390 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 -- 172.21.15.82:0/4046312711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 msgr2=0x55baeb81fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0280a5bc0 tx=0x7fe0280b06a0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 -- 172.21.15.82:0/4046312711 shutdown_connections 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb458390 0x55baeb81fdc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb4501b0 0x55baeb81f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 --2- 172.21.15.82:0/4046312711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb81f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.262+0000 7fe03aecf740 1 -- 172.21.15.82:0/4046312711 >> 172.21.15.82:0/4046312711 conn(0x55baeb46d460 msgr2=0x55baeb81bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.263+0000 7fe031400640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 0x7fe0140b4d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005f70 tx=0x7fe01c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.263+0000 7fe03aecf740 1 -- 172.21.15.82:0/4046312711 shutdown_connections 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.263+0000 7fe03aecf740 1 -- 172.21.15.82:0/4046312711 wait complete. 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.264+0000 7fe03aecf740 1 -- start start 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.264+0000 7fe03aecf740 1 Processor -- start 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.265+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 0x55baeb829980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.265+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 0x55baeb829ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.266+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.266+0000 7fe031e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 0x55baeb829980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.266+0000 7fe032800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.266+0000 7fe032800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38082/0 (socket says 172.21.15.82:38082) 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe032800640 1 -- 172.21.15.82:0/3071325534 learned_addr learned my addr 172.21.15.82:0/3071325534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe031400640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 0x55baeb829ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55baeb5e7700 con 0x55baeb4501b0 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55baeb7206e0 con 0x55baeb458390 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55baeb82c410 con 0x55baeb479070 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.267+0000 7fe03aecf740 10 client.0 _ll_register_callbacks cb 0x55baeb72cda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.268+0000 7fe032800640 1 -- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 msgr2=0x55baeb829ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.268+0000 7fe032800640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 0x55baeb829ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.268+0000 7fe032800640 1 -- 172.21.15.82:0/3071325534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 msgr2=0x55baeb829980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.269+0000 7fe032800640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 0x55baeb829980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.269+0000 7fe032800640 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baeb74bf90 con 0x55baeb479070 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.270+0000 7fe031400640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 0x55baeb829ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.270+0000 7fe031e00640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 0x55baeb829980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe032800640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0280a5f30 tx=0x7fe02800cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f99059c701d23fd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe00fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0280c7030 con 0x55baeb479070 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0280ad390 con 0x55baeb479070 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe0280a4d80 con 0x55baeb479070 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.271+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0280a5a20 con 0x55baeb479070 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.272+0000 7fe03aecf740 10 client.25792 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:46.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.272+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baeb838480 con 0x55baeb479070 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.273+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0280ad390 con 0x55baeb479070 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7fe0280a82f0 con 0x55baeb479070 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 10 client.25792 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 10 client.25792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 20 client.25792 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb4379f0 0x55baeb83b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 4 client.25792 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.274+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baeb795d30 con 0x55baeb4379f0 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.276+0000 7fe031e00640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb4379f0 0x55baeb83b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.277+0000 7fe00fe00640 10 client.25792 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.279+0000 7fe031e00640 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb4379f0 0x55baeb83b7e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85144054d4c829f9 server_cookie=b561f5808ef47fe3 in_seq=0 out_seq=0 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.281+0000 7fe00fe00640 1 -- 172.21.15.82:0/3071325534 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55baeb795d30 con 0x55baeb4379f0 2024-06-06T02:41:46.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.281+0000 7fe00fe00640 10 client.25792 handle_command_reply: tid=0 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.281+0000 7fe03aecf740 1 client.25792 shutdown 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.281+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 msgr2=0x55baeb82f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.281+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe0280a5f30 tx=0x7fe02800cf70 comp rx=0 tx=0).stop 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 shutdown_connections 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb4379f0 0x55baeb83b7e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb479070 0x55baeb82f760 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb458390 0x55baeb829ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3071325534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb4501b0 0x55baeb829980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 >> 172.21.15.82:0/3071325534 conn(0x55baeb46d460 msgr2=0x55baeb81f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe00fe00640 0 client.25792 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:41:46.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 shutdown_connections 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 1 -- 172.21.15.82:0/3071325534 wait complete. 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.282+0000 7fe03aecf740 20 client.25792 trim_cache size 0 max 16384 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.301+0000 7fe03aecf740 1 Processor -- start 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.301+0000 7fe03aecf740 1 -- start start 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb82b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb479070 0x55baeb81b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bfee0 con 0x55baeb458390 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bd7b0 con 0x55baeb479070 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe03aecf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bb5e0 con 0x55baeb4501b0 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe031400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe031400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57480/0 (socket says 172.21.15.82:57480) 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe031400640 1 -- 172.21.15.82:0/2518336547 learned_addr learned my addr 172.21.15.82:0/2518336547 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.302+0000 7fe031e00640 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb82b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe032800640 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb479070 0x55baeb81b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 -- 172.21.15.82:0/2518336547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 msgr2=0x55baeb82b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb82b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 -- 172.21.15.82:0/2518336547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb479070 msgr2=0x55baeb81b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb479070 0x55baeb81b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 -- 172.21.15.82:0/2518336547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baeb81cbd0 con 0x55baeb458390 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.303+0000 7fe031400640 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009930 tx=0x7fe01c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf6e20b610d0d63 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.304+0000 7fe01aa00640 1 -- 172.21.15.82:0/2518336547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c035050 con 0x55baeb458390 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.304+0000 7fe01aa00640 1 -- 172.21.15.82:0/2518336547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe01c04d070 con 0x55baeb458390 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.304+0000 7fe01aa00640 1 -- 172.21.15.82:0/2518336547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c048a30 con 0x55baeb458390 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.305+0000 7fe03aecf740 1 -- 172.21.15.82:0/2518336547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 msgr2=0x55baeb823f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.305+0000 7fe03aecf740 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009930 tx=0x7fe01c03b000 comp rx=0 tx=0).stop 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 -- 172.21.15.82:0/2518336547 shutdown_connections 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb479070 0x55baeb81b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb458390 0x55baeb823f90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 --2- 172.21.15.82:0/2518336547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb82b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 -- 172.21.15.82:0/2518336547 >> 172.21.15.82:0/2518336547 conn(0x55baeb46d460 msgr2=0x55baeb8288e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 -- 172.21.15.82:0/2518336547 shutdown_connections 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.306+0000 7fe03aecf740 1 -- 172.21.15.82:0/2518336547 wait complete. 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.307+0000 7fe03aecf740 1 -- start start 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.308+0000 7fe03aecf740 1 Processor -- start 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.310+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.310+0000 7fe03aecf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb833360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.311+0000 7fe031e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.311+0000 7fe031e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38100/0 (socket says 172.21.15.82:38100) 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.311+0000 7fe031e00640 1 -- 172.21.15.82:0/3082517825 learned_addr learned my addr 172.21.15.82:0/3082517825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.312+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb40cda0 0x55baeb833940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.312+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bbc70 con 0x55baeb479070 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.312+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bd0e0 con 0x55baeb40cda0 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.312+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c1bc340 con 0x55baeb4501b0 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.313+0000 7fe03aecf740 10 client.0 _ll_register_callbacks cb 0x7fe028017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.313+0000 7fe031400640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb833360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.314+0000 7fe031e00640 1 -- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb40cda0 msgr2=0x55baeb833940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.314+0000 7fe031e00640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb40cda0 0x55baeb833940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.314+0000 7fe031e00640 1 -- 172.21.15.82:0/3082517825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 msgr2=0x55baeb833360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.315+0000 7fe031e00640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb833360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.315+0000 7fe031e00640 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baeb834120 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.316+0000 7fe031400640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb833360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.318+0000 7fe031e00640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe020000c00 tx=0x7fe020010c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5254e159bbdb8d11 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.318+0000 7fe00fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.323+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02000fd00 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.323+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe020027440 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.323+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe01c04d070 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.325+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe02000fea0 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.328+0000 7fe03aecf740 10 client.25798 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.328+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baeb8a3d50 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.328+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe01c04d070 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.332+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7fe020025020 con 0x55baeb4501b0 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 10 client.25798 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 10 client.25798 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:41:46.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 20 client.25798 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:46.140 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:41:46.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb8a4420 0x55baeb8a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:46.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 4 client.25798 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:41:46.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.333+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55baeb7917d0 con 0x55baeb8a4420 2024-06-06T02:41:46.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.334+0000 7fe031400640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb8a4420 0x55baeb8a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.336+0000 7fe031400640 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb8a4420 0x55baeb8a6840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=92f155cef8ae1d1b server_cookie=4bc3626e61da53c1 in_seq=0 out_seq=0 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.336+0000 7fe00fe00640 10 client.25798 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.337+0000 7fe00fe00640 1 -- 172.21.15.82:0/3082517825 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55baeb7917d0 con 0x55baeb8a4420 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.337+0000 7fe00fe00640 10 client.25798 handle_command_reply: tid=0 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.337+0000 7fe03aecf740 1 client.25798 shutdown 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 msgr2=0x55baeb836030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe020000c00 tx=0x7fe020010c00 comp rx=0 tx=0).stop 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 shutdown_connections 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x55baeb8a4420 0x55baeb8a6840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55baeb40cda0 0x55baeb833940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55baeb479070 0x55baeb833360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 --2- 172.21.15.82:0/3082517825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55baeb4501b0 0x55baeb836030 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 >> 172.21.15.82:0/3082517825 conn(0x55baeb46d460 msgr2=0x55baeb822f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.338+0000 7fe00fe00640 0 client.25798 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.339+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 shutdown_connections 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.339+0000 7fe03aecf740 1 -- 172.21.15.82:0/3082517825 wait complete. 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.339+0000 7fe03aecf740 20 client.25798 trim_cache size 0 max 16384 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.341+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 msgr2=0x7fe0140b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.341+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 0x7fe0140b4d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005f70 tx=0x7fe01c00b040 comp rx=0 tx=0).stop 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.341+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 msgr2=0x7fe02c06d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.341+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 0x7fe02c06d8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe02800be20 tx=0x7fe02800bf10 comp rx=0 tx=0).stop 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.341+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 shutdown_connections 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe02c106f90 0x7fe02c06d8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe02c1024a0 0x7fe02c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe0140b2870 0x7fe0140b4d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 --2- 172.21.15.82:0/250898450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe02c101b50 0x7fe02c074230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:46.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 >> 172.21.15.82:0/250898450 conn(0x7fe02c078a80 msgr2=0x7fe02c104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:46.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 shutdown_connections 2024-06-06T02:41:46.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:41:43.342+0000 7fe034800640 1 -- 172.21.15.82:0/250898450 wait complete. 2024-06-06T02:41:46.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:46 smithi103 ceph-mon[36349]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 90 MiB/s wr, 13.66k op/s 2024-06-06T02:41:46.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:46 smithi082 ceph-mon[31579]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 90 MiB/s wr, 13.66k op/s 2024-06-06T02:41:46.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:46 smithi184 ceph-mon[36922]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 90 MiB/s wr, 13.66k op/s 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.338+0000 7f6038200640 1 -- 172.21.15.82:0/1857087428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030102b90 msgr2=0x7f6030102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.338+0000 7f6038200640 1 --2- 172.21.15.82:0/1857087428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030102b90 0x7f6030102fa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6024009900 tx=0x7f602402a400 comp rx=0 tx=0).stop 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 -- 172.21.15.82:0/1857087428 shutdown_connections 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 --2- 172.21.15.82:0/1857087428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030104600 0x7f603010af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 --2- 172.21.15.82:0/1857087428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030103cb0 0x7f60301040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 --2- 172.21.15.82:0/1857087428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030102b90 0x7f6030102fa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 -- 172.21.15.82:0/1857087428 >> 172.21.15.82:0/1857087428 conn(0x7f60300fe390 msgr2=0x7f6030100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.339+0000 7f6038200640 1 -- 172.21.15.82:0/1857087428 shutdown_connections 2024-06-06T02:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.340+0000 7f6038200640 1 -- 172.21.15.82:0/1857087428 wait complete. 2024-06-06T02:41:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.341+0000 7f6038200640 1 Processor -- start 2024-06-06T02:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.344+0000 7f6038200640 1 -- start start 2024-06-06T02:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.345+0000 7f6038200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030102b90 0x7f60301971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6038200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030103cb0 0x7f60301976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6038200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6038200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f603010e750 con 0x7f6030103cb0 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6038200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f603010e5d0 con 0x7f6030102b90 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6038200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f603010e8d0 con 0x7f6030104600 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6036200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6036200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38120/0 (socket says 172.21.15.82:38120) 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.346+0000 7f6036200640 1 -- 172.21.15.82:0/143080455 learned_addr learned my addr 172.21.15.82:0/143080455 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6035800640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030102b90 0x7f60301971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6036200640 1 -- 172.21.15.82:0/143080455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030102b90 msgr2=0x7f60301971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6036200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030102b90 0x7f60301971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6036200640 1 -- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030103cb0 msgr2=0x7f60301976e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6036200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030103cb0 0x7f60301976e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.347+0000 7f6036200640 1 -- 172.21.15.82:0/143080455 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603019ac10 con 0x7f6030104600 2024-06-06T02:41:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.348+0000 7f6036200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f602800b970 tx=0x7f602800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.348+0000 7f602e000640 1 -- 172.21.15.82:0/143080455 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028019070 con 0x7f6030104600 2024-06-06T02:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.348+0000 7f602e000640 1 -- 172.21.15.82:0/143080455 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6028014440 con 0x7f6030104600 2024-06-06T02:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.349+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603019af00 con 0x7f6030104600 2024-06-06T02:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.349+0000 7f602e000640 1 -- 172.21.15.82:0/143080455 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280075b0 con 0x7f6030104600 2024-06-06T02:41:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.349+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603019b480 con 0x7f6030104600 2024-06-06T02:41:48.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:48 smithi103 ceph-mon[36349]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 MiB/s wr, 13.63k op/s 2024-06-06T02:41:48.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:48 smithi082 ceph-mon[31579]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 MiB/s wr, 13.63k op/s 2024-06-06T02:41:48.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:48 smithi184 ceph-mon[36922]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 MiB/s wr, 13.63k op/s 2024-06-06T02:41:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.412+0000 7f602e000640 1 -- 172.21.15.82:0/143080455 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f602801c070 con 0x7f6030104600 2024-06-06T02:41:48.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.422+0000 7f602e000640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 0x7f60180b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.423+0000 7f602e000640 1 -- 172.21.15.82:0/143080455 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f60280e17e0 con 0x7f6030104600 2024-06-06T02:41:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.423+0000 7f6035800640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 0x7f60180b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.426+0000 7f603f1fb740 1 Processor -- start 2024-06-06T02:41:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.426+0000 7f6035800640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 0x7f60180b4df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6024031440 tx=0x7f60240314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.426+0000 7f603f1fb740 1 -- start start 2024-06-06T02:41:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b73bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b73c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.427 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55992b6ae480 con 0x55992b36e2f0 2024-06-06T02:41:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55992b69da20 con 0x55992b3971b0 2024-06-06T02:41:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f603f1fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55992b6a1a60 con 0x55992b3764d0 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f6036200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f6036200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38126/0 (socket says 172.21.15.82:38126) 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f6036200640 1 -- 172.21.15.82:0/4143993547 learned_addr learned my addr 172.21.15.82:0/4143993547 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f6034e00640 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b73c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.427+0000 7f6035800640 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b73bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 -- 172.21.15.82:0/4143993547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 msgr2=0x55992b73bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b73bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 -- 172.21.15.82:0/4143993547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 msgr2=0x55992b73c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b73c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 -- 172.21.15.82:0/4143993547 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992b69a8d0 con 0x55992b3764d0 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6036200640 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60280a4ef0 tx=0x7f6028004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9856adfae418235c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6022a00640 1 -- 172.21.15.82:0/4143993547 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280b1c20 con 0x55992b3764d0 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6022a00640 1 -- 172.21.15.82:0/4143993547 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60280df3b0 con 0x55992b3764d0 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.428+0000 7f6022a00640 1 -- 172.21.15.82:0/4143993547 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60280a80d0 con 0x55992b3764d0 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 -- 172.21.15.82:0/4143993547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 msgr2=0x55992b743100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f60280a4ef0 tx=0x7f6028004a40 comp rx=0 tx=0).stop 2024-06-06T02:41:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 -- 172.21.15.82:0/4143993547 shutdown_connections 2024-06-06T02:41:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b743100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b73c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 --2- 172.21.15.82:0/4143993547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b73bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.430+0000 7f603f1fb740 1 -- 172.21.15.82:0/4143993547 >> 172.21.15.82:0/4143993547 conn(0x55992b38b300 msgr2=0x55992b7376b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.431+0000 7f603f1fb740 1 -- 172.21.15.82:0/4143993547 shutdown_connections 2024-06-06T02:41:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.431+0000 7f603f1fb740 1 -- 172.21.15.82:0/4143993547 wait complete. 2024-06-06T02:41:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.432+0000 7f603f1fb740 1 -- start start 2024-06-06T02:41:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.432+0000 7f603f1fb740 1 Processor -- start 2024-06-06T02:41:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b3764d0 0x55992b7459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55992b5d8ab0 con 0x55992b3764d0 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55992b63b630 con 0x55992b3971b0 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55992b743ad0 con 0x55992b36e2f0 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f603f1fb740 10 client.0 _ll_register_callbacks cb 0x55992b641610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f6035800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f6035800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38138/0 (socket says 172.21.15.82:38138) 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f6035800640 1 -- 172.21.15.82:0/1627743823 learned_addr learned my addr 172.21.15.82:0/1627743823 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.433+0000 7f6034e00640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b3764d0 0x55992b7459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6036200640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6035800640 1 -- 172.21.15.82:0/1627743823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 msgr2=0x55992b74c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6035800640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6035800640 1 -- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b3764d0 msgr2=0x55992b7459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6035800640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b3764d0 0x55992b7459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.434+0000 7f6035800640 1 -- 172.21.15.82:0/1627743823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55992b668170 con 0x55992b36e2f0 2024-06-06T02:41:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.435+0000 7f6035800640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6024000c00 tx=0x7f602402a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e4bb5aea008219 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.435+0000 7f6017400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:41:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.436+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6024035050 con 0x55992b36e2f0 2024-06-06T02:41:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.436+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60280df3b0 con 0x55992b36e2f0 2024-06-06T02:41:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.437+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f6024031bb0 con 0x55992b36e2f0 2024-06-06T02:41:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.437+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6024031db0 con 0x55992b36e2f0 2024-06-06T02:41:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.438+0000 7f603f1fb740 10 client.25810 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.438+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55992b402790 con 0x55992b36e2f0 2024-06-06T02:41:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.438+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60280df3b0 con 0x55992b36e2f0 2024-06-06T02:41:48.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.439+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7f602403c560 con 0x55992b36e2f0 2024-06-06T02:41:48.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.439+0000 7f603f1fb740 10 client.25810 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.439+0000 7f603f1fb740 10 client.25810 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.439+0000 7f603f1fb740 20 client.25810 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.440+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b355d80 0x55992b752cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.440+0000 7f603f1fb740 4 client.25810 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.440+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55992b6b03d0 con 0x55992b355d80 2024-06-06T02:41:48.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.440+0000 7f6034e00640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b355d80 0x55992b752cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.442+0000 7f6034e00640 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b355d80 0x55992b752cb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d619e77328614d server_cookie=66d46df46dad97e6 in_seq=0 out_seq=0 2024-06-06T02:41:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.442+0000 7f6017400640 10 client.25810 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.444+0000 7f6017400640 1 -- 172.21.15.82:0/1627743823 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55992b6b03d0 con 0x55992b355d80 2024-06-06T02:41:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.444+0000 7f6017400640 10 client.25810 handle_command_reply: tid=0 2024-06-06T02:41:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.444+0000 7f603f1fb740 1 client.25810 shutdown 2024-06-06T02:41:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.445+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 msgr2=0x55992b745470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.445+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6024000c00 tx=0x7f602402a400 comp rx=0 tx=0).stop 2024-06-06T02:41:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.445+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 shutdown_connections 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b355d80 0x55992b752cb0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b3764d0 0x55992b7459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 --2- 172.21.15.82:0/1627743823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b36e2f0 0x55992b745470 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 >> 172.21.15.82:0/1627743823 conn(0x55992b38b300 msgr2=0x55992b7385b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f6017400640 0 client.25810 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.446+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 shutdown_connections 2024-06-06T02:41:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.447+0000 7f603f1fb740 1 -- 172.21.15.82:0/1627743823 wait complete. 2024-06-06T02:41:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.447+0000 7f603f1fb740 20 client.25810 trim_cache size 0 max 16384 2024-06-06T02:41:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.472+0000 7f603f1fb740 1 Processor -- start 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.475+0000 7f603f1fb740 1 -- start start 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b737690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60301bbb20 con 0x55992b36e2f0 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60301b93f0 con 0x55992b3971b0 2024-06-06T02:41:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f603f1fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f60301b7220 con 0x55992b3764d0 2024-06-06T02:41:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f6034e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f6036200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f6036200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57940/0 (socket says 172.21.15.82:57940) 2024-06-06T02:41:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6036200640 1 -- 172.21.15.82:0/585912819 learned_addr learned my addr 172.21.15.82:0/585912819 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:48.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.476+0000 7f6034e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:38146/0 (socket says 172.21.15.82:38146) 2024-06-06T02:41:48.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6034e00640 1 -- 172.21.15.82:0/585912819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 msgr2=0x55992b74cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6034e00640 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6034e00640 1 -- 172.21.15.82:0/585912819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 msgr2=0x55992b737690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6034e00640 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b737690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.477+0000 7f6034e00640 1 -- 172.21.15.82:0/585912819 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55992b47b620 con 0x55992b3764d0 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.478+0000 7f6034e00640 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55992b7533b0 tx=0x7f601c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a250a5e8305c479 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.478+0000 7f6022000640 1 -- 172.21.15.82:0/585912819 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c01e070 con 0x55992b3764d0 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.478+0000 7f6022000640 1 -- 172.21.15.82:0/585912819 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55992b6b03d0 con 0x55992b3764d0 2024-06-06T02:41:48.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.478+0000 7f6022000640 1 -- 172.21.15.82:0/585912819 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c01a590 con 0x55992b3764d0 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 -- 172.21.15.82:0/585912819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 msgr2=0x55992b74c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55992b7533b0 tx=0x7f601c004730 comp rx=0 tx=0).stop 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 -- 172.21.15.82:0/585912819 shutdown_connections 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3971b0 0x55992b74cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3764d0 0x55992b74c830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 --2- 172.21.15.82:0/585912819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b737690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.479+0000 7f603f1fb740 1 -- 172.21.15.82:0/585912819 >> 172.21.15.82:0/585912819 conn(0x55992b38b300 msgr2=0x55992b736f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.480+0000 7f603f1fb740 1 -- 172.21.15.82:0/585912819 shutdown_connections 2024-06-06T02:41:48.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.480+0000 7f603f1fb740 1 -- 172.21.15.82:0/585912819 wait complete. 2024-06-06T02:41:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.480+0000 7f603f1fb740 1 -- start start 2024-06-06T02:41:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 Processor -- start 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b749ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 0x55992b74b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60301b78b0 con 0x55992b36e2f0 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60301b8d20 con 0x55992b3764d0 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f60301b7f80 con 0x55992b3971b0 2024-06-06T02:41:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.481+0000 7f603f1fb740 10 client.0 _ll_register_callbacks cb 0x7f60240036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:41:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:57952/0 (socket says 172.21.15.82:57952) 2024-06-06T02:41:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 -- 172.21.15.82:0/3962243171 learned_addr learned my addr 172.21.15.82:0/3962243171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:41:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6036200640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 0x55992b74b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 -- 172.21.15.82:0/3962243171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 msgr2=0x55992b74b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 0x55992b74b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 -- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 msgr2=0x55992b749ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6035800640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b749ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b749ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.482+0000 7f6034e00640 1 -- 172.21.15.82:0/3962243171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55992b74b900 con 0x55992b3764d0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.483+0000 7f6036200640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 0x55992b74b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.483+0000 7f6034e00640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f601c004700 tx=0x7f601c00cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd3ec07850b6926 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.483+0000 7f6017400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c01e070 con 0x55992b3764d0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f601c0043f0 con 0x55992b3764d0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55992b6b03d0 con 0x55992b3764d0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f601c0035f0 con 0x55992b3764d0 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f603f1fb740 10 client.25781 fetch_fsmap learned FSMap version 28 2024-06-06T02:41:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.484+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55992b74cc20 con 0x55992b3764d0 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.485+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55992b6b03d0 con 0x55992b3764d0 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8342+0+0 (secure 0 0 0) 0x7f601c037400 con 0x55992b3764d0 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 10 client.25781 fetch_fsmap finished waiting for FSMap version 28 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 20 client.25781 populate_metadata read hostname 'smithi082' 2024-06-06T02:41:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b32b1c0 0x55992b7bd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:41:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 4 client.25781 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:41:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.486+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55992b6abe70 con 0x55992b32b1c0 2024-06-06T02:41:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.487+0000 7f6035800640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b32b1c0 0x55992b7bd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:41:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.489+0000 7f6035800640 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b32b1c0 0x55992b7bd7c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e1a605d932767c server_cookie=6d370b66bcc07766 in_seq=0 out_seq=0 2024-06-06T02:41:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.489+0000 7f6017400640 10 client.25781 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.893+0000 7f6017400640 1 -- 172.21.15.82:0/3962243171 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55992b6abe70 con 0x55992b32b1c0 2024-06-06T02:41:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.893+0000 7f6017400640 10 client.25781 handle_command_reply: tid=0 2024-06-06T02:41:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.893+0000 7f603f1fb740 1 client.25781 shutdown 2024-06-06T02:41:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.893+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 msgr2=0x55992b74a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.893+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f601c004700 tx=0x7f601c00cd70 comp rx=0 tx=0).stop 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 shutdown_connections 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55992b3971b0 0x55992b74b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55992b3764d0 0x55992b74a3e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55992b32b1c0 0x55992b7bd7c0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 --2- 172.21.15.82:0/3962243171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55992b36e2f0 0x55992b749ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 >> 172.21.15.82:0/3962243171 conn(0x55992b38b300 msgr2=0x55992b73f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.895+0000 7f6017400640 0 client.25781 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:41:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.896+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 shutdown_connections 2024-06-06T02:41:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.897+0000 7f603f1fb740 1 -- 172.21.15.82:0/3962243171 wait complete. 2024-06-06T02:41:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.897+0000 7f603f1fb740 20 client.25781 trim_cache size 0 max 16384 2024-06-06T02:41:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:41:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:41:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:41:48.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.899+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 msgr2=0x7f60180b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.899+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 0x7f60180b4df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6024031440 tx=0x7f60240314a0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.899+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 msgr2=0x7f603019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.899+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f602800b970 tx=0x7f602800be30 comp rx=0 tx=0).stop 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 shutdown_connections 2024-06-06T02:41:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f60180b28e0 0x7f60180b4df0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6030104600 0x7f603019a650 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030103cb0 0x7f60301976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 --2- 172.21.15.82:0/143080455 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6030102b90 0x7f60301971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 >> 172.21.15.82:0/143080455 conn(0x7f60300fe390 msgr2=0x7f6030104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 shutdown_connections 2024-06-06T02:41:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:41:48.900+0000 7f6038200640 1 -- 172.21.15.82:0/143080455 wait complete. 2024-06-06T02:41:50.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:50 smithi103 ceph-mon[36349]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 87 MiB/s wr, 13.60k op/s 2024-06-06T02:41:50.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:50 smithi184 ceph-mon[36922]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 87 MiB/s wr, 13.60k op/s 2024-06-06T02:41:50.723 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:50 smithi082 ceph-mon[31579]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 87 MiB/s wr, 13.60k op/s 2024-06-06T02:41:52.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:52 smithi103 ceph-mon[36349]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 MiB/s wr, 15.62k op/s 2024-06-06T02:41:52.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:52 smithi184 ceph-mon[36922]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 MiB/s wr, 15.62k op/s 2024-06-06T02:41:52.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:52 smithi082 ceph-mon[31579]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 100 MiB/s wr, 15.62k op/s 2024-06-06T02:41:54.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:54 smithi184 ceph-mon[36922]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 97 MiB/s wr, 14.77k op/s 2024-06-06T02:41:54.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:54 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:54 smithi103 ceph-mon[36349]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 97 MiB/s wr, 14.77k op/s 2024-06-06T02:41:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:54 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:54.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:54 smithi082 ceph-mon[31579]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 97 MiB/s wr, 14.77k op/s 2024-06-06T02:41:54.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:54 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:41:56.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:56 smithi184 ceph-mon[36922]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 99 MiB/s wr, 14.71k op/s 2024-06-06T02:41:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:56 smithi103 ceph-mon[36349]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 99 MiB/s wr, 14.71k op/s 2024-06-06T02:41:56.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:56 smithi082 ceph-mon[31579]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 99 MiB/s wr, 14.71k op/s 2024-06-06T02:41:58.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:41:58 smithi184 ceph-mon[36922]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 94 MiB/s wr, 13.54k op/s 2024-06-06T02:41:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:41:58 smithi103 ceph-mon[36349]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 94 MiB/s wr, 13.54k op/s 2024-06-06T02:41:58.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:41:58 smithi082 ceph-mon[31579]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 94 MiB/s wr, 13.54k op/s 2024-06-06T02:42:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:00 smithi103 ceph-mon[36349]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 93 MiB/s wr, 13.07k op/s 2024-06-06T02:42:00.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:00 smithi082 ceph-mon[31579]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 93 MiB/s wr, 13.07k op/s 2024-06-06T02:42:00.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:00 smithi184 ceph-mon[36922]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 93 MiB/s wr, 13.07k op/s 2024-06-06T02:42:02.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:02 smithi103 ceph-mon[36349]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 MiB/s wr, 14.24k op/s 2024-06-06T02:42:02.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:02 smithi082 ceph-mon[31579]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 MiB/s wr, 14.24k op/s 2024-06-06T02:42:02.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:02 smithi184 ceph-mon[36922]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 MiB/s wr, 14.24k op/s 2024-06-06T02:42:04.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:04 smithi103 ceph-mon[36349]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 13.27k op/s 2024-06-06T02:42:04.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:04 smithi082 ceph-mon[31579]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 13.27k op/s 2024-06-06T02:42:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:04 smithi184 ceph-mon[36922]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 13.27k op/s 2024-06-06T02:42:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:06 smithi103 ceph-mon[36349]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 105 MiB/s wr, 14.43k op/s 2024-06-06T02:42:06.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:06 smithi082 ceph-mon[31579]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 105 MiB/s wr, 14.43k op/s 2024-06-06T02:42:06.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:06 smithi184 ceph-mon[36922]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 105 MiB/s wr, 14.43k op/s 2024-06-06T02:42:08.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:08 smithi082 ceph-mon[31579]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 MiB/s wr, 13.86k op/s 2024-06-06T02:42:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:08 smithi103 ceph-mon[36349]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 MiB/s wr, 13.86k op/s 2024-06-06T02:42:08.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:08 smithi184 ceph-mon[36922]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 99 MiB/s wr, 13.86k op/s 2024-06-06T02:42:08.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T02:42:10.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:10 smithi103 ceph-mon[36349]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 96 MiB/s wr, 13.73k op/s 2024-06-06T02:42:10.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:10 smithi082 ceph-mon[31579]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 96 MiB/s wr, 13.73k op/s 2024-06-06T02:42:10.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:10 smithi184 ceph-mon[36922]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 96 MiB/s wr, 13.73k op/s 2024-06-06T02:42:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.648+0000 7f48c3e00640 1 -- 172.21.15.82:0/1377085324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc10a290 msgr2=0x7f48bc10a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.648+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1377085324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc10a290 0x7f48bc10a760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009890 tx=0x7f48a802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.649+0000 7f48c3e00640 1 -- 172.21.15.82:0/1377085324 shutdown_connections 2024-06-06T02:42:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1377085324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc111330 0x7f48bc113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1377085324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc10a290 0x7f48bc10a760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 --2- 172.21.15.82:0/1377085324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc109940 0x7f48bc109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 -- 172.21.15.82:0/1377085324 >> 172.21.15.82:0/1377085324 conn(0x7f48bc06fbe0 msgr2=0x7f48bc072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 -- 172.21.15.82:0/1377085324 shutdown_connections 2024-06-06T02:42:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.650+0000 7f48c3e00640 1 -- 172.21.15.82:0/1377085324 wait complete. 2024-06-06T02:42:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.651+0000 7f48c3e00640 1 Processor -- start 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 -- start start 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc109940 0x7f48bc19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc111330 0x7f48bc1a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc116ee0 con 0x7f48bc109940 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc109940 0x7f48bc19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc116d60 con 0x7f48bc10a290 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c3e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc117060 con 0x7f48bc111330 2024-06-06T02:42:10.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.652+0000 7f48c0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58826/0 (socket says 172.21.15.82:58826) 2024-06-06T02:42:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 -- 172.21.15.82:0/2952829760 learned_addr learned my addr 172.21.15.82:0/2952829760 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c1e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc111330 0x7f48bc1a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 -- 172.21.15.82:0/2952829760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc111330 msgr2=0x7f48bc1a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc111330 0x7f48bc1a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 -- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc109940 msgr2=0x7f48bc19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc109940 0x7f48bc19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.653+0000 7f48c0a00640 1 -- 172.21.15.82:0/2952829760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1a7460 con 0x7f48bc10a290 2024-06-06T02:42:10.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.655+0000 7f48c0a00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48a80042f0 tx=0x7f48a8004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.656+0000 7f48ba000640 1 -- 172.21.15.82:0/2952829760 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8040020 con 0x7f48bc10a290 2024-06-06T02:42:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.656+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc1a76f0 con 0x7f48bc10a290 2024-06-06T02:42:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.656+0000 7f48ba000640 1 -- 172.21.15.82:0/2952829760 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a8038040 con 0x7f48bc10a290 2024-06-06T02:42:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.656+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1a7c30 con 0x7f48bc10a290 2024-06-06T02:42:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.656+0000 7f48ba000640 1 -- 172.21.15.82:0/2952829760 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8037070 con 0x7f48bc10a290 2024-06-06T02:42:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.661+0000 7f48ba000640 1 -- 172.21.15.82:0/2952829760 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f48a8043020 con 0x7f48bc10a290 2024-06-06T02:42:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.664+0000 7f48ba000640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 0x7f48a40b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.664+0000 7f48ba000640 1 -- 172.21.15.82:0/2952829760 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48a81029f0 con 0x7f48bc10a290 2024-06-06T02:42:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.664+0000 7f48c1400640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 0x7f48a40b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.697+0000 7f48c1400640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 0x7f48a40b4d70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0747c0 tx=0x7f48b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.698+0000 7f48cae35740 1 Processor -- start 2024-06-06T02:42:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.698+0000 7f48cae35740 1 -- start start 2024-06-06T02:42:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.700+0000 7f48cae35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.701+0000 7f48cae35740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 0x559d86491240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.702+0000 7f48cae35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d86498100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.702+0000 7f48cae35740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559d86403480 con 0x559d860c32f0 2024-06-06T02:42:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.702+0000 7f48cae35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559d863f2a20 con 0x559d860ec1b0 2024-06-06T02:42:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.702+0000 7f48cae35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559d863f6a60 con 0x559d860cb4d0 2024-06-06T02:42:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.703+0000 7f48c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.703+0000 7f48c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58834/0 (socket says 172.21.15.82:58834) 2024-06-06T02:42:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.703+0000 7f48c1400640 1 -- 172.21.15.82:0/548391534 learned_addr learned my addr 172.21.15.82:0/548391534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.704+0000 7f48c0a00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 0x559d86491240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.704+0000 7f48c1e00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d86498100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.705+0000 7f48c0a00640 1 -- 172.21.15.82:0/548391534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 msgr2=0x559d86498100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c0a00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d86498100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c0a00640 1 -- 172.21.15.82:0/548391534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 msgr2=0x559d86490d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c0a00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c0a00640 1 -- 172.21.15.82:0/548391534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d863ef8d0 con 0x559d860c32f0 2024-06-06T02:42:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c1400640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.706+0000 7f48c1e00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d86498100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:42:10.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.707+0000 7f48c0a00640 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 0x559d86491240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f48a80c9fa0 tx=0x7f48a80095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df9e6f80b6f5454 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.709+0000 7f48ae600640 1 -- 172.21.15.82:0/548391534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a80c9b20 con 0x559d860c32f0 2024-06-06T02:42:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.709+0000 7f48ae600640 1 -- 172.21.15.82:0/548391534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a80ca710 con 0x559d860c32f0 2024-06-06T02:42:10.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.709+0000 7f48ae600640 1 -- 172.21.15.82:0/548391534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a80d29e0 con 0x559d860c32f0 2024-06-06T02:42:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.711+0000 7f48cae35740 1 -- 172.21.15.82:0/548391534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 msgr2=0x559d86491240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.711+0000 7f48cae35740 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 0x559d86491240 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f48a80c9fa0 tx=0x7f48a80095b0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 -- 172.21.15.82:0/548391534 shutdown_connections 2024-06-06T02:42:10.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d86498100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860c32f0 0x559d86491240 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 --2- 172.21.15.82:0/548391534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860ec1b0 0x559d86490d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 -- 172.21.15.82:0/548391534 >> 172.21.15.82:0/548391534 conn(0x559d860e0300 msgr2=0x559d8648c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 -- 172.21.15.82:0/548391534 shutdown_connections 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.713+0000 7f48cae35740 1 -- 172.21.15.82:0/548391534 wait complete. 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.714+0000 7f48cae35740 1 -- start start 2024-06-06T02:42:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.714+0000 7f48cae35740 1 Processor -- start 2024-06-06T02:42:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d86499fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d8649a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559d8632dab0 con 0x559d860ec1b0 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559d86390630 con 0x559d860cb4d0 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559d86403480 con 0x559d860c32f0 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.715+0000 7f48cae35740 10 client.0 _ll_register_callbacks cb 0x559d86396610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.716+0000 7f48c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.716+0000 7f48c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35988/0 (socket says 172.21.15.82:35988) 2024-06-06T02:42:10.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.716+0000 7f48c1e00640 1 -- 172.21.15.82:0/4207074897 learned_addr learned my addr 172.21.15.82:0/4207074897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.716+0000 7f48c1400640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d86499fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.716+0000 7f48c0a00640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d8649a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.717+0000 7f48c1e00640 1 -- 172.21.15.82:0/4207074897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 msgr2=0x559d86499fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.717+0000 7f48c1e00640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d86499fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.717+0000 7f48c1e00640 1 -- 172.21.15.82:0/4207074897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 msgr2=0x559d8649a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.717+0000 7f48c1e00640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d8649a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.717+0000 7f48c1e00640 1 -- 172.21.15.82:0/4207074897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d863bd170 con 0x559d860ec1b0 2024-06-06T02:42:10.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.718+0000 7f48c0a00640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d8649a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.718+0000 7f48c1e00640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48b4011a90 tx=0x7f48b4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39329c746eb19525 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.718+0000 7f48a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:42:10.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.719+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4020060 con 0x559d860ec1b0 2024-06-06T02:42:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.719+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48b400fcc0 con 0x559d860ec1b0 2024-06-06T02:42:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.720+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48a80ca710 con 0x559d860ec1b0 2024-06-06T02:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.722+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48b401b420 con 0x559d860ec1b0 2024-06-06T02:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.722+0000 7f48cae35740 10 client.15579 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:10.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.723+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559d86157790 con 0x559d860ec1b0 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a80ca710 con 0x559d860ec1b0 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f48b4024620 con 0x559d860ec1b0 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 10 client.15579 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 20 client.15579 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:10.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860aad80 0x559d864a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 4 client.15579 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:10.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.724+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d864053d0 con 0x559d860aad80 2024-06-06T02:42:10.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.726+0000 7f48c1400640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860aad80 0x559d864a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.728+0000 7f48c1400640 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860aad80 0x559d864a7750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377ac728dd68490f server_cookie=e9e838b672298a52 in_seq=0 out_seq=0 2024-06-06T02:42:10.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.729+0000 7f48a2a00640 10 client.15579 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.731+0000 7f48a2a00640 1 -- 172.21.15.82:0/4207074897 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559d864053d0 con 0x559d860aad80 2024-06-06T02:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.731+0000 7f48a2a00640 10 client.15579 handle_command_reply: tid=0 2024-06-06T02:42:10.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.731+0000 7f48cae35740 1 client.15579 shutdown 2024-06-06T02:42:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.731+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 msgr2=0x559d864a13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f48b4011a90 tx=0x7f48b4011e90 comp rx=0 tx=0).stop 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 shutdown_connections 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860aad80 0x559d864a7750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a13d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d8649a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 --2- 172.21.15.82:0/4207074897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d86499fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.732 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.732+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 >> 172.21.15.82:0/4207074897 conn(0x559d860e0300 msgr2=0x559d8648d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.733+0000 7f48a2a00640 0 client.15579 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.733+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 shutdown_connections 2024-06-06T02:42:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.733+0000 7f48cae35740 1 -- 172.21.15.82:0/4207074897 wait complete. 2024-06-06T02:42:10.733 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.734+0000 7f48cae35740 20 client.15579 trim_cache size 0 max 16384 2024-06-06T02:42:10.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.784+0000 7f48cae35740 1 Processor -- start 2024-06-06T02:42:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.784+0000 7f48cae35740 1 -- start start 2024-06-06T02:42:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.785+0000 7f48cae35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.785+0000 7f48cae35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d864a1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.785+0000 7f48cae35740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.786+0000 7f48c0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d864a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.786+0000 7f48c1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.786+0000 7f48c0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d864a1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58858/0 (socket says 172.21.15.82:58858) 2024-06-06T02:42:10.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.786+0000 7f48c1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:43156/0 (socket says 172.21.15.82:43156) 2024-06-06T02:42:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.786+0000 7f48c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.787+0000 7f48c0a00640 1 -- 172.21.15.82:0/2102509676 learned_addr learned my addr 172.21.15.82:0/2102509676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.787+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f489c010e70 con 0x559d860ec1b0 2024-06-06T02:42:10.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.787+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f489c00e740 con 0x559d860cb4d0 2024-06-06T02:42:10.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.787+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f489c00c570 con 0x559d860c32f0 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.788+0000 7f48c1400640 1 -- 172.21.15.82:0/2102509676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 msgr2=0x559d864a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.788+0000 7f48c1400640 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d864a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.788+0000 7f48c1400640 1 -- 172.21.15.82:0/2102509676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 msgr2=0x559d864a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.788+0000 7f48c1400640 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.788+0000 7f48c1400640 1 -- 172.21.15.82:0/2102509676 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d861d0620 con 0x559d860c32f0 2024-06-06T02:42:10.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.789+0000 7f48c1400640 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x559d864a7e90 tx=0x7f48b0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a730f2c6623f25 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.790+0000 7f48adc00640 1 -- 172.21.15.82:0/2102509676 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0004020 con 0x559d860c32f0 2024-06-06T02:42:10.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.790+0000 7f48adc00640 1 -- 172.21.15.82:0/2102509676 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559d864053d0 con 0x559d860c32f0 2024-06-06T02:42:10.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.790+0000 7f48adc00640 1 -- 172.21.15.82:0/2102509676 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b00049e0 con 0x559d860c32f0 2024-06-06T02:42:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.792+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 msgr2=0x559d8648daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x559d864a7e90 tx=0x7f48b0014000 comp rx=0 tx=0).stop 2024-06-06T02:42:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 shutdown_connections 2024-06-06T02:42:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d864a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860cb4d0 0x559d864a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 --2- 172.21.15.82:0/2102509676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860c32f0 0x559d8648daf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 >> 172.21.15.82:0/2102509676 conn(0x559d860e0300 msgr2=0x559d8648d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.793+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 shutdown_connections 2024-06-06T02:42:10.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.794+0000 7f48cae35740 1 -- 172.21.15.82:0/2102509676 wait complete. 2024-06-06T02:42:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.795+0000 7f48cae35740 1 -- start start 2024-06-06T02:42:10.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.795+0000 7f48cae35740 1 Processor -- start 2024-06-06T02:42:10.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.796+0000 7f48cae35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860c32f0 0x559d864a1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.797+0000 7f48cae35740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d8649e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.797+0000 7f48cae35740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.797+0000 7f48cae35740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f489c00cc00 con 0x559d860ec1b0 2024-06-06T02:42:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.797+0000 7f48cae35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f489c00e070 con 0x559d860c32f0 2024-06-06T02:42:10.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.797+0000 7f48cae35740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f489c00d2d0 con 0x559d860cb4d0 2024-06-06T02:42:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.798+0000 7f48cae35740 10 client.0 _ll_register_callbacks cb 0x7f48b400ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.798+0000 7f48c1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860c32f0 0x559d864a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.799+0000 7f48c0a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d8649e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.799+0000 7f48c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.799+0000 7f48c1e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36004/0 (socket says 172.21.15.82:36004) 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.799+0000 7f48c1e00640 1 -- 172.21.15.82:0/3523900998 learned_addr learned my addr 172.21.15.82:0/3523900998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.799+0000 7f48c1e00640 1 -- 172.21.15.82:0/3523900998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 msgr2=0x559d8649e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.800+0000 7f48c1e00640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d8649e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.800+0000 7f48c1e00640 1 -- 172.21.15.82:0/3523900998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860c32f0 msgr2=0x559d864a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:10.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.800+0000 7f48c1e00640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860c32f0 0x559d864a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.800+0000 7f48c1e00640 1 -- 172.21.15.82:0/3523900998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8649ece0 con 0x559d860ec1b0 2024-06-06T02:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.800+0000 7f48c0a00640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d8649e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.801+0000 7f48c1e00640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000f80 tx=0x7f48b400fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487b22897645a931 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:10.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.801+0000 7f48a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:42:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.802+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4034060 con 0x559d860ec1b0 2024-06-06T02:42:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.802+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f48b40243a0 con 0x559d860ec1b0 2024-06-06T02:42:10.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.802+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d864053d0 con 0x559d860ec1b0 2024-06-06T02:42:10.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.803+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48b402a080 con 0x559d860ec1b0 2024-06-06T02:42:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.803+0000 7f48cae35740 10 client.15585 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.803+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559d8650efa0 con 0x559d860ec1b0 2024-06-06T02:42:10.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.804+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559d864053d0 con 0x559d860ec1b0 2024-06-06T02:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f48b401bb90 con 0x559d860ec1b0 2024-06-06T02:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 10 client.15585 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 20 client.15585 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:10.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860801c0 0x559d86511970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 4 client.15585 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.805+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559d86400e70 con 0x559d860801c0 2024-06-06T02:42:10.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.806+0000 7f48c1400640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860801c0 0x559d86511970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.808+0000 7f48c1400640 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860801c0 0x559d86511970 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e40bb5fde98aa6f server_cookie=8b1837c3998b833b in_seq=0 out_seq=0 2024-06-06T02:42:10.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:10.809+0000 7f48a2a00640 10 client.15585 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:11.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.119+0000 7f48a2a00640 1 -- 172.21.15.82:0/3523900998 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559d86400e70 con 0x559d860801c0 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.119+0000 7f48a2a00640 10 client.15585 handle_command_reply: tid=0 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.119+0000 7f48cae35740 1 client.15585 shutdown 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 msgr2=0x559d8649e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48b4000f80 tx=0x7f48b400fcf0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 shutdown_connections 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559d860801c0 0x559d86511970 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48a2a00640 0 client.15585 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:11.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559d860ec1b0 0x559d8649e6f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559d860cb4d0 0x559d8649e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 --2- 172.21.15.82:0/3523900998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d860c32f0 0x559d864a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.120+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 >> 172.21.15.82:0/3523900998 conn(0x559d860e0300 msgr2=0x559d8648da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.121+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 shutdown_connections 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.121+0000 7f48cae35740 1 -- 172.21.15.82:0/3523900998 wait complete. 2024-06-06T02:42:11.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.121+0000 7f48cae35740 20 client.15585 trim_cache size 0 max 16384 2024-06-06T02:42:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:42:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:42:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:42:11.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.122+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 msgr2=0x7f48a40b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.122+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 0x7f48a40b4d70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0747c0 tx=0x7f48b0009260 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.122+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 msgr2=0x7f48bc19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.122+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48a80042f0 tx=0x7f48a8004320 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 shutdown_connections 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f48a40b2860 0x7f48a40b4d70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48bc111330 0x7f48bc1a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48bc10a290 0x7f48bc19fe60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 --2- 172.21.15.82:0/2952829760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48bc109940 0x7f48bc19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 >> 172.21.15.82:0/2952829760 conn(0x7f48bc06fbe0 msgr2=0x7f48bc10b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 shutdown_connections 2024-06-06T02:42:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:11.123+0000 7f48c3e00640 1 -- 172.21.15.82:0/2952829760 wait complete. 2024-06-06T02:42:11.490 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:42:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:12 smithi103 ceph-mon[36349]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 MiB/s wr, 14.63k op/s 2024-06-06T02:42:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:12 smithi082 ceph-mon[31579]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 MiB/s wr, 14.63k op/s 2024-06-06T02:42:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:12 smithi184 ceph-mon[36922]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 MiB/s wr, 14.63k op/s 2024-06-06T02:42:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:14 smithi103 ceph-mon[36349]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 96 MiB/s wr, 13.75k op/s 2024-06-06T02:42:14.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:14 smithi082 ceph-mon[31579]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 96 MiB/s wr, 13.75k op/s 2024-06-06T02:42:14.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:14 smithi184 ceph-mon[36922]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 96 MiB/s wr, 13.75k op/s 2024-06-06T02:42:16.594 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:16 smithi082 ceph-mon[31579]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 97 MiB/s wr, 13.88k op/s 2024-06-06T02:42:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:16 smithi103 ceph-mon[36349]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 97 MiB/s wr, 13.88k op/s 2024-06-06T02:42:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:16 smithi184 ceph-mon[36922]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 97 MiB/s wr, 13.88k op/s 2024-06-06T02:42:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:18 smithi103 ceph-mon[36349]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 MiB/s wr, 13.17k op/s 2024-06-06T02:42:18.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:18 smithi082 ceph-mon[31579]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 MiB/s wr, 13.17k op/s 2024-06-06T02:42:18.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:18 smithi184 ceph-mon[36922]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 MiB/s wr, 13.17k op/s 2024-06-06T02:42:20.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:20 smithi103 ceph-mon[36349]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.86k op/s 2024-06-06T02:42:20.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:20 smithi082 ceph-mon[31579]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.86k op/s 2024-06-06T02:42:20.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:20 smithi184 ceph-mon[36922]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.86k op/s 2024-06-06T02:42:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:22 smithi103 ceph-mon[36349]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 97 MiB/s wr, 13.82k op/s 2024-06-06T02:42:22.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:22 smithi082 ceph-mon[31579]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 97 MiB/s wr, 13.82k op/s 2024-06-06T02:42:22.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:22 smithi184 ceph-mon[36922]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 97 MiB/s wr, 13.82k op/s 2024-06-06T02:42:24.568 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:24 smithi082 ceph-mon[31579]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 90 MiB/s wr, 13.01k op/s 2024-06-06T02:42:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 -- 172.21.15.82:0/3820151429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7508106420 msgr2=0x7f7508106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 --2- 172.21.15.82:0/3820151429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7508106420 0x7f7508106830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7504009ca0 tx=0x7f750402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 -- 172.21.15.82:0/3820151429 shutdown_connections 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 --2- 172.21.15.82:0/3820151429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f750810d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 --2- 172.21.15.82:0/3820151429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75081049c0 0x7f7508104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 --2- 172.21.15.82:0/3820151429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7508106420 0x7f7508106830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.603+0000 7f7510800640 1 -- 172.21.15.82:0/3820151429 >> 172.21.15.82:0/3820151429 conn(0x7f75081005c0 msgr2=0x7f7508102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.606+0000 7f7510800640 1 -- 172.21.15.82:0/3820151429 shutdown_connections 2024-06-06T02:42:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.606+0000 7f7510800640 1 -- 172.21.15.82:0/3820151429 wait complete. 2024-06-06T02:42:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.608+0000 7f7510800640 1 Processor -- start 2024-06-06T02:42:24.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.608+0000 7f7510800640 1 -- start start 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.608+0000 7f7510800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.608+0000 7f7510800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f75081977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.608+0000 7f7510800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7508106420 0x7f75081af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f7510800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7508110a20 con 0x7f7508105440 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f7510800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75081108a0 con 0x7f7508106420 2024-06-06T02:42:24.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f7510800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7508110ba0 con 0x7f75081049c0 2024-06-06T02:42:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35784/0 (socket says 172.21.15.82:35784) 2024-06-06T02:42:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 -- 172.21.15.82:0/544766022 learned_addr learned my addr 172.21.15.82:0/544766022 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750e800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7508106420 0x7f75081af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750d400640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f75081977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 -- 172.21.15.82:0/544766022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7508106420 msgr2=0x7f75081af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7508106420 0x7f75081af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.609+0000 7f750de00640 1 -- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 msgr2=0x7f75081977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.610+0000 7f750de00640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f75081977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.610+0000 7f750de00640 1 -- 172.21.15.82:0/544766022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75081afe60 con 0x7f75081049c0 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.610+0000 7f750d400640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f75081977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:24.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.610+0000 7f750de00640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f80 tx=0x7f7504003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.611+0000 7f7502a00640 1 -- 172.21.15.82:0/544766022 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750402f380 con 0x7f75081049c0 2024-06-06T02:42:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.611+0000 7f7502a00640 1 -- 172.21.15.82:0/544766022 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75040317c0 con 0x7f75081049c0 2024-06-06T02:42:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.611+0000 7f7502a00640 1 -- 172.21.15.82:0/544766022 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750402fbe0 con 0x7f75081049c0 2024-06-06T02:42:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.611+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75081b00f0 con 0x7f75081049c0 2024-06-06T02:42:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.611+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75081b05f0 con 0x7f75081049c0 2024-06-06T02:42:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.617+0000 7f75177ed740 1 Processor -- start 2024-06-06T02:42:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.617+0000 7f75177ed740 1 -- start start 2024-06-06T02:42:24.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:24 smithi103 ceph-mon[36349]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 90 MiB/s wr, 13.01k op/s 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.617+0000 7f75177ed740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 0x55a87f6a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f75177ed740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f75177ed740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 0x55a87f6b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f75177ed740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a87f61b480 con 0x55a87f3041b0 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f75177ed740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a87f60aa20 con 0x55a87f2e34d0 2024-06-06T02:42:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f75177ed740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a87f60ea60 con 0x55a87f2db2f0 2024-06-06T02:42:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f750d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 0x55a87f6b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f750e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 0x55a87f6a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.619+0000 7f750e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 0x55a87f6a8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48104/0 (socket says 172.21.15.82:48104) 2024-06-06T02:42:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.620+0000 7f750e800640 1 -- 172.21.15.82:0/737041198 learned_addr learned my addr 172.21.15.82:0/737041198 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.620+0000 7f750d400640 1 -- 172.21.15.82:0/737041198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 msgr2=0x55a87f6a9240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:42:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.621+0000 7f750d400640 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a9240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.621+0000 7f750d400640 1 -- 172.21.15.82:0/737041198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 msgr2=0x55a87f6a8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.621+0000 7f750d400640 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 0x55a87f6a8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.621+0000 7f750d400640 1 -- 172.21.15.82:0/737041198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a87f6078d0 con 0x55a87f2e34d0 2024-06-06T02:42:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.622+0000 7f750d400640 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 0x55a87f6b0100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009c30 tx=0x7f74f4010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb81cec420571fd4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.622+0000 7f7502a00640 1 -- 172.21.15.82:0/544766022 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f750402fd80 con 0x7f75081049c0 2024-06-06T02:42:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.622+0000 7f74fb000640 1 -- 172.21.15.82:0/737041198 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4004020 con 0x55a87f2e34d0 2024-06-06T02:42:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.622+0000 7f74fb000640 1 -- 172.21.15.82:0/737041198 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f40041c0 con 0x55a87f2e34d0 2024-06-06T02:42:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.622+0000 7f74fb000640 1 -- 172.21.15.82:0/737041198 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f40126b0 con 0x55a87f2e34d0 2024-06-06T02:42:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.623+0000 7f75177ed740 1 -- 172.21.15.82:0/737041198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 msgr2=0x55a87f6b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.623+0000 7f75177ed740 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 0x55a87f6b0100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009c30 tx=0x7f74f4010740 comp rx=0 tx=0).stop 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f7502a00640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 0x7f74f00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f75177ed740 1 -- 172.21.15.82:0/737041198 shutdown_connections 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f75177ed740 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2e34d0 0x55a87f6b0100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f75177ed740 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f75177ed740 1 --2- 172.21.15.82:0/737041198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f3041b0 0x55a87f6a8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.627+0000 7f75177ed740 1 -- 172.21.15.82:0/737041198 >> 172.21.15.82:0/737041198 conn(0x55a87f2f8300 msgr2=0x55a87f6a46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.628+0000 7f75177ed740 1 -- 172.21.15.82:0/737041198 shutdown_connections 2024-06-06T02:42:24.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.628+0000 7f750e800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 0x7f74f00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.628+0000 7f7502a00640 1 -- 172.21.15.82:0/544766022 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7504103960 con 0x7f75081049c0 2024-06-06T02:42:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.630+0000 7f750e800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 0x7f74f00b4df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ac00 tx=0x7f74fc005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.630+0000 7f75177ed740 1 -- 172.21.15.82:0/737041198 wait complete. 2024-06-06T02:42:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.631+0000 7f75177ed740 1 -- start start 2024-06-06T02:42:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.631+0000 7f75177ed740 1 Processor -- start 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2db2f0 0x55a87f6b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a87f545ab0 con 0x55a87f2db2f0 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a87f5a8630 con 0x55a87f3041b0 2024-06-06T02:42:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a87f6b0ad0 con 0x55a87f2e34d0 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f75177ed740 10 client.0 _ll_register_callbacks cb 0x55a87f5ae610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f750d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f750d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35786/0 (socket says 172.21.15.82:35786) 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f750d400640 1 -- 172.21.15.82:0/279597997 learned_addr learned my addr 172.21.15.82:0/279597997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.632+0000 7f750e800640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750de00640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2db2f0 0x55a87f6b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750d400640 1 -- 172.21.15.82:0/279597997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 msgr2=0x55a87f6b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750d400640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750d400640 1 -- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2db2f0 msgr2=0x55a87f6b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750d400640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2db2f0 0x55a87f6b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.633+0000 7f750d400640 1 -- 172.21.15.82:0/279597997 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a87f5d5170 con 0x55a87f2e34d0 2024-06-06T02:42:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.634+0000 7f750d400640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74f4011010 tx=0x7f74f40099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b472b890e1f6d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.634+0000 7f74ef400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:42:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.636+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f402a060 con 0x55a87f2e34d0 2024-06-06T02:42:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.636+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f40041c0 con 0x55a87f2e34d0 2024-06-06T02:42:24.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.636+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f74f4003610 con 0x55a87f2e34d0 2024-06-06T02:42:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.638+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74f4003810 con 0x55a87f2e34d0 2024-06-06T02:42:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.638+0000 7f75177ed740 10 client.25840 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.638+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a87f36f790 con 0x55a87f2e34d0 2024-06-06T02:42:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74f40041c0 con 0x55a87f2e34d0 2024-06-06T02:42:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f74f402f070 con 0x55a87f2e34d0 2024-06-06T02:42:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 10 client.25840 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 10 client.25840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 20 client.25840 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2c2d80 0x55a87f6bf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 4 client.25840 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.639+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a87f61d3d0 con 0x55a87f2c2d80 2024-06-06T02:42:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.640+0000 7f750de00640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2c2d80 0x55a87f6bf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.641+0000 7f74ef400640 10 client.25840 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.644+0000 7f750de00640 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2c2d80 0x55a87f6bf8f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da881f5a5367d04f server_cookie=555bbdf69ebb6ae8 in_seq=0 out_seq=0 2024-06-06T02:42:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.646+0000 7f74ef400640 1 -- 172.21.15.82:0/279597997 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a87f61d3d0 con 0x55a87f2c2d80 2024-06-06T02:42:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.646+0000 7f74ef400640 10 client.25840 handle_command_reply: tid=0 2024-06-06T02:42:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.646+0000 7f75177ed740 1 client.25840 shutdown 2024-06-06T02:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 msgr2=0x55a87f6b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74f4011010 tx=0x7f74f40099a0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 shutdown_connections 2024-06-06T02:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.647 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2e34d0 0x55a87f6b2a10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2c2d80 0x55a87f6bf8f0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 --2- 172.21.15.82:0/279597997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2db2f0 0x55a87f6b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 >> 172.21.15.82:0/279597997 conn(0x55a87f2f8300 msgr2=0x55a87f6a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.647+0000 7f74ef400640 0 client.25840 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:24.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:24 smithi184 ceph-mon[36922]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 90 MiB/s wr, 13.01k op/s 2024-06-06T02:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.648+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 shutdown_connections 2024-06-06T02:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.648+0000 7f75177ed740 1 -- 172.21.15.82:0/279597997 wait complete. 2024-06-06T02:42:24.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.649+0000 7f75177ed740 20 client.25840 trim_cache size 0 max 16384 2024-06-06T02:42:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.694+0000 7f75177ed740 1 Processor -- start 2024-06-06T02:42:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.694+0000 7f75177ed740 1 -- start start 2024-06-06T02:42:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.694+0000 7f75177ed740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f75177ed740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f75177ed740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f75177ed740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75081bbae0 con 0x55a87f2e34d0 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f75177ed740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75081b93b0 con 0x55a87f3041b0 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f75177ed740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75081b71e0 con 0x55a87f2db2f0 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f750d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f750de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f750de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35794/0 (socket says 172.21.15.82:35794) 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.696+0000 7f750de00640 1 -- 172.21.15.82:0/3834121055 learned_addr learned my addr 172.21.15.82:0/3834121055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.695+0000 7f750e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.696+0000 7f750de00640 1 -- 172.21.15.82:0/3834121055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 msgr2=0x55a87f6b9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.696+0000 7f750de00640 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.696+0000 7f750de00640 1 -- 172.21.15.82:0/3834121055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 msgr2=0x55a87f6a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.697+0000 7f750de00640 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.697+0000 7f750de00640 1 -- 172.21.15.82:0/3834121055 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a87f3e8620 con 0x55a87f2db2f0 2024-06-06T02:42:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.698+0000 7f750e800640 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:42:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.698+0000 7f750d400640 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.698+0000 7f750de00640 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75040caed0 tx=0x7f750403e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8326505b84345f05 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.699+0000 7f74fa600640 1 -- 172.21.15.82:0/3834121055 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040e9070 con 0x55a87f2db2f0 2024-06-06T02:42:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.699+0000 7f74fa600640 1 -- 172.21.15.82:0/3834121055 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7504036020 con 0x55a87f2db2f0 2024-06-06T02:42:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.699+0000 7f74fa600640 1 -- 172.21.15.82:0/3834121055 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75040cb400 con 0x55a87f2db2f0 2024-06-06T02:42:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.700+0000 7f75177ed740 1 -- 172.21.15.82:0/3834121055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 msgr2=0x55a87f6a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.700+0000 7f75177ed740 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75040caed0 tx=0x7f750403e040 comp rx=0 tx=0).stop 2024-06-06T02:42:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.701+0000 7f75177ed740 1 -- 172.21.15.82:0/3834121055 shutdown_connections 2024-06-06T02:42:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.701+0000 7f75177ed740 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f3041b0 0x55a87f6b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.701+0000 7f75177ed740 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.701+0000 7f75177ed740 1 --2- 172.21.15.82:0/3834121055 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f2db2f0 0x55a87f6a5860 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.701+0000 7f75177ed740 1 -- 172.21.15.82:0/3834121055 >> 172.21.15.82:0/3834121055 conn(0x55a87f2f8300 msgr2=0x55a87f6a5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.702+0000 7f75177ed740 1 -- 172.21.15.82:0/3834121055 shutdown_connections 2024-06-06T02:42:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.702+0000 7f75177ed740 1 -- 172.21.15.82:0/3834121055 wait complete. 2024-06-06T02:42:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.702+0000 7f75177ed740 1 -- start start 2024-06-06T02:42:24.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.703+0000 7f75177ed740 1 Processor -- start 2024-06-06T02:42:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f3041b0 0x55a87f725f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75081b7870 con 0x55a87f2e34d0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75081b8ce0 con 0x55a87f2db2f0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f75081b7f40 con 0x55a87f3041b0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f75177ed740 10 client.0 _ll_register_callbacks cb 0x7f74f4009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:40992/0 (socket says 172.21.15.82:40992) 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750de00640 1 -- 172.21.15.82:0/162380749 learned_addr learned my addr 172.21.15.82:0/162380749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750d400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48126/0 (socket says 172.21.15.82:48126) 2024-06-06T02:42:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.706+0000 7f750e800640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f3041b0 0x55a87f725f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 -- 172.21.15.82:0/162380749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f3041b0 msgr2=0x55a87f725f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f3041b0 0x55a87f725f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 -- 172.21.15.82:0/162380749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 msgr2=0x55a87f6b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 -- 172.21.15.82:0/162380749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a87f6ba2c0 con 0x55a87f2e34d0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f750d400640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009b80 tx=0x7f74f4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487d12a8f4b530ce server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f74ef400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4035030 con 0x55a87f2e34d0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f74f4022040 con 0x55a87f2e34d0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.707+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7504036020 con 0x55a87f2e34d0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.708+0000 7f750de00640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.708+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74f402a040 con 0x55a87f2e34d0 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.708+0000 7f75177ed740 10 client.15597 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:24.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.708+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a87f7273e0 con 0x55a87f2e34d0 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7504036020 con 0x55a87f2e34d0 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f74f402f050 con 0x55a87f2e34d0 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 10 client.15597 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 10 client.15597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 20 client.15597 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2981c0 0x55a87f729db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 4 client.15597 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a87f618e70 con 0x55a87f2981c0 2024-06-06T02:42:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.709+0000 7f750de00640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2981c0 0x55a87f729db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.711+0000 7f750de00640 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2981c0 0x55a87f729db0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b95117bd9099a08e server_cookie=3b89c88b37741b32 in_seq=0 out_seq=0 2024-06-06T02:42:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.711+0000 7f74ef400640 10 client.15597 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:24.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f74ef400640 1 -- 172.21.15.82:0/162380749 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a87f618e70 con 0x55a87f2981c0 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f74ef400640 10 client.15597 handle_command_reply: tid=0 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 client.15597 shutdown 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 msgr2=0x55a87f6b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009b80 tx=0x7f74f4005f10 comp rx=0 tx=0).stop 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 shutdown_connections 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a87f3041b0 0x55a87f725f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a87f2981c0 0x55a87f729db0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a87f2e34d0 0x55a87f6b72d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 --2- 172.21.15.82:0/162380749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a87f2db2f0 0x55a87f6b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 >> 172.21.15.82:0/162380749 conn(0x55a87f2f8300 msgr2=0x55a87f6abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.918+0000 7f74ef400640 0 client.15597 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.919+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 shutdown_connections 2024-06-06T02:42:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.919+0000 7f75177ed740 1 -- 172.21.15.82:0/162380749 wait complete. 2024-06-06T02:42:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.919+0000 7f75177ed740 20 client.15597 trim_cache size 0 max 16384 2024-06-06T02:42:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:42:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:42:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:42:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:42:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 msgr2=0x7f74f00b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 0x7f74f00b4df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00ac00 tx=0x7f74fc005f60 comp rx=0 tx=0).stop 2024-06-06T02:42:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 msgr2=0x7f75081972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:24.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f80 tx=0x7f7504003ba0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 shutdown_connections 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7508106420 0x7f75081af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7508105440 0x7f75081977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f74f00b28e0 0x7f74f00b4df0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 --2- 172.21.15.82:0/544766022 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75081049c0 0x7f75081972b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:24.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.922+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 >> 172.21.15.82:0/544766022 conn(0x7f75081005c0 msgr2=0x7f7508078bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.923+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 shutdown_connections 2024-06-06T02:42:24.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:24.923+0000 7f7510800640 1 -- 172.21.15.82:0/544766022 wait complete. 2024-06-06T02:42:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:26 smithi103 ceph-mon[36349]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 88 MiB/s wr, 12.80k op/s 2024-06-06T02:42:26.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:26 smithi082 ceph-mon[31579]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 88 MiB/s wr, 12.80k op/s 2024-06-06T02:42:26.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:26 smithi184 ceph-mon[36922]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 88 MiB/s wr, 12.80k op/s 2024-06-06T02:42:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:28 smithi103 ceph-mon[36349]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 97 MiB/s wr, 14.31k op/s 2024-06-06T02:42:28.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:28 smithi082 ceph-mon[31579]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 97 MiB/s wr, 14.31k op/s 2024-06-06T02:42:28.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:28 smithi184 ceph-mon[36922]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 97 MiB/s wr, 14.31k op/s 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.576+0000 7f99abe00640 1 -- 172.21.15.82:0/3565992295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10f4d0 msgr2=0x7f99ac10f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.576+0000 7f99abe00640 1 --2- 172.21.15.82:0/3565992295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10f4d0 0x7f99ac10f8e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f999c0074e0 tx=0x7f999c02b080 comp rx=0 tx=0).stop 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.577+0000 7f99abe00640 1 -- 172.21.15.82:0/3565992295 shutdown_connections 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.577+0000 7f99abe00640 1 --2- 172.21.15.82:0/3565992295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac10a0b0 0x7f99ac116270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.577+0000 7f99abe00640 1 --2- 172.21.15.82:0/3565992295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 0x7f99ac109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.577+0000 7f99abe00640 1 --2- 172.21.15.82:0/3565992295 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10f4d0 0x7f99ac10f8e0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f999c0074e0 tx=0x7f999c02b080 comp rx=0 tx=0).stop 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.577+0000 7f99abe00640 1 -- 172.21.15.82:0/3565992295 >> 172.21.15.82:0/3565992295 conn(0x7f99ac06eda0 msgr2=0x7f99ac06f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.578+0000 7f99abe00640 1 -- 172.21.15.82:0/3565992295 shutdown_connections 2024-06-06T02:42:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.578+0000 7f99abe00640 1 -- 172.21.15.82:0/3565992295 wait complete. 2024-06-06T02:42:29.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.580+0000 7f99abe00640 1 Processor -- start 2024-06-06T02:42:29.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.581+0000 7f99abe00640 1 -- start start 2024-06-06T02:42:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.582+0000 7f99abe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 0x7f99ac1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.582+0000 7f99abe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.582+0000 7f99abe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 0x7f99ac1b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99aa000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99aa000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41022/0 (socket says 172.21.15.82:41022) 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99aa000640 1 -- 172.21.15.82:0/1019730567 learned_addr learned my addr 172.21.15.82:0/1019730567 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac1192d0 con 0x7f99ac109760 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac119150 con 0x7f99ac10a0b0 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac119450 con 0x7f99ac1142a0 2024-06-06T02:42:29.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.583+0000 7f99ab400640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 0x7f99ac1b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.584+0000 7f99aa000640 1 -- 172.21.15.82:0/1019730567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 msgr2=0x7f99ac1b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.584+0000 7f99aa000640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 0x7f99ac1b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.584+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 0x7f99ac1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.584+0000 7f99aa000640 1 -- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 msgr2=0x7f99ac1137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.585+0000 7f99aa000640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 0x7f99ac1137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.586+0000 7f99aa000640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99ac1b4b10 con 0x7f99ac10a0b0 2024-06-06T02:42:29.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.586+0000 7f99ab400640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 0x7f99ac1b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:29.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.588+0000 7f99aa000640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f99a400cce0 tx=0x7f99a400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.588+0000 7f99a3400640 1 -- 172.21.15.82:0/1019730567 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a400f450 con 0x7f99ac10a0b0 2024-06-06T02:42:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.589+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99ac1b4e00 con 0x7f99ac10a0b0 2024-06-06T02:42:29.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.589+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99ac1b52b0 con 0x7f99ac10a0b0 2024-06-06T02:42:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.589+0000 7f99a3400640 1 -- 172.21.15.82:0/1019730567 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99a400faa0 con 0x7f99ac10a0b0 2024-06-06T02:42:29.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.589+0000 7f99a3400640 1 -- 172.21.15.82:0/1019730567 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4018c50 con 0x7f99ac10a0b0 2024-06-06T02:42:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.596+0000 7f99a3400640 1 -- 172.21.15.82:0/1019730567 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f99a400fc50 con 0x7f99ac10a0b0 2024-06-06T02:42:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.598+0000 7f99a3400640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 0x7f99900b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.598+0000 7f99a3400640 1 -- 172.21.15.82:0/1019730567 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f99a40e2570 con 0x7f99ac10a0b0 2024-06-06T02:42:29.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.599+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 0x7f99900b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.601+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 0x7f99900b4e40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f999c02b670 tx=0x7f999c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.606+0000 7f99b7f02740 1 Processor -- start 2024-06-06T02:42:29.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.608+0000 7f99b7f02740 1 -- start start 2024-06-06T02:42:29.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 0x56531e55ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e55bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56531e4cfde0 con 0x56531e18c1b0 2024-06-06T02:42:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56531e4bf380 con 0x56531e1b5070 2024-06-06T02:42:29.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.609+0000 7f99b7f02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56531e4c33c0 con 0x56531e194390 2024-06-06T02:42:29.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.610+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.610+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41030/0 (socket says 172.21.15.82:41030) 2024-06-06T02:42:29.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.610+0000 7f99aaa00640 1 -- 172.21.15.82:0/3695022464 learned_addr learned my addr 172.21.15.82:0/3695022464 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:29.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.610+0000 7f99ab400640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e55bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.610+0000 7f99aa000640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 0x56531e55ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 -- 172.21.15.82:0/3695022464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 msgr2=0x56531e55bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e55bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 -- 172.21.15.82:0/3695022464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 msgr2=0x56531e55ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 0x56531e55ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 -- 172.21.15.82:0/3695022464 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531e220650 con 0x56531e1b5070 2024-06-06T02:42:29.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aa000640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 0x56531e55ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:29.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.612+0000 7f99aaa00640 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99ac074800 tx=0x7f999c03a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b87ee8bec5cbcea6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.613+0000 7f999be00640 1 -- 172.21.15.82:0/3695022464 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c038040 con 0x56531e1b5070 2024-06-06T02:42:29.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.613+0000 7f999be00640 1 -- 172.21.15.82:0/3695022464 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0036b0 con 0x56531e1b5070 2024-06-06T02:42:29.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.614+0000 7f999be00640 1 -- 172.21.15.82:0/3695022464 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c0049f0 con 0x56531e1b5070 2024-06-06T02:42:29.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 -- 172.21.15.82:0/3695022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 msgr2=0x56531e55b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f99ac074800 tx=0x7f999c03a000 comp rx=0 tx=0).stop 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 -- 172.21.15.82:0/3695022464 shutdown_connections 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e55bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e18c1b0 0x56531e55ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 --2- 172.21.15.82:0/3695022464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e1b5070 0x56531e55b520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.615+0000 7f99b7f02740 1 -- 172.21.15.82:0/3695022464 >> 172.21.15.82:0/3695022464 conn(0x56531e1a9460 msgr2=0x56531e557d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.616+0000 7f99b7f02740 1 -- 172.21.15.82:0/3695022464 shutdown_connections 2024-06-06T02:42:29.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.616+0000 7f99b7f02740 1 -- 172.21.15.82:0/3695022464 wait complete. 2024-06-06T02:42:29.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.617+0000 7f99b7f02740 1 -- start start 2024-06-06T02:42:29.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.618+0000 7f99b7f02740 1 Processor -- start 2024-06-06T02:42:29.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e565bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56531e323700 con 0x56531e1b5070 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56531e45c6e0 con 0x56531e18c1b0 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56531e568630 con 0x56531e194390 2024-06-06T02:42:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.620+0000 7f99b7f02740 10 client.0 _ll_register_callbacks cb 0x56531e468da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.621+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e565bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.621+0000 7f99ab400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.621+0000 7f99aa000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.621+0000 7f99aa000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35832/0 (socket says 172.21.15.82:35832) 2024-06-06T02:42:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.621+0000 7f99aa000640 1 -- 172.21.15.82:0/872274098 learned_addr learned my addr 172.21.15.82:0/872274098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:29.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.622+0000 7f99aa000640 1 -- 172.21.15.82:0/872274098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 msgr2=0x56531e565bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.622+0000 7f99aa000640 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e565bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.622+0000 7f99aa000640 1 -- 172.21.15.82:0/872274098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 msgr2=0x56531e56ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.622+0000 7f99aa000640 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.622+0000 7f99aa000640 1 -- 172.21.15.82:0/872274098 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531e487f90 con 0x56531e194390 2024-06-06T02:42:29.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.623+0000 7f99aa000640 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000f80 tx=0x7f99a4018660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a375c11f81dfa677 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.623+0000 7f9998c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:42:29.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.624+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40a9b50 con 0x56531e194390 2024-06-06T02:42:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.624+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f99a40a6140 con 0x56531e194390 2024-06-06T02:42:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.625+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c0036b0 con 0x56531e194390 2024-06-06T02:42:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.626+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99a40adf00 con 0x56531e194390 2024-06-06T02:42:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.626+0000 7f99b7f02740 10 client.25858 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.626+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56531e574700 con 0x56531e194390 2024-06-06T02:42:29.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0036b0 con 0x56531e194390 2024-06-06T02:42:29.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f99a4020030 con 0x56531e194390 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 10 client.25858 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 10 client.25858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 20 client.25858 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e1739f0 0x56531e578180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 4 client.25858 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.627+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56531e4d1d30 con 0x56531e1739f0 2024-06-06T02:42:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.628+0000 7f99aaa00640 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e1739f0 0x56531e578180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.635+0000 7f9998c00640 10 client.25858 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:42:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.635+0000 7f99aaa00640 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e1739f0 0x56531e578180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a6538a89540cde66 server_cookie=c95076b1de02c471 in_seq=0 out_seq=0 2024-06-06T02:42:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f9998c00640 1 -- 172.21.15.82:0/872274098 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56531e4d1d30 con 0x56531e1739f0 2024-06-06T02:42:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f9998c00640 10 client.25858 handle_command_reply: tid=0 2024-06-06T02:42:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f99b7f02740 1 client.25858 shutdown 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 msgr2=0x56531e566110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000f80 tx=0x7f99a4018660 comp rx=0 tx=0).stop 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.638+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 shutdown_connections 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e1739f0 0x56531e578180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e566110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f99b7f02740 1 --2- 172.21.15.82:0/872274098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e565bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 >> 172.21.15.82:0/872274098 conn(0x56531e1a9460 msgr2=0x56531e55b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.639+0000 7f9998c00640 0 client.25858 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:42:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.641+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 shutdown_connections 2024-06-06T02:42:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.642+0000 7f99b7f02740 1 -- 172.21.15.82:0/872274098 wait complete. 2024-06-06T02:42:29.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.642+0000 7f99b7f02740 20 client.25858 trim_cache size 0 max 16384 2024-06-06T02:42:29.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.675+0000 7f99b7f02740 1 Processor -- start 2024-06-06T02:42:29.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.675+0000 7f99b7f02740 1 -- start start 2024-06-06T02:42:29.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e556ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9988010d10 con 0x56531e1b5070 2024-06-06T02:42:29.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f998800e5e0 con 0x56531e18c1b0 2024-06-06T02:42:29.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.676+0000 7f99b7f02740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f998800c410 con 0x56531e194390 2024-06-06T02:42:29.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aa000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aa000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35846/0 (socket says 172.21.15.82:35846) 2024-06-06T02:42:29.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aa000640 1 -- 172.21.15.82:0/2803794962 learned_addr learned my addr 172.21.15.82:0/2803794962 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:29.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e556ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99ab400640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aaa00640 1 -- 172.21.15.82:0/2803794962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 msgr2=0x56531e56b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.677+0000 7f99aaa00640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.678+0000 7f99aaa00640 1 -- 172.21.15.82:0/2803794962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 msgr2=0x56531e56be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.678+0000 7f99aaa00640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.678+0000 7f99aaa00640 1 -- 172.21.15.82:0/2803794962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56531e553640 con 0x56531e18c1b0 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.678+0000 7f99ab400640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:29.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.678+0000 7f99aa000640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:29.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.679+0000 7f99aaa00640 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e556ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56531e558740 tx=0x7f999c005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe15abd18933f778 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.679+0000 7f999b400640 1 -- 172.21.15.82:0/2803794962 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c038070 con 0x56531e18c1b0 2024-06-06T02:42:29.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.679+0000 7f999b400640 1 -- 172.21.15.82:0/2803794962 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0054f0 con 0x56531e18c1b0 2024-06-06T02:42:29.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.679+0000 7f999b400640 1 -- 172.21.15.82:0/2803794962 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c004b80 con 0x56531e18c1b0 2024-06-06T02:42:29.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 -- 172.21.15.82:0/2803794962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 msgr2=0x56531e556ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e556ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56531e558740 tx=0x7f999c005f00 comp rx=0 tx=0).stop 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 -- 172.21.15.82:0/2803794962 shutdown_connections 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e1b5070 0x56531e56be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e194390 0x56531e56b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 --2- 172.21.15.82:0/2803794962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e556ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.681+0000 7f99b7f02740 1 -- 172.21.15.82:0/2803794962 >> 172.21.15.82:0/2803794962 conn(0x56531e1a9460 msgr2=0x56531e5563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.682+0000 7f99b7f02740 1 -- 172.21.15.82:0/2803794962 shutdown_connections 2024-06-06T02:42:29.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.682+0000 7f99b7f02740 1 -- 172.21.15.82:0/2803794962 wait complete. 2024-06-06T02:42:29.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.683+0000 7f99b7f02740 1 -- start start 2024-06-06T02:42:29.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.683+0000 7f99b7f02740 1 Processor -- start 2024-06-06T02:42:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.685+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.685+0000 7f99b7f02740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e194390 0x56531e56d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.685+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.685+0000 7f99aaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:41044/0 (socket says 172.21.15.82:41044) 2024-06-06T02:42:29.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.686+0000 7f99aaa00640 1 -- 172.21.15.82:0/1210229610 learned_addr learned my addr 172.21.15.82:0/1210229610 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:29.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.686+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 0x56531e5de940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.686+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f998800caa0 con 0x56531e194390 2024-06-06T02:42:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.686+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f998800df10 con 0x56531e18c1b0 2024-06-06T02:42:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.687+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f998800d170 con 0x56531e1b5070 2024-06-06T02:42:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.686+0000 7f99ab400640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 0x56531e5de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.687+0000 7f99aa000640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e194390 0x56531e56d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99b7f02740 10 client.0 _ll_register_callbacks cb 0x7f99a40a5a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99aaa00640 1 -- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 msgr2=0x56531e5de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 0x56531e5de940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99aaa00640 1 -- 172.21.15.82:0/1210229610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e194390 msgr2=0x56531e56d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e194390 0x56531e56d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.688+0000 7f99aaa00640 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531e56dcf0 con 0x56531e18c1b0 2024-06-06T02:42:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.689+0000 7f99ab400640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 0x56531e5de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:42:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.689+0000 7f99aaa00640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f999c02b0c0 tx=0x7f999c005e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f31c3b1fbbb597 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.689+0000 7f9998c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:42:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.691+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999c038040 con 0x56531e18c1b0 2024-06-06T02:42:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.691+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f999c00a2d0 con 0x56531e18c1b0 2024-06-06T02:42:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.691+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f999c0054f0 con 0x56531e18c1b0 2024-06-06T02:42:29.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.692+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f999c02bbb0 con 0x56531e18c1b0 2024-06-06T02:42:29.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.693+0000 7f99b7f02740 10 client.25832 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:29.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.693+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56531e5dfe10 con 0x56531e18c1b0 2024-06-06T02:42:29.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.693+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f999c0054f0 con 0x56531e18c1b0 2024-06-06T02:42:29.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f999c03b030 con 0x56531e18c1b0 2024-06-06T02:42:29.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 10 client.25832 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 10 client.25832 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 20 client.25832 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e148da0 0x56531e5e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 4 client.25832 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.695+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56531e4cd7d0 con 0x56531e148da0 2024-06-06T02:42:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.696+0000 7f99aa000640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e148da0 0x56531e5e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.696+0000 7f99aa000640 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e148da0 0x56531e5e1ff0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bd4b01c619ae288 server_cookie=9e5cf0bf5614946 in_seq=0 out_seq=0 2024-06-06T02:42:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.696+0000 7f9998c00640 10 client.25832 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:42:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.697+0000 7f9998c00640 1 -- 172.21.15.82:0/1210229610 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56531e4cd7d0 con 0x56531e148da0 2024-06-06T02:42:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.697+0000 7f9998c00640 10 client.25832 handle_command_reply: tid=0 2024-06-06T02:42:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.697+0000 7f99b7f02740 1 client.25832 shutdown 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 msgr2=0x56531e56cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f999c02b0c0 tx=0x7f999c005e90 comp rx=0 tx=0).stop 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 shutdown_connections 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56531e148da0 0x56531e5e1ff0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56531e1b5070 0x56531e5de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56531e194390 0x56531e56d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 --2- 172.21.15.82:0/1210229610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56531e18c1b0 0x56531e56cf00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 >> 172.21.15.82:0/1210229610 conn(0x56531e1a9460 msgr2=0x56531e566ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.699+0000 7f9998c00640 0 client.25832 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:42:29.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.700+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 shutdown_connections 2024-06-06T02:42:29.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.700+0000 7f99b7f02740 1 -- 172.21.15.82:0/1210229610 wait complete. 2024-06-06T02:42:29.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.702+0000 7f99b7f02740 20 client.25832 trim_cache size 0 max 16384 2024-06-06T02:42:29.703 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:42:29.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 msgr2=0x7f99900b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 0x7f99900b4e40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f999c02b670 tx=0x7f999c005fd0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 msgr2=0x7f99ac113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f99a400cce0 tx=0x7f99a400a620 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 shutdown_connections 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f99900b2930 0x7f99900b4e40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99ac1142a0 0x7f99ac1b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99ac10a0b0 0x7f99ac113d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 --2- 172.21.15.82:0/1019730567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99ac109760 0x7f99ac1137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 >> 172.21.15.82:0/1019730567 conn(0x7f99ac06eda0 msgr2=0x7f99ac06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.705+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 shutdown_connections 2024-06-06T02:42:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:29.706+0000 7f99abe00640 1 -- 172.21.15.82:0/1019730567 wait complete. 2024-06-06T02:42:30.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:29 smithi184 ceph-mon[36922]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:42:30.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:29 smithi103 ceph-mon[36349]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:42:30.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:29 smithi082 ceph-mon[31579]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:42:32.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:32 smithi103 ceph-mon[36349]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 96 MiB/s wr, 14.28k op/s 2024-06-06T02:42:32.370 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:32 smithi082 ceph-mon[31579]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 96 MiB/s wr, 14.28k op/s 2024-06-06T02:42:32.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:32 smithi184 ceph-mon[36922]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 96 MiB/s wr, 14.28k op/s 2024-06-06T02:42:34.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:34 smithi103 ceph-mon[36349]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 MiB/s wr, 13.98k op/s 2024-06-06T02:42:34.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:34 smithi082 ceph-mon[31579]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 MiB/s wr, 13.98k op/s 2024-06-06T02:42:34.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:34 smithi184 ceph-mon[36922]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 92 MiB/s wr, 13.98k op/s 2024-06-06T02:42:35.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T02:42:35.363 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:35 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:42:35.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:35 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:42:35.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:35 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:42:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:42:36.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 80 MiB/s wr, 12.24k op/s 2024-06-06T02:42:36.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi103 to 176.2M 2024-06-06T02:42:36.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:36 smithi103 ceph-mon[36349]: Unable to set osd_memory_target on smithi103 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-06-06T02:42:36.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 80 MiB/s wr, 12.24k op/s 2024-06-06T02:42:36.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi103 to 176.2M 2024-06-06T02:42:36.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:36 smithi082 ceph-mon[31579]: Unable to set osd_memory_target on smithi103 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 80 MiB/s wr, 12.24k op/s 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:36.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi103 to 176.2M 2024-06-06T02:42:36.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:36 smithi184 ceph-mon[36922]: Unable to set osd_memory_target on smithi103 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-06-06T02:42:37.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:37 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:37.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:37 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:37.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:37 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 86 MiB/s wr, 13.38k op/s 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-06-06T02:42:38.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-06-06T02:42:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:42:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:42:38.399 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:42:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 86 MiB/s wr, 13.38k op/s 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:42:38.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: pgmap v591: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 86 MiB/s wr, 13.38k op/s 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:42:38.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:42:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.576+0000 7fad8da00640 1 -- 172.21.15.82:0/1739166731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad88104440 msgr2=0x7fad8810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.576+0000 7fad8da00640 1 --2- 172.21.15.82:0/1739166731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad88104440 0x7fad8810ad40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fad80009be0 tx=0x7fad8002a6f0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 -- 172.21.15.82:0/1739166731 shutdown_connections 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 --2- 172.21.15.82:0/1739166731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad88104440 0x7fad8810ad40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 --2- 172.21.15.82:0/1739166731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 --2- 172.21.15.82:0/1739166731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad881029d0 0x7fad88102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 -- 172.21.15.82:0/1739166731 >> 172.21.15.82:0/1739166731 conn(0x7fad880fe1d0 msgr2=0x7fad88100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 -- 172.21.15.82:0/1739166731 shutdown_connections 2024-06-06T02:42:39.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.577+0000 7fad8da00640 1 -- 172.21.15.82:0/1739166731 wait complete. 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.578+0000 7fad8da00640 1 Processor -- start 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.579+0000 7fad8da00640 1 -- start start 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.579+0000 7fad8da00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 0x7fad881137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.579+0000 7fad8da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad8da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad88104440 0x7fad88111f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad87400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad87400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88113d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53414/0 (socket says 172.21.15.82:53414) 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810c2e0 con 0x7fad88103af0 2024-06-06T02:42:39.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad87400640 1 -- 172.21.15.82:0/1705226253 learned_addr learned my addr 172.21.15.82:0/1705226253 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810c160 con 0x7fad88104440 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad8810c460 con 0x7fad881029d0 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad8d000640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad88104440 0x7fad88111f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.580+0000 7fad87e00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 0x7fad881137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.581+0000 7fad87e00640 1 -- 172.21.15.82:0/1705226253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad88104440 msgr2=0x7fad88111f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.581+0000 7fad87e00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad88104440 0x7fad88111f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.581+0000 7fad87e00640 1 -- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 msgr2=0x7fad88113d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.581+0000 7fad87e00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88113d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.581+0000 7fad87e00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad88112790 con 0x7fad881029d0 2024-06-06T02:42:39.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.582+0000 7fad87e00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 0x7fad881137e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad881039f0 tx=0x7fad7000ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.584+0000 7fad84c00640 1 -- 172.21.15.82:0/1705226253 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7000ccd0 con 0x7fad881029d0 2024-06-06T02:42:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.584+0000 7fad84c00640 1 -- 172.21.15.82:0/1705226253 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad700035f0 con 0x7fad881029d0 2024-06-06T02:42:39.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.584+0000 7fad84c00640 1 -- 172.21.15.82:0/1705226253 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70010690 con 0x7fad881029d0 2024-06-06T02:42:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.586+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad88112a80 con 0x7fad881029d0 2024-06-06T02:42:39.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.586+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad881b0250 con 0x7fad881029d0 2024-06-06T02:42:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 Processor -- start 2024-06-06T02:42:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 -- start start 2024-06-06T02:42:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80dff2f0 0x556b811cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556b8113f480 con 0x556b80dff2f0 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556b8112ea20 con 0x556b80e281b0 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.591+0000 7fad95ff2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556b81132a60 con 0x556b80e074d0 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38336/0 (socket says 172.21.15.82:38336) 2024-06-06T02:42:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 -- 172.21.15.82:0/3340368498 learned_addr learned my addr 172.21.15.82:0/3340368498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad87400640 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 -- 172.21.15.82:0/3340368498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 msgr2=0x556b811d4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811d4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 -- 172.21.15.82:0/3340368498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80dff2f0 msgr2=0x556b811cd480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:42:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80dff2f0 0x556b811cd480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.592+0000 7fad8d000640 1 -- 172.21.15.82:0/3340368498 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b8112b8d0 con 0x556b80e281b0 2024-06-06T02:42:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.593+0000 7fad8d000640 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad80030950 tx=0x7fad80030410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e340202781013d28 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.593+0000 7fad7d600640 1 -- 172.21.15.82:0/3340368498 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80036040 con 0x556b80e281b0 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.593+0000 7fad7d600640 1 -- 172.21.15.82:0/3340368498 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad80003e20 con 0x556b80e281b0 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.593+0000 7fad7d600640 1 -- 172.21.15.82:0/3340368498 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80031a90 con 0x556b80e281b0 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.595+0000 7fad95ff2740 1 -- 172.21.15.82:0/3340368498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 msgr2=0x556b811ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.595+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fad80030950 tx=0x7fad80030410 comp rx=0 tx=0).stop 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.596+0000 7fad95ff2740 1 -- 172.21.15.82:0/3340368498 shutdown_connections 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.596+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811d4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.596+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80dff2f0 0x556b811cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.596+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3340368498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80e281b0 0x556b811ccf40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.596+0000 7fad95ff2740 1 -- 172.21.15.82:0/3340368498 >> 172.21.15.82:0/3340368498 conn(0x556b80e1c300 msgr2=0x556b811c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.603+0000 7fad84c00640 1 -- 172.21.15.82:0/1705226253 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fad70003a80 con 0x7fad881029d0 2024-06-06T02:42:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.605+0000 7fad84c00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 0x7fad6c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.605+0000 7fad84c00640 1 -- 172.21.15.82:0/1705226253 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fad700e23b0 con 0x7fad881029d0 2024-06-06T02:42:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.605+0000 7fad87400640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 0x7fad6c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.606+0000 7fad95ff2740 1 -- 172.21.15.82:0/3340368498 shutdown_connections 2024-06-06T02:42:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.608+0000 7fad95ff2740 1 -- 172.21.15.82:0/3340368498 wait complete. 2024-06-06T02:42:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.608+0000 7fad87400640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 0x7fad6c0b4d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x556b811c9680 tx=0x7fad78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.608+0000 7fad95ff2740 1 -- start start 2024-06-06T02:42:39.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.609+0000 7fad95ff2740 1 Processor -- start 2024-06-06T02:42:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556b81069ab0 con 0x556b80e074d0 2024-06-06T02:42:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556b810cc630 con 0x556b80de6d80 2024-06-06T02:42:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x556b811d4cb0 con 0x556b80e281b0 2024-06-06T02:42:39.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad95ff2740 10 client.0 _ll_register_callbacks cb 0x556b810d2610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad87400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.611+0000 7fad87400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:43448/0 (socket says 172.21.15.82:43448) 2024-06-06T02:42:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.611+0000 7fad87400640 1 -- 172.21.15.82:0/3493072307 learned_addr learned my addr 172.21.15.82:0/3493072307 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.611+0000 7fad87400640 1 -- 172.21.15.82:0/3493072307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 msgr2=0x556b811ddb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.610+0000 7fad87e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.611+0000 7fad8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad87400640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811ddb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad87400640 1 -- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 msgr2=0x556b811d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad87400640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811d6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad87400640 1 -- 172.21.15.82:0/3493072307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b810f9170 con 0x556b80e281b0 2024-06-06T02:42:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad87e00640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.616+0000 7fad8d000640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811ddb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:42:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.617+0000 7fad87400640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad780045e0 tx=0x7fad78004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b40b6988e2506279 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.617+0000 7fad76000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:42:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.617+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78009e50 con 0x556b80e281b0 2024-06-06T02:42:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.617+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fad7801e680 con 0x556b80e281b0 2024-06-06T02:42:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.618+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad80003e20 con 0x556b80e281b0 2024-06-06T02:42:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.618+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad7801e880 con 0x556b80e281b0 2024-06-06T02:42:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.620+0000 7fad95ff2740 10 client.25876 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.620+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b80e93790 con 0x556b80e281b0 2024-06-06T02:42:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.620+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad80003e20 con 0x556b80e281b0 2024-06-06T02:42:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.620+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fad78027070 con 0x556b80e281b0 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 10 client.25876 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 20 client.25876 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b80dbc1c0 0x556b811e4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 4 client.25876 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.622+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b811413d0 con 0x556b80dbc1c0 2024-06-06T02:42:39.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.625+0000 7fad87e00640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b80dbc1c0 0x556b811e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.628+0000 7fad76000640 10 client.25876 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.628+0000 7fad87e00640 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b80dbc1c0 0x556b811e4320 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6fdc35820543e83 server_cookie=d9b0788bbab5ec41 in_seq=0 out_seq=0 2024-06-06T02:42:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.630+0000 7fad76000640 1 -- 172.21.15.82:0/3493072307 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556b811413d0 con 0x556b80dbc1c0 2024-06-06T02:42:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.630+0000 7fad76000640 10 client.25876 handle_command_reply: tid=0 2024-06-06T02:42:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.630+0000 7fad95ff2740 1 client.25876 shutdown 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.630+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 msgr2=0x556b811d6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.630+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad780045e0 tx=0x7fad78004730 comp rx=0 tx=0).stop 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 shutdown_connections 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811ddb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811d6c80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b80dbc1c0 0x556b811e4320 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3493072307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 >> 172.21.15.82:0/3493072307 conn(0x556b80e1c300 msgr2=0x556b811c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad76000640 0 client.25876 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 shutdown_connections 2024-06-06T02:42:39.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.631+0000 7fad95ff2740 1 -- 172.21.15.82:0/3493072307 wait complete. 2024-06-06T02:42:39.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.634+0000 7fad95ff2740 20 client.25876 trim_cache size 0 max 16384 2024-06-06T02:42:39.671 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.671+0000 7fad95ff2740 1 Processor -- start 2024-06-06T02:42:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.672+0000 7fad95ff2740 1 -- start start 2024-06-06T02:42:39.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.672+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.673+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.673+0000 7fad87e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.673+0000 7fad87e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38356/0 (socket says 172.21.15.82:38356) 2024-06-06T02:42:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.674+0000 7fad87e00640 1 -- 172.21.15.82:0/961323400 learned_addr learned my addr 172.21.15.82:0/961323400 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:39.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.674+0000 7fad95ff2740 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e281b0 0x556b811d5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.674+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad881bba10 con 0x556b80e281b0 2024-06-06T02:42:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.674+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b92e0 con 0x556b80de6d80 2024-06-06T02:42:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.674+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b70d0 con 0x556b80e074d0 2024-06-06T02:42:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.675+0000 7fad87400640 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.675+0000 7fad8d000640 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e281b0 0x556b811d5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.675+0000 7fad87e00640 1 -- 172.21.15.82:0/961323400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 msgr2=0x556b811dda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.675+0000 7fad87e00640 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811dda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.675+0000 7fad87e00640 1 -- 172.21.15.82:0/961323400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e281b0 msgr2=0x556b811d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.676+0000 7fad87e00640 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e281b0 0x556b811d5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.676+0000 7fad87e00640 1 -- 172.21.15.82:0/961323400 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b80f0c620 con 0x556b80de6d80 2024-06-06T02:42:39.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.676+0000 7fad87e00640 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad70004610 tx=0x7fad700a5890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27af21a616d857fd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.678+0000 7fad7cc00640 1 -- 172.21.15.82:0/961323400 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad700c3070 con 0x556b80de6d80 2024-06-06T02:42:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.678+0000 7fad7cc00640 1 -- 172.21.15.82:0/961323400 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad7008e070 con 0x556b80de6d80 2024-06-06T02:42:39.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.678+0000 7fad7cc00640 1 -- 172.21.15.82:0/961323400 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad700a99d0 con 0x556b80de6d80 2024-06-06T02:42:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.679+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 msgr2=0x556b811d57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.679+0000 7fad95ff2740 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad70004610 tx=0x7fad700a5890 comp rx=0 tx=0).stop 2024-06-06T02:42:39.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.681+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 shutdown_connections 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.681+0000 7fad95ff2740 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e281b0 0x556b811d5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.681+0000 7fad95ff2740 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e074d0 0x556b811dda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.681+0000 7fad95ff2740 1 --2- 172.21.15.82:0/961323400 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b80de6d80 0x556b811d57c0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fad70004610 tx=0x7fad700a5890 comp rx=0 tx=0).stop 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.681+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 >> 172.21.15.82:0/961323400 conn(0x556b80e1c300 msgr2=0x556b811d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.682+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 shutdown_connections 2024-06-06T02:42:39.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.682+0000 7fad95ff2740 1 -- 172.21.15.82:0/961323400 wait complete. 2024-06-06T02:42:39.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.685+0000 7fad95ff2740 1 -- start start 2024-06-06T02:42:39.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.685+0000 7fad95ff2740 1 Processor -- start 2024-06-06T02:42:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.688+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811da940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.688+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.688+0000 7fad95ff2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.689+0000 7fad95ff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b77a0 con 0x556b80e074d0 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad8d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38364/0 (socket says 172.21.15.82:38364) 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad8d000640 1 -- 172.21.15.82:0/3891563138 learned_addr learned my addr 172.21.15.82:0/3891563138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b8c10 con 0x556b81248b70 2024-06-06T02:42:39.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad87400640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fad881b7e70 con 0x556b80e281b0 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad95ff2740 10 client.0 _ll_register_callbacks cb 0x7fad780044a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.691+0000 7fad87e00640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811da940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 -- 172.21.15.82:0/3891563138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 msgr2=0x556b811dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811dae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 -- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 msgr2=0x556b811da940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:39.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811da940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b811dde00 con 0x556b81248b70 2024-06-06T02:42:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad8d000640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad80006010 tx=0x7fad80030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444fa79d81cd58b2 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.692+0000 7fad76000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:42:39.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.693+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80036040 con 0x556b81248b70 2024-06-06T02:42:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.693+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fad80003970 con 0x556b81248b70 2024-06-06T02:42:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.694+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad7008e070 con 0x556b81248b70 2024-06-06T02:42:39.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.694+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad80059050 con 0x556b81248b70 2024-06-06T02:42:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.694+0000 7fad95ff2740 10 client.25847 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.694+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b8124c560 con 0x556b81248b70 2024-06-06T02:42:39.695 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.695+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad800318f0 con 0x556b81248b70 2024-06-06T02:42:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fad800041f0 con 0x556b81248b70 2024-06-06T02:42:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 10 client.25847 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 10 client.25847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:39.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 20 client.25847 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b8124cb20 0x556b8124ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 4 client.25847 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:42:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.697+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fad7008e070 con 0x556b8124cb20 2024-06-06T02:42:39.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.698+0000 7fad87e00640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b8124cb20 0x556b8124ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.698+0000 7fad87e00640 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b8124cb20 0x556b8124ef40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6d05c06d779517 server_cookie=8bbb599543017ef1 in_seq=0 out_seq=0 2024-06-06T02:42:39.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:39.698+0000 7fad76000640 10 client.25847 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:40 smithi103 ceph-mon[36349]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 77 MiB/s wr, 12.02k op/s 2024-06-06T02:42:40.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:40 smithi082 ceph-mon[31579]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 77 MiB/s wr, 12.02k op/s 2024-06-06T02:42:40.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:40 smithi184 ceph-mon[36922]: pgmap v592: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 77 MiB/s wr, 12.02k op/s 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad76000640 1 -- 172.21.15.82:0/3891563138 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fad7008e070 con 0x556b8124cb20 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad76000640 10 client.25847 handle_command_reply: tid=0 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 client.25847 shutdown 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 msgr2=0x556b8124af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad80006010 tx=0x7fad80030650 comp rx=0 tx=0).stop 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 shutdown_connections 2024-06-06T02:42:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556b81248b70 0x556b8124af90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x556b80e281b0 0x556b811dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.128+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x556b8124cb20 0x556b8124ef40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad95ff2740 1 --2- 172.21.15.82:0/3891563138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556b80e074d0 0x556b811da940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad76000640 0 client.25847 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 >> 172.21.15.82:0/3891563138 conn(0x556b80e1c300 msgr2=0x556b811c7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 shutdown_connections 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad95ff2740 1 -- 172.21.15.82:0/3891563138 wait complete. 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.129+0000 7fad95ff2740 20 client.25847 trim_cache size 0 max 16384 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:42:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:42:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:42:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:42:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 msgr2=0x7fad6c0b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 0x7fad6c0b4d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x556b811c9680 tx=0x7fad78005f90 comp rx=0 tx=0).stop 2024-06-06T02:42:41.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 msgr2=0x7fad881137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 0x7fad881137e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad881039f0 tx=0x7fad7000ee50 comp rx=0 tx=0).stop 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 shutdown_connections 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad88104440 0x7fad88111f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad88103af0 0x7fad88113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fad6c0b2850 0x7fad6c0b4d60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 --2- 172.21.15.82:0/1705226253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad881029d0 0x7fad881137e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 >> 172.21.15.82:0/1705226253 conn(0x7fad880fe1d0 msgr2=0x7fad88106d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 shutdown_connections 2024-06-06T02:42:41.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:41.130+0000 7fad8da00640 1 -- 172.21.15.82:0/1705226253 wait complete. 2024-06-06T02:42:42.487 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:42 smithi082 ceph-mon[31579]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 83 MiB/s wr, 12.77k op/s 2024-06-06T02:42:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:42 smithi103 ceph-mon[36349]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 83 MiB/s wr, 12.77k op/s 2024-06-06T02:42:42.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:42 smithi184 ceph-mon[36922]: pgmap v593: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 83 MiB/s wr, 12.77k op/s 2024-06-06T02:42:44.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:44 smithi103 ceph-mon[36349]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 84 MiB/s wr, 12.78k op/s 2024-06-06T02:42:44.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:44 smithi082 ceph-mon[31579]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 84 MiB/s wr, 12.78k op/s 2024-06-06T02:42:44.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:44 smithi184 ceph-mon[36922]: pgmap v594: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 84 MiB/s wr, 12.78k op/s 2024-06-06T02:42:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:46 smithi103 ceph-mon[36349]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 11.19k op/s 2024-06-06T02:42:46.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:46 smithi082 ceph-mon[31579]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 11.19k op/s 2024-06-06T02:42:46.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:46 smithi184 ceph-mon[36922]: pgmap v595: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 11.19k op/s 2024-06-06T02:42:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:48 smithi103 ceph-mon[36349]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 MiB/s wr, 11.59k op/s 2024-06-06T02:42:48.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:48 smithi082 ceph-mon[31579]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 MiB/s wr, 11.59k op/s 2024-06-06T02:42:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:48 smithi184 ceph-mon[36922]: pgmap v596: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 MiB/s wr, 11.59k op/s 2024-06-06T02:42:50.369 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:50 smithi082 ceph-mon[31579]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 11.73k op/s 2024-06-06T02:42:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:50 smithi103 ceph-mon[36349]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 11.73k op/s 2024-06-06T02:42:50.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:50 smithi184 ceph-mon[36922]: pgmap v597: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 79 MiB/s wr, 11.73k op/s 2024-06-06T02:42:52.540 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:52 smithi082 ceph-mon[31579]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 85 MiB/s wr, 12.49k op/s 2024-06-06T02:42:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:52 smithi103 ceph-mon[36349]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 85 MiB/s wr, 12.49k op/s 2024-06-06T02:42:52.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:52 smithi184 ceph-mon[36922]: pgmap v598: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 85 MiB/s wr, 12.49k op/s 2024-06-06T02:42:54.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:54 smithi103 ceph-mon[36349]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 MiB/s wr, 12.34k op/s 2024-06-06T02:42:54.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:54 smithi082 ceph-mon[31579]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 MiB/s wr, 12.34k op/s 2024-06-06T02:42:54.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:54 smithi184 ceph-mon[36922]: pgmap v599: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 83 MiB/s wr, 12.34k op/s 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 -- 172.21.15.82:0/4130631959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c074c20 msgr2=0x7f414c077680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 --2- 172.21.15.82:0/4130631959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c074c20 0x7f414c077680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4138009900 tx=0x7f413802b530 comp rx=0 tx=0).stop 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 -- 172.21.15.82:0/4130631959 shutdown_connections 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 --2- 172.21.15.82:0/4130631959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c07a2f0 0x7f414c07c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 --2- 172.21.15.82:0/4130631959 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0750c0 0x7f414c079c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 --2- 172.21.15.82:0/4130631959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c074c20 0x7f414c077680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.750+0000 7f4150e00640 1 -- 172.21.15.82:0/4130631959 >> 172.21.15.82:0/4130631959 conn(0x7f414c06fa60 msgr2=0x7f414c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.751+0000 7f4150e00640 1 -- 172.21.15.82:0/4130631959 shutdown_connections 2024-06-06T02:42:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.751+0000 7f4150e00640 1 -- 172.21.15.82:0/4130631959 wait complete. 2024-06-06T02:42:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.753+0000 7f4150e00640 1 Processor -- start 2024-06-06T02:42:54.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.754+0000 7f4150e00640 1 -- start start 2024-06-06T02:42:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.755+0000 7f4150e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.755+0000 7f414b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.756+0000 7f4150e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 0x7f414c1b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.756+0000 7f414b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42792/0 (socket says 172.21.15.82:42792) 2024-06-06T02:42:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.756+0000 7f414b400640 1 -- 172.21.15.82:0/390911631 learned_addr learned my addr 172.21.15.82:0/390911631 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.756+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c07a2f0 0x7f414c1b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.757+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f414c07fe60 con 0x7f414c074c20 2024-06-06T02:42:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.757+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f414c07fce0 con 0x7f414c07a2f0 2024-06-06T02:42:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.757+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f414c07ffe0 con 0x7f414c0750c0 2024-06-06T02:42:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.757+0000 7f414aa00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 0x7f414c1b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.758 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.758+0000 7f414b400640 1 -- 172.21.15.82:0/390911631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 msgr2=0x7f414c1b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.758+0000 7f414b400640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 0x7f414c1b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.758+0000 7f414b400640 1 -- 172.21.15.82:0/390911631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c07a2f0 msgr2=0x7f414c1b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.758+0000 7f414b400640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c07a2f0 0x7f414c1b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.758+0000 7f414b400640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c1b80b0 con 0x7f414c074c20 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.759+0000 7f414aa00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 0x7f414c1b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:42:54.759 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.759+0000 7f414b400640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4138033fd0 tx=0x7f41380038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.760+0000 7f4143e00640 1 -- 172.21.15.82:0/390911631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138041070 con 0x7f414c074c20 2024-06-06T02:42:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.761+0000 7f4143e00640 1 -- 172.21.15.82:0/390911631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413803b8a0 con 0x7f414c074c20 2024-06-06T02:42:54.761 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.761+0000 7f4143e00640 1 -- 172.21.15.82:0/390911631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138036040 con 0x7f414c074c20 2024-06-06T02:42:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.762+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c1b8340 con 0x7f414c074c20 2024-06-06T02:42:54.762 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.762+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1b87e0 con 0x7f414c074c20 2024-06-06T02:42:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.773+0000 7f4159572740 1 Processor -- start 2024-06-06T02:42:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.773+0000 7f4159572740 1 -- start start 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3471b0 0x55fdef6ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef31e2f0 0x55fdef6ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fdef65e480 con 0x55fdef31e2f0 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fdef64da20 con 0x55fdef3471b0 2024-06-06T02:42:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f4159572740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdef651a60 con 0x55fdef3264d0 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f414aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f414aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:60412/0 (socket says 172.21.15.82:60412) 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f414aa00640 1 -- 172.21.15.82:0/2552849496 learned_addr learned my addr 172.21.15.82:0/2552849496 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.778+0000 7f414be00640 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3471b0 0x55fdef6ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 -- 172.21.15.82:0/2552849496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3471b0 msgr2=0x55fdef6ebef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3471b0 0x55fdef6ebef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 -- 172.21.15.82:0/2552849496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef31e2f0 msgr2=0x55fdef6ec430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:42:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef31e2f0 0x55fdef6ec430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 -- 172.21.15.82:0/2552849496 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdef64a8d0 con 0x55fdef3264d0 2024-06-06T02:42:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.779+0000 7f414aa00640 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f413c00bd00 tx=0x7f413c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=338662612930cb30 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.780+0000 7f4143e00640 1 -- 172.21.15.82:0/390911631 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4138044070 con 0x7f414c074c20 2024-06-06T02:42:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.780+0000 7f4140c00640 1 -- 172.21.15.82:0/2552849496 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c015070 con 0x55fdef3264d0 2024-06-06T02:42:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.780+0000 7f4140c00640 1 -- 172.21.15.82:0/2552849496 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413c01a910 con 0x55fdef3264d0 2024-06-06T02:42:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.780+0000 7f4140c00640 1 -- 172.21.15.82:0/2552849496 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c0119c0 con 0x55fdef3264d0 2024-06-06T02:42:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.782+0000 7f4159572740 1 -- 172.21.15.82:0/2552849496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 msgr2=0x55fdef6f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.782+0000 7f4159572740 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f413c00bd00 tx=0x7f413c00f730 comp rx=0 tx=0).stop 2024-06-06T02:42:54.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.784+0000 7f4159572740 1 -- 172.21.15.82:0/2552849496 shutdown_connections 2024-06-06T02:42:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.784+0000 7f4159572740 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3264d0 0x55fdef6f32f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.784+0000 7f4159572740 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef31e2f0 0x55fdef6ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.784+0000 7f4159572740 1 --2- 172.21.15.82:0/2552849496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3471b0 0x55fdef6ebef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.784+0000 7f4159572740 1 -- 172.21.15.82:0/2552849496 >> 172.21.15.82:0/2552849496 conn(0x55fdef33b300 msgr2=0x55fdef6e78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.786+0000 7f4143e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 0x7f41300b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.786+0000 7f4143e00640 1 -- 172.21.15.82:0/390911631 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4138102660 con 0x7f414c074c20 2024-06-06T02:42:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.787+0000 7f414aa00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 0x7f41300b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.789 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.789+0000 7f414aa00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 0x7f41300b4f10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f413c005bc0 tx=0x7f413c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.790+0000 7f4159572740 1 -- 172.21.15.82:0/2552849496 shutdown_connections 2024-06-06T02:42:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.790+0000 7f4159572740 1 -- 172.21.15.82:0/2552849496 wait complete. 2024-06-06T02:42:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.791+0000 7f4159572740 1 -- start start 2024-06-06T02:42:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.792+0000 7f4159572740 1 Processor -- start 2024-06-06T02:42:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.793+0000 7f4159572740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.793+0000 7f4159572740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.793+0000 7f414b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.794+0000 7f414b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47020/0 (socket says 172.21.15.82:47020) 2024-06-06T02:42:54.794 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.794+0000 7f414b400640 1 -- 172.21.15.82:0/2973094403 learned_addr learned my addr 172.21.15.82:0/2973094403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.794+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3471b0 0x55fdef6fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.794+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fdef588ab0 con 0x55fdef3264d0 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.794+0000 7f414be00640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3471b0 0x55fdef6fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.795+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fdef5eb630 con 0x55fdef31e2f0 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.795+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55fdef6f3cc0 con 0x55fdef3471b0 2024-06-06T02:42:54.795 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.795+0000 7f4159572740 10 client.0 _ll_register_callbacks cb 0x55fdef5f1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 -- 172.21.15.82:0/2973094403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3471b0 msgr2=0x55fdef6fcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3471b0 0x55fdef6fcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 -- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 msgr2=0x55fdef6f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdef618170 con 0x55fdef31e2f0 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f414b400640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4138009850 tx=0x7f413802b530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e1c522af27b585 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.796+0000 7f4135600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.797+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380c9750 con 0x55fdef31e2f0 2024-06-06T02:42:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.797+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f413c01a910 con 0x55fdef31e2f0 2024-06-06T02:42:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.798+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f413803bd70 con 0x55fdef31e2f0 2024-06-06T02:42:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.799+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f41380ca340 con 0x55fdef31e2f0 2024-06-06T02:42:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.799+0000 7f4159572740 10 client.25856 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.799+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fdef3b2790 con 0x55fdef31e2f0 2024-06-06T02:42:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.799+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413c01a910 con 0x55fdef31e2f0 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.800+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f41380c5ed0 con 0x55fdef31e2f0 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.801+0000 7f4159572740 10 client.25856 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.801+0000 7f4159572740 10 client.25856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.802+0000 7f4159572740 20 client.25856 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.802+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef305d80 0x55fdef702e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.802+0000 7f4159572740 4 client.25856 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.802+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdef6603d0 con 0x55fdef305d80 2024-06-06T02:42:54.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.802+0000 7f414aa00640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef305d80 0x55fdef702e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.803+0000 7f414aa00640 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef305d80 0x55fdef702e00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fff68cef2928f0 server_cookie=94d1d091e2636466 in_seq=0 out_seq=0 2024-06-06T02:42:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.803+0000 7f4135600640 10 client.25856 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.805+0000 7f4135600640 1 -- 172.21.15.82:0/2973094403 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fdef6603d0 con 0x55fdef305d80 2024-06-06T02:42:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.805+0000 7f4135600640 10 client.25856 handle_command_reply: tid=0 2024-06-06T02:42:54.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.805+0000 7f4159572740 1 client.25856 shutdown 2024-06-06T02:42:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 msgr2=0x55fdef6f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4138009850 tx=0x7f413802b530 comp rx=0 tx=0).stop 2024-06-06T02:42:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 shutdown_connections 2024-06-06T02:42:54.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef3471b0 0x55fdef6fcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef305d80 0x55fdef702e00 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4135600640 0 client.25856 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 --2- 172.21.15.82:0/2973094403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6f56c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.806+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 >> 172.21.15.82:0/2973094403 conn(0x55fdef33b300 msgr2=0x55fdef6e87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.807+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 shutdown_connections 2024-06-06T02:42:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.807+0000 7f4159572740 1 -- 172.21.15.82:0/2973094403 wait complete. 2024-06-06T02:42:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.807+0000 7f4159572740 20 client.25856 trim_cache size 0 max 16384 2024-06-06T02:42:54.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.848+0000 7f4159572740 1 Processor -- start 2024-06-06T02:42:54.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.848+0000 7f4159572740 1 -- start start 2024-06-06T02:42:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.849+0000 7f4159572740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef305d80 0x55fdef6e8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.849+0000 7f4159572740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 0x55fdef6fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.849+0000 7f4159572740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 0x55fdef6e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f414be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 0x55fdef6e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f414be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 0x55fdef6e8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47022/0 (socket says 172.21.15.82:47022) 2024-06-06T02:42:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f414be00640 1 -- 172.21.15.82:0/3265943742 learned_addr learned my addr 172.21.15.82:0/3265943742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d4ff0 con 0x55fdef305d80 2024-06-06T02:42:54.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.850+0000 7f414aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 0x55fdef6fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f414b400640 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef305d80 0x55fdef6e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d28c0 con 0x55fdef3264d0 2024-06-06T02:42:54.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.851+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d06f0 con 0x55fdef31e2f0 2024-06-06T02:42:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.852+0000 7f414aa00640 1 -- 172.21.15.82:0/3265943742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 msgr2=0x55fdef6e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.852+0000 7f414aa00640 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 0x55fdef6e8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.852+0000 7f414aa00640 1 -- 172.21.15.82:0/3265943742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef305d80 msgr2=0x55fdef6e8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.852+0000 7f414aa00640 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef305d80 0x55fdef6e8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.852+0000 7f414aa00640 1 -- 172.21.15.82:0/3265943742 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdef42b620 con 0x55fdef31e2f0 2024-06-06T02:42:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.854+0000 7f414aa00640 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 0x55fdef6fca10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f413c005fb0 tx=0x7f413c00b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da41ebde52c47a2f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.854+0000 7f4137e00640 1 -- 172.21.15.82:0/3265943742 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c035070 con 0x55fdef31e2f0 2024-06-06T02:42:54.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.854+0000 7f4137e00640 1 -- 172.21.15.82:0/3265943742 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413c00b840 con 0x55fdef31e2f0 2024-06-06T02:42:54.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.856+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 msgr2=0x55fdef6fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.856+0000 7f4137e00640 1 -- 172.21.15.82:0/3265943742 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c035070 con 0x55fdef31e2f0 2024-06-06T02:42:54.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.856+0000 7f4159572740 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 0x55fdef6fca10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f413c005fb0 tx=0x7f413c00b620 comp rx=0 tx=0).stop 2024-06-06T02:42:54.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.859+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 shutdown_connections 2024-06-06T02:42:54.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.859+0000 7f4159572740 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef3264d0 0x55fdef6e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.859+0000 7f4159572740 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef31e2f0 0x55fdef6fca10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.859+0000 7f4159572740 1 --2- 172.21.15.82:0/3265943742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef305d80 0x55fdef6e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.859+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 >> 172.21.15.82:0/3265943742 conn(0x55fdef33b300 msgr2=0x55fdef6f5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:54.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.860+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 shutdown_connections 2024-06-06T02:42:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.860+0000 7f4159572740 1 -- 172.21.15.82:0/3265943742 wait complete. 2024-06-06T02:42:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.861+0000 7f4159572740 1 -- start start 2024-06-06T02:42:54.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.861+0000 7f4159572740 1 Processor -- start 2024-06-06T02:42:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.863+0000 7f4159572740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.863+0000 7f4159572740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6fa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.864+0000 7f4159572740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.864+0000 7f414aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.864+0000 7f414aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6fa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47038/0 (socket says 172.21.15.82:47038) 2024-06-06T02:42:54.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.864+0000 7f414b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.864+0000 7f414b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:60440/0 (socket says 172.21.15.82:60440) 2024-06-06T02:42:54.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f414aa00640 1 -- 172.21.15.82:0/3006305083 learned_addr learned my addr 172.21.15.82:0/3006305083 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d0d80 con 0x55fdef3264d0 2024-06-06T02:42:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d21f0 con 0x55fdef31e2f0 2024-06-06T02:42:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f414c1d1450 con 0x55fdef305d80 2024-06-06T02:42:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f4159572740 10 client.0 _ll_register_callbacks cb 0x7f41380c9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:54.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.866+0000 7f414be00640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.867+0000 7f414b400640 1 -- 172.21.15.82:0/3006305083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 msgr2=0x55fdef6fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.867+0000 7f414b400640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.867+0000 7f414b400640 1 -- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 msgr2=0x55fdef6fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.867+0000 7f414b400640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.868+0000 7f414b400640 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdef6fb5d0 con 0x55fdef305d80 2024-06-06T02:42:54.868 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.868+0000 7f414be00640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:42:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.869+0000 7f414b400640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41380c5cc0 tx=0x7f4138003f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f6673ae80d12465 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.870+0000 7f4135600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:42:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.870+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380e2080 con 0x55fdef305d80 2024-06-06T02:42:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.870+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f41380d2820 con 0x55fdef305d80 2024-06-06T02:42:54.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.870+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f413c00b840 con 0x55fdef305d80 2024-06-06T02:42:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.873+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4138032880 con 0x55fdef305d80 2024-06-06T02:42:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.873+0000 7f4159572740 10 client.25900 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:54.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.873+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fdef6fb5d0 con 0x55fdef305d80 2024-06-06T02:42:54.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.873+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413c00b840 con 0x55fdef305d80 2024-06-06T02:42:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f41380c8ea0 con 0x55fdef305d80 2024-06-06T02:42:54.875 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 10 client.25900 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 10 client.25900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 20 client.25900 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef3471b0 0x55fdef76d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 4 client.25900 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:42:54.876 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.875+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdef65be70 con 0x55fdef3471b0 2024-06-06T02:42:54.877 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.876+0000 7f414aa00640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef3471b0 0x55fdef76d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.878+0000 7f414aa00640 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef3471b0 0x55fdef76d5e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25f60a9be0c67d5 server_cookie=f94faa115511ef6d in_seq=0 out_seq=0 2024-06-06T02:42:54.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:54.878+0000 7f4135600640 10 client.25900 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.351+0000 7f4135600640 1 -- 172.21.15.82:0/3006305083 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdef65be70 con 0x55fdef3471b0 2024-06-06T02:42:55.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.351+0000 7f4135600640 10 client.25900 handle_command_reply: tid=0 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.351+0000 7f4159572740 1 client.25900 shutdown 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.351+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 msgr2=0x55fdef6f9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.351+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41380c5cc0 tx=0x7f4138003f30 comp rx=0 tx=0).stop 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 shutdown_connections 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55fdef3471b0 0x55fdef76d5e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdef3264d0 0x55fdef6fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fdef31e2f0 0x55fdef6fa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 --2- 172.21.15.82:0/3006305083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55fdef305d80 0x55fdef6f9bc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 >> 172.21.15.82:0/3006305083 conn(0x55fdef33b300 msgr2=0x55fdef6f5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4135600640 0 client.25900 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.352+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 shutdown_connections 2024-06-06T02:42:55.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.353+0000 7f4159572740 1 -- 172.21.15.82:0/3006305083 wait complete. 2024-06-06T02:42:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.353+0000 7f4159572740 20 client.25900 trim_cache size 0 max 16384 2024-06-06T02:42:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:42:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:42:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:42:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:42:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 msgr2=0x7f41300b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 0x7f41300b4f10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f413c005bc0 tx=0x7f413c000bc0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 msgr2=0x7f414c1b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4138033fd0 tx=0x7f41380038a0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 shutdown_connections 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c07a2f0 0x7f414c1b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f41300b2a00 0x7f41300b4f10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f414c0750c0 0x7f414c1b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 --2- 172.21.15.82:0/390911631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f414c074c20 0x7f414c1b06e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 >> 172.21.15.82:0/390911631 conn(0x7f414c06fa60 msgr2=0x7f414c075630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 shutdown_connections 2024-06-06T02:42:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:42:55.355+0000 7f4150e00640 1 -- 172.21.15.82:0/390911631 wait complete. 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.189+0000 7f0de1800640 1 -- 172.21.15.82:0/2359977832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc1044e0 msgr2=0x7f0ddc10ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 --2- 172.21.15.82:0/2359977832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc10ca30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009900 tx=0x7f0dc802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 -- 172.21.15.82:0/2359977832 shutdown_connections 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 --2- 172.21.15.82:0/2359977832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc10f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 --2- 172.21.15.82:0/2359977832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc10ca30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 --2- 172.21.15.82:0/2359977832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ddc103b90 0x7f0ddc103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.190+0000 7f0de1800640 1 -- 172.21.15.82:0/2359977832 >> 172.21.15.82:0/2359977832 conn(0x7f0ddc0fd6f0 msgr2=0x7f0ddc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.191+0000 7f0de1800640 1 -- 172.21.15.82:0/2359977832 shutdown_connections 2024-06-06T02:42:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.191+0000 7f0de1800640 1 -- 172.21.15.82:0/2359977832 wait complete. 2024-06-06T02:42:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.193+0000 7f0de1800640 1 Processor -- start 2024-06-06T02:42:56.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.193+0000 7f0de1800640 1 -- start start 2024-06-06T02:42:56.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ddc103b90 0x7f0ddc074430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc06d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1192a0 con 0x7f0ddc103b90 2024-06-06T02:42:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc119120 con 0x7f0ddc10cff0 2024-06-06T02:42:56.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.195+0000 7f0de1800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc119420 con 0x7f0ddc1044e0 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0dda000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc06d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47052/0 (socket says 172.21.15.82:47052) 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 -- 172.21.15.82:0/3886596345 learned_addr learned my addr 172.21.15.82:0/3886596345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 -- 172.21.15.82:0/3886596345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc1044e0 msgr2=0x7f0ddc06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc06d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 -- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ddc103b90 msgr2=0x7f0ddc074430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.196+0000 7f0ddb400640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ddc103b90 0x7f0ddc074430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.197+0000 7f0ddb400640 1 -- 172.21.15.82:0/3886596345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc071f60 con 0x7f0ddc10cff0 2024-06-06T02:42:56.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.197+0000 7f0ddb400640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400dd70 tx=0x7f0dd400b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.198+0000 7f0dd3400640 1 -- 172.21.15.82:0/3886596345 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4017670 con 0x7f0ddc10cff0 2024-06-06T02:42:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.198+0000 7f0dd3400640 1 -- 172.21.15.82:0/3886596345 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd4012070 con 0x7f0ddc10cff0 2024-06-06T02:42:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.198+0000 7f0dd3400640 1 -- 172.21.15.82:0/3886596345 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400eaa0 con 0x7f0ddc10cff0 2024-06-06T02:42:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.198+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc072250 con 0x7f0ddc10cff0 2024-06-06T02:42:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.198+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc072710 con 0x7f0ddc10cff0 2024-06-06T02:42:56.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.207+0000 7f0dd3400640 1 -- 172.21.15.82:0/3886596345 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0dd400ec40 con 0x7f0ddc10cff0 2024-06-06T02:42:56.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.210+0000 7f0dd3400640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 0x7f0dc00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.212+0000 7f0dd3400640 1 -- 172.21.15.82:0/3886596345 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0dd40e3290 con 0x7f0ddc10cff0 2024-06-06T02:42:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.212+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 0x7f0dc00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:56 smithi082 ceph-mon[31579]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 80 MiB/s wr, 11.98k op/s 2024-06-06T02:42:56.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.574+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 0x7f0dc00b4ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc005fd0 tx=0x7f0dcc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.575+0000 7f0de7d84740 1 Processor -- start 2024-06-06T02:42:56.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.575+0000 7f0de7d84740 1 -- start start 2024-06-06T02:42:56.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8ee070 0x555d8bc94450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 0x555d8bc94990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bc94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d8bc08e10 con 0x555d8b8cd390 2024-06-06T02:42:56.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555d8bbf83b0 con 0x555d8b8ee070 2024-06-06T02:42:56.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.576+0000 7f0de7d84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555d8bbfc3f0 con 0x555d8b8c51b0 2024-06-06T02:42:56.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.577+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bc94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.577+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bc94ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42852/0 (socket says 172.21.15.82:42852) 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.577+0000 7f0ddb400640 1 -- 172.21.15.82:0/1404735245 learned_addr learned my addr 172.21.15.82:0/1404735245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.577+0000 7f0dda000640 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 0x555d8bc94990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.578+0000 7f0dda000640 1 -- 172.21.15.82:0/1404735245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8ee070 msgr2=0x555d8bc94450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.578+0000 7f0dda000640 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8ee070 0x555d8bc94450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.578+0000 7f0dda000640 1 -- 172.21.15.82:0/1404735245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 msgr2=0x555d8bc94ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.578+0000 7f0dda000640 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bc94ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.578+0000 7f0dda000640 1 -- 172.21.15.82:0/1404735245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d8b959650 con 0x555d8b8c51b0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.579+0000 7f0dda000640 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 0x555d8bc94990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0dc802a910 tx=0x7f0dc8004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbea90b7fa184cd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.579+0000 7f0dc7e00640 1 -- 172.21.15.82:0/1404735245 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8035040 con 0x555d8b8c51b0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.580+0000 7f0dc7e00640 1 -- 172.21.15.82:0/1404735245 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc8004750 con 0x555d8b8c51b0 2024-06-06T02:42:56.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.580+0000 7f0dc7e00640 1 -- 172.21.15.82:0/1404735245 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8003810 con 0x555d8b8c51b0 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.583+0000 7f0de7d84740 1 -- 172.21.15.82:0/1404735245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 msgr2=0x555d8bc94990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.583+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 0x555d8bc94990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0dc802a910 tx=0x7f0dc8004390 comp rx=0 tx=0).stop 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 -- 172.21.15.82:0/1404735245 shutdown_connections 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bc94ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8c51b0 0x555d8bc94990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1404735245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8ee070 0x555d8bc94450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 -- 172.21.15.82:0/1404735245 >> 172.21.15.82:0/1404735245 conn(0x555d8b8e2460 msgr2=0x555d8bc90de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 -- 172.21.15.82:0/1404735245 shutdown_connections 2024-06-06T02:42:56.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.584+0000 7f0de7d84740 1 -- 172.21.15.82:0/1404735245 wait complete. 2024-06-06T02:42:56.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.585+0000 7f0de7d84740 1 -- start start 2024-06-06T02:42:56.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.585+0000 7f0de7d84740 1 Processor -- start 2024-06-06T02:42:56.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.588+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8c51b0 0x555d8bcb17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.588+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.588+0000 7f0ddaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8c51b0 0x555d8bcb17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.589+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.589+0000 7f0de7d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d8ba5c700 con 0x555d8b8c51b0 2024-06-06T02:42:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.589+0000 7f0de7d84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555d8bb95710 con 0x555d8b8cd390 2024-06-06T02:42:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.589+0000 7f0de7d84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x555d8bcb2690 con 0x555d8b8ee070 2024-06-06T02:42:56.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.589+0000 7f0de7d84740 10 client.0 _ll_register_callbacks cb 0x555d8bba1dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.591+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.591+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:60480/0 (socket says 172.21.15.82:60480) 2024-06-06T02:42:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.591+0000 7f0ddb400640 1 -- 172.21.15.82:0/1757649713 learned_addr learned my addr 172.21.15.82:0/1757649713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:56.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.591+0000 7f0dda000640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.592+0000 7f0ddb400640 1 -- 172.21.15.82:0/1757649713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 msgr2=0x555d8bcb1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.592+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.592+0000 7f0ddb400640 1 -- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8c51b0 msgr2=0x555d8bcb17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.592+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8c51b0 0x555d8bcb17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.592+0000 7f0ddb400640 1 -- 172.21.15.82:0/1757649713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8bbc0fc0 con 0x555d8b8ee070 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.594+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400efd0 tx=0x7f0dd40aa1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b478e4d40818b02 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.594+0000 7f0dc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:42:56.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.595+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40aaf70 con 0x555d8b8ee070 2024-06-06T02:42:56.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.596+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0dd40a6b00 con 0x555d8b8ee070 2024-06-06T02:42:56.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.597+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dc8004750 con 0x555d8b8ee070 2024-06-06T02:42:56.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.597+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0dd40aa870 con 0x555d8b8ee070 2024-06-06T02:42:56.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.598+0000 7f0de7d84740 10 client.25909 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:56.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.598+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555d8bcbe940 con 0x555d8b8ee070 2024-06-06T02:42:56.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.599+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc8004750 con 0x555d8b8ee070 2024-06-06T02:42:56.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f0dd401f030 con 0x555d8b8ee070 2024-06-06T02:42:56.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 10 client.25909 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:56.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:56.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 20 client.25909 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:56.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8b8ac9f0 0x555d8bcc1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 4 client.25909 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:42:56.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.600+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d8bc0ad60 con 0x555d8b8ac9f0 2024-06-06T02:42:56.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.601+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8b8ac9f0 0x555d8bcc1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.602+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8b8ac9f0 0x555d8bcc1cf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db132bd62315c0a server_cookie=da1219fe4c8e7e2 in_seq=0 out_seq=0 2024-06-06T02:42:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.602+0000 7f0dc4c00640 10 client.25909 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:56.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.604+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1757649713 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555d8bc0ad60 con 0x555d8b8ac9f0 2024-06-06T02:42:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.604+0000 7f0dc4c00640 10 client.25909 handle_command_reply: tid=0 2024-06-06T02:42:56.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.604+0000 7f0de7d84740 1 client.25909 shutdown 2024-06-06T02:42:56.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.606+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 msgr2=0x555d8bcafbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.606+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400efd0 tx=0x7f0dd40aa1c0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 shutdown_connections 2024-06-06T02:42:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcafbb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8b8ac9f0 0x555d8bcc1cf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1757649713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8c51b0 0x555d8bcb17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 >> 172.21.15.82:0/1757649713 conn(0x555d8b8e2460 msgr2=0x555d8bc94cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.607+0000 7f0dc4c00640 0 client.25909 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.608+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 shutdown_connections 2024-06-06T02:42:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.610+0000 7f0de7d84740 1 -- 172.21.15.82:0/1757649713 wait complete. 2024-06-06T02:42:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.610+0000 7f0de7d84740 20 client.25909 trim_cache size 0 max 16384 2024-06-06T02:42:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:56 smithi103 ceph-mon[36349]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 80 MiB/s wr, 11.98k op/s 2024-06-06T02:42:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.643+0000 7f0de7d84740 1 Processor -- start 2024-06-06T02:42:56.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 -- start start 2024-06-06T02:42:56.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bca93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bca9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b74e0 con 0x555d8b8cd390 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc118350 con 0x555d8b8c51b0 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.644+0000 7f0de7d84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc06af30 con 0x555d8b8ee070 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.645+0000 7f0ddaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.645+0000 7f0ddaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47092/0 (socket says 172.21.15.82:47092) 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.645+0000 7f0ddaa00640 1 -- 172.21.15.82:0/399779937 learned_addr learned my addr 172.21.15.82:0/399779937 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.645+0000 7f0ddb400640 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bca9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 -- 172.21.15.82:0/399779937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 msgr2=0x555d8bca9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bca9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 -- 172.21.15.82:0/399779937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 msgr2=0x555d8bca93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bca93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 -- 172.21.15.82:0/399779937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d8bc91e70 con 0x555d8b8c51b0 2024-06-06T02:42:56.649 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:56 smithi184 ceph-mon[36922]: pgmap v600: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 80 MiB/s wr, 11.98k op/s 2024-06-06T02:42:56.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.646+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00bfd0 tx=0x7f0dcc005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602bc8e2b475a3dd server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.648+0000 7f0dc7400640 1 -- 172.21.15.82:0/399779937 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc01f440 con 0x555d8b8c51b0 2024-06-06T02:42:56.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.649+0000 7f0dc7400640 1 -- 172.21.15.82:0/399779937 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dcc017050 con 0x555d8b8c51b0 2024-06-06T02:42:56.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.649+0000 7f0dc7400640 1 -- 172.21.15.82:0/399779937 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc028810 con 0x555d8b8c51b0 2024-06-06T02:42:56.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 -- 172.21.15.82:0/399779937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 msgr2=0x555d8bc90eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00bfd0 tx=0x7f0dcc005c90 comp rx=0 tx=0).stop 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 -- 172.21.15.82:0/399779937 shutdown_connections 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bca9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b8cd390 0x555d8bca93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 --2- 172.21.15.82:0/399779937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8c51b0 0x555d8bc90eb0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00bfd0 tx=0x7f0dcc005c90 comp rx=0 tx=0).stop 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 -- 172.21.15.82:0/399779937 >> 172.21.15.82:0/399779937 conn(0x555d8b8e2460 msgr2=0x555d8bc907a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.651+0000 7f0de7d84740 1 -- 172.21.15.82:0/399779937 shutdown_connections 2024-06-06T02:42:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.652+0000 7f0de7d84740 1 -- 172.21.15.82:0/399779937 wait complete. 2024-06-06T02:42:56.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.653+0000 7f0de7d84740 1 -- start start 2024-06-06T02:42:56.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.654+0000 7f0de7d84740 1 Processor -- start 2024-06-06T02:42:56.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.657+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.657+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcb6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.657+0000 7f0de7d84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 0x555d8bcba680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.658+0000 7f0ddaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.658+0000 7f0de7d84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc116810 con 0x555d8b881da0 2024-06-06T02:42:56.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.658+0000 7f0de7d84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc117c80 con 0x555d8b8cd390 2024-06-06T02:42:56.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.658+0000 7f0de7d84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc116ee0 con 0x555d8b8ee070 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.659+0000 7f0ddb400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 0x555d8bcba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.659+0000 7f0ddaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:47100/0 (socket says 172.21.15.82:47100) 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.659+0000 7f0ddaa00640 1 -- 172.21.15.82:0/1224845543 learned_addr learned my addr 172.21.15.82:0/1224845543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.659+0000 7f0dda000640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcb6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.660+0000 7f0de7d84740 10 client.0 _ll_register_callbacks cb 0x7f0dd40a60b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:42:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.661+0000 7f0ddb400640 1 -- 172.21.15.82:0/1224845543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 msgr2=0x555d8bcb6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.661+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcb6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.661+0000 7f0ddb400640 1 -- 172.21.15.82:0/1224845543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 msgr2=0x555d8bcb5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:42:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.661+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.661+0000 7f0ddb400640 1 -- 172.21.15.82:0/1224845543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d8bcb6c50 con 0x555d8b881da0 2024-06-06T02:42:56.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.662+0000 7f0ddb400640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 0x555d8bcba680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40caf10 tx=0x7f0dd400e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f5f60be0025135 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:42:56.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.662+0000 7f0dc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:42:56.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.663+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40a6730 con 0x555d8b881da0 2024-06-06T02:42:56.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.663+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0dd40ab770 con 0x555d8b881da0 2024-06-06T02:42:56.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.664+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dcc017050 con 0x555d8b881da0 2024-06-06T02:42:56.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.664+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0dd40ab970 con 0x555d8b881da0 2024-06-06T02:42:56.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.664+0000 7f0de7d84740 10 client.15630 fetch_fsmap learned FSMap version 29 2024-06-06T02:42:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.664+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555d8bd2a960 con 0x555d8b881da0 2024-06-06T02:42:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.664+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dcc017050 con 0x555d8b881da0 2024-06-06T02:42:56.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f0dd401f030 con 0x555d8b881da0 2024-06-06T02:42:56.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 10 client.15630 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:42:56.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 10 client.15630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:42:56.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 20 client.15630 populate_metadata read hostname 'smithi082' 2024-06-06T02:42:56.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8bd2ae50 0x555d8bd2d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:42:56.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 4 client.15630 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:42:56.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.668+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d8bc06800 con 0x555d8bd2ae50 2024-06-06T02:42:56.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.669+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8bd2ae50 0x555d8bd2d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.670+0000 7f0ddaa00640 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8bd2ae50 0x555d8bd2d270 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3474fd3f07692a51 server_cookie=65285a19e3c6c7e0 in_seq=0 out_seq=0 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.670+0000 7f0dc4c00640 10 client.15630 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.671+0000 7f0dc4c00640 1 -- 172.21.15.82:0/1224845543 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d8bc06800 con 0x555d8bd2ae50 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.671+0000 7f0dc4c00640 10 client.15630 handle_command_reply: tid=0 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.671+0000 7f0de7d84740 1 client.15630 shutdown 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.671+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 msgr2=0x555d8bcba680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.671+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 0x555d8bcba680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40caf10 tx=0x7f0dd400e500 comp rx=0 tx=0).stop 2024-06-06T02:42:56.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 shutdown_connections 2024-06-06T02:42:56.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x555d8bd2ae50 0x555d8bd2d270 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d8b881da0 0x555d8bcba680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555d8b8ee070 0x555d8bcb6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 --2- 172.21.15.82:0/1224845543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555d8b8cd390 0x555d8bcb5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 >> 172.21.15.82:0/1224845543 conn(0x555d8b8e2460 msgr2=0x555d8bc94310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.672+0000 7f0dc4c00640 0 client.15630 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.673+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 shutdown_connections 2024-06-06T02:42:56.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.673+0000 7f0de7d84740 1 -- 172.21.15.82:0/1224845543 wait complete. 2024-06-06T02:42:56.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.673+0000 7f0de7d84740 20 client.15630 trim_cache size 0 max 16384 2024-06-06T02:42:56.676 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 msgr2=0x7f0dc00b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 0x7f0dc00b4ec0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc005fd0 tx=0x7f0dcc005850 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 msgr2=0x7f0ddc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400dd70 tx=0x7f0dd400b6e0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 shutdown_connections 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ddc10cff0 0x7f0ddc06dc40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f0dc00b29b0 0x7f0dc00b4ec0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ddc1044e0 0x7f0ddc06d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 --2- 172.21.15.82:0/3886596345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ddc103b90 0x7f0ddc074430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:42:56.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.675+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 >> 172.21.15.82:0/3886596345 conn(0x7f0ddc0fd6f0 msgr2=0x7f0ddc0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:42:56.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.676+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 shutdown_connections 2024-06-06T02:42:56.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:42:56.676+0000 7f0de1800640 1 -- 172.21.15.82:0/3886596345 wait complete. 2024-06-06T02:42:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:42:58 smithi103 ceph-mon[36349]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 80 MiB/s wr, 12.14k op/s 2024-06-06T02:42:58.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:42:58 smithi082 ceph-mon[31579]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 80 MiB/s wr, 12.14k op/s 2024-06-06T02:42:58.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:42:58 smithi184 ceph-mon[36922]: pgmap v601: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 80 MiB/s wr, 12.14k op/s 2024-06-06T02:43:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:00 smithi103 ceph-mon[36349]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 88 MiB/s wr, 13.40k op/s 2024-06-06T02:43:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:00 smithi082 ceph-mon[31579]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 88 MiB/s wr, 13.40k op/s 2024-06-06T02:43:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:00 smithi184 ceph-mon[36922]: pgmap v602: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 88 MiB/s wr, 13.40k op/s 2024-06-06T02:43:02.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:02 smithi103 ceph-mon[36349]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 81 MiB/s wr, 12.29k op/s 2024-06-06T02:43:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:02 smithi082 ceph-mon[31579]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 81 MiB/s wr, 12.29k op/s 2024-06-06T02:43:02.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:02 smithi184 ceph-mon[36922]: pgmap v603: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 81 MiB/s wr, 12.29k op/s 2024-06-06T02:43:04.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:04 smithi103 ceph-mon[36349]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 11.32k op/s 2024-06-06T02:43:04.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:04 smithi082 ceph-mon[31579]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 11.32k op/s 2024-06-06T02:43:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:04 smithi184 ceph-mon[36922]: pgmap v604: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 75 MiB/s wr, 11.32k op/s 2024-06-06T02:43:06.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:06 smithi082 ceph-mon[31579]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 72 MiB/s wr, 10.82k op/s 2024-06-06T02:43:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:06 smithi103 ceph-mon[36349]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 72 MiB/s wr, 10.82k op/s 2024-06-06T02:43:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:06 smithi184 ceph-mon[36922]: pgmap v605: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 72 MiB/s wr, 10.82k op/s 2024-06-06T02:43:07.132 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-06-06T02:43:07.133 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-06-06T02:43:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:08 smithi103 ceph-mon[36349]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 MiB/s wr, 10.74k op/s 2024-06-06T02:43:08.624 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:43:08.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:08 smithi082 ceph-mon[31579]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 MiB/s wr, 10.74k op/s 2024-06-06T02:43:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:08 smithi184 ceph-mon[36922]: pgmap v606: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 MiB/s wr, 10.74k op/s 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.842+0000 7fd1a1400640 1 -- 172.21.15.82:0/1172284213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 msgr2=0x7fd19c109b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.842+0000 7fd1a1400640 1 --2- 172.21.15.82:0/1172284213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 0x7fd19c109b70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd188009930 tx=0x7fd18802a440 comp rx=0 tx=0).stop 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 -- 172.21.15.82:0/1172284213 shutdown_connections 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 --2- 172.21.15.82:0/1172284213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 0x7fd19c1119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 --2- 172.21.15.82:0/1172284213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 0x7fd19c109b70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 --2- 172.21.15.82:0/1172284213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c10af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 -- 172.21.15.82:0/1172284213 >> 172.21.15.82:0/1172284213 conn(0x7fd19c06fbe0 msgr2=0x7fd19c072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.843+0000 7fd1a1400640 1 -- 172.21.15.82:0/1172284213 shutdown_connections 2024-06-06T02:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.844+0000 7fd1a1400640 1 -- 172.21.15.82:0/1172284213 wait complete. 2024-06-06T02:43:08.845 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.845+0000 7fd1a1400640 1 Processor -- start 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 -- start start 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 0x7fd19c11ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 0x7fd19c120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c1143f0 con 0x7fd19c10a0b0 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c114270 con 0x7fd19c10ab40 2024-06-06T02:43:08.846 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.846+0000 7fd1a1400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c114570 con 0x7fd19c109760 2024-06-06T02:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.847+0000 7fd19b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.847+0000 7fd19b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58798/0 (socket says 172.21.15.82:58798) 2024-06-06T02:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.847+0000 7fd19b200640 1 -- 172.21.15.82:0/3060820322 learned_addr learned my addr 172.21.15.82:0/3060820322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:08.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.847+0000 7fd199e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 0x7fd19c120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.848+0000 7fd19b200640 1 -- 172.21.15.82:0/3060820322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 msgr2=0x7fd19c11ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.848+0000 7fd19b200640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 0x7fd19c11ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.848+0000 7fd19b200640 1 -- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 msgr2=0x7fd19c120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.848+0000 7fd19b200640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 0x7fd19c120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.848+0000 7fd19b200640 1 -- 172.21.15.82:0/3060820322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c1b8450 con 0x7fd19c10ab40 2024-06-06T02:43:08.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd19b200640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd19400cce0 tx=0x7fd19400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd193400640 1 -- 172.21.15.82:0/3060820322 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400f450 con 0x7fd19c10ab40 2024-06-06T02:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd193400640 1 -- 172.21.15.82:0/3060820322 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd19400faa0 con 0x7fd19c10ab40 2024-06-06T02:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd193400640 1 -- 172.21.15.82:0/3060820322 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194018b70 con 0x7fd19c10ab40 2024-06-06T02:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c1b8740 con 0x7fd19c10ab40 2024-06-06T02:43:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.849+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1b8c40 con 0x7fd19c10ab40 2024-06-06T02:43:08.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.856+0000 7fd1a839e740 1 Processor -- start 2024-06-06T02:43:08.856 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.857+0000 7fd193400640 1 -- 172.21.15.82:0/3060820322 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd194018d10 con 0x7fd19c10ab40 2024-06-06T02:43:08.858 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 -- start start 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x56112839dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561128310480 con 0x561127ff91b0 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5611282ffa20 con 0x561127fd84d0 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.859+0000 7fd1a839e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x561128303a60 con 0x561127fd02f0 2024-06-06T02:43:08.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.860+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.860+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53868/0 (socket says 172.21.15.82:53868) 2024-06-06T02:43:08.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.860+0000 7fd19a800640 1 -- 172.21.15.82:0/4038194423 learned_addr learned my addr 172.21.15.82:0/4038194423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:08.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd199e00640 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd19a800640 1 -- 172.21.15.82:0/4038194423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 msgr2=0x5611283a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd19a800640 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd19a800640 1 -- 172.21.15.82:0/4038194423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 msgr2=0x56112839dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd19a800640 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x56112839dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.861+0000 7fd19a800640 1 -- 172.21.15.82:0/4038194423 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611282fc8d0 con 0x561127fd02f0 2024-06-06T02:43:08.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.862+0000 7fd193400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 0x7fd1800b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.862+0000 7fd193400640 1 -- 172.21.15.82:0/3060820322 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd1940e2680 con 0x7fd19c10ab40 2024-06-06T02:43:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.862+0000 7fd19a800640 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00aa20 tx=0x7fd18c00aee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fda666e178c9a2e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.863+0000 7fd199e00640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 0x7fd1800b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.863+0000 7fd187400640 1 -- 172.21.15.82:0/4038194423 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c007b30 con 0x561127fd02f0 2024-06-06T02:43:08.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.863+0000 7fd187400640 1 -- 172.21.15.82:0/4038194423 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd18c0054d0 con 0x561127fd02f0 2024-06-06T02:43:08.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.863+0000 7fd187400640 1 -- 172.21.15.82:0/4038194423 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c013420 con 0x561127fd02f0 2024-06-06T02:43:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.865+0000 7fd1a839e740 1 -- 172.21.15.82:0/4038194423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 msgr2=0x56112839e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.865+0000 7fd1a839e740 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00aa20 tx=0x7fd18c00aee0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.865+0000 7fd199e00640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 0x7fd1800b4d70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd19c11bd10 tx=0x7fd188000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 -- 172.21.15.82:0/4038194423 shutdown_connections 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd02f0 0x56112839e240 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00aa20 tx=0x7fd18c00aee0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 --2- 172.21.15.82:0/4038194423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x56112839dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 -- 172.21.15.82:0/4038194423 >> 172.21.15.82:0/4038194423 conn(0x561127fed300 msgr2=0x5611283996b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 -- 172.21.15.82:0/4038194423 shutdown_connections 2024-06-06T02:43:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.867+0000 7fd1a839e740 1 -- 172.21.15.82:0/4038194423 wait complete. 2024-06-06T02:43:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.868+0000 7fd1a839e740 1 -- start start 2024-06-06T02:43:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.868+0000 7fd1a839e740 1 Processor -- start 2024-06-06T02:43:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.871+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127ff91b0 0x5611283a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fb7d80 0x5611283ae960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56112823aab0 con 0x561127fb7d80 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56112829d630 con 0x561127ff91b0 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5611283a5ad0 con 0x561127fd84d0 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53878/0 (socket says 172.21.15.82:53878) 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd19a800640 1 -- 172.21.15.82:0/1643775804 learned_addr learned my addr 172.21.15.82:0/1643775804 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd1a839e740 10 client.0 _ll_register_callbacks cb 0x5611282a3610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd199e00640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127ff91b0 0x5611283a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd19a800640 1 -- 172.21.15.82:0/1643775804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127ff91b0 msgr2=0x5611283a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.872+0000 7fd19a800640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127ff91b0 0x5611283a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.873+0000 7fd19a800640 1 -- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fb7d80 msgr2=0x5611283ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.873+0000 7fd19a800640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fb7d80 0x5611283ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.873+0000 7fd19a800640 1 -- 172.21.15.82:0/1643775804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611282ca170 con 0x561127fd84d0 2024-06-06T02:43:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.888+0000 7fd19a800640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56112839edb0 tx=0x7fd18c005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2eee322774b1434 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.888+0000 7fd17be00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c022020 con 0x561127fd84d0 2024-06-06T02:43:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd18c005020 con 0x561127fd84d0 2024-06-06T02:43:08.889 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd18c0054d0 con 0x561127fd84d0 2024-06-06T02:43:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd18c004e40 con 0x561127fd84d0 2024-06-06T02:43:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd1a839e740 10 client.25921 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.890+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561128064790 con 0x561127fd84d0 2024-06-06T02:43:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.891+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd18c0054d0 con 0x561127fd84d0 2024-06-06T02:43:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fd18c007b30 con 0x561127fd84d0 2024-06-06T02:43:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 10 client.25921 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 10 client.25921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 20 client.25921 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561127f8d1c0 0x5611283b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 4 client.25921 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:43:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611283123d0 con 0x561127f8d1c0 2024-06-06T02:43:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.892+0000 7fd199e00640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561127f8d1c0 0x5611283b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.893+0000 7fd199e00640 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561127f8d1c0 0x5611283b49f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51279197b4f1f622 server_cookie=12329d9ba94875c4 in_seq=0 out_seq=0 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.893+0000 7fd17be00640 10 client.25921 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.893+0000 7fd17be00640 1 -- 172.21.15.82:0/1643775804 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5611283123d0 con 0x561127f8d1c0 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.893+0000 7fd17be00640 10 client.25921 handle_command_reply: tid=0 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 client.25921 shutdown 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 msgr2=0x5611283a7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56112839edb0 tx=0x7fd18c005c90 comp rx=0 tx=0).stop 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 shutdown_connections 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x561127f8d1c0 0x5611283b49f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fb7d80 0x5611283ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127ff91b0 0x5611283a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 --2- 172.21.15.82:0/1643775804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fd84d0 0x5611283a7530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 >> 172.21.15.82:0/1643775804 conn(0x561127fed300 msgr2=0x56112839a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd17be00640 0 client.25921 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.894+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 shutdown_connections 2024-06-06T02:43:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.895+0000 7fd1a839e740 1 -- 172.21.15.82:0/1643775804 wait complete. 2024-06-06T02:43:08.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.895+0000 7fd1a839e740 20 client.25921 trim_cache size 0 max 16384 2024-06-06T02:43:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 Processor -- start 2024-06-06T02:43:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 -- start start 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 0x56112839ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 0x5611283ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c010e50 con 0x561127fd84d0 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00e720 con 0x561127fb7d80 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.923+0000 7fd1a839e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00c550 con 0x561127ff91b0 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 0x56112839ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53894/0 (socket says 172.21.15.82:53894) 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 -- 172.21.15.82:0/3621003704 learned_addr learned my addr 172.21.15.82:0/3621003704 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 0x56112839ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58816/0 (socket says 172.21.15.82:58816) 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd199e00640 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 0x5611283ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 -- 172.21.15.82:0/3621003704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 msgr2=0x56112839ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 0x56112839ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 -- 172.21.15.82:0/3621003704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 msgr2=0x5611283ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 0x5611283ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 -- 172.21.15.82:0/3621003704 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611280dd620 con 0x561127ff91b0 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd199e00640 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 0x5611283ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:43:08.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.924+0000 7fd19b200640 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1940e0180 tx=0x7fd1940a64b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c17cccd2cae6434e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.925+0000 7fd186a00640 1 -- 172.21.15.82:0/3621003704 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940b2fd0 con 0x561127ff91b0 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.925+0000 7fd186a00640 1 -- 172.21.15.82:0/3621003704 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1940a7250 con 0x561127ff91b0 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.925+0000 7fd186a00640 1 -- 172.21.15.82:0/3621003704 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19400f5f0 con 0x561127ff91b0 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- 172.21.15.82:0/3621003704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 msgr2=0x5611283a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1940e0180 tx=0x7fd1940a64b0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- 172.21.15.82:0/3621003704 shutdown_connections 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127ff91b0 0x5611283a6af0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127fd84d0 0x5611283ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 --2- 172.21.15.82:0/3621003704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fb7d80 0x56112839ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- 172.21.15.82:0/3621003704 >> 172.21.15.82:0/3621003704 conn(0x561127fed300 msgr2=0x56112839a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- 172.21.15.82:0/3621003704 shutdown_connections 2024-06-06T02:43:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- 172.21.15.82:0/3621003704 wait complete. 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 -- start start 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.926+0000 7fd1a839e740 1 Processor -- start 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x5611283ab610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00cbe0 con 0x561127ff91b0 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00e050 con 0x561127fd84d0 2024-06-06T02:43:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c00d2b0 con 0x561127fb7d80 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd1a839e740 10 client.0 _ll_register_callbacks cb 0x7fd18c005700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd199e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd19b200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x5611283ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd19a800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:53898/0 (socket says 172.21.15.82:53898) 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd19a800640 1 -- 172.21.15.82:0/2813077871 learned_addr learned my addr 172.21.15.82:0/2813077871 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.927+0000 7fd199e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:58818/0 (socket says 172.21.15.82:58818) 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 -- 172.21.15.82:0/2813077871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 msgr2=0x5611283ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 -- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 msgr2=0x5611283ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x5611283ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 -- 172.21.15.82:0/2813077871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611283abb80 con 0x561127fb7d80 2024-06-06T02:43:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd19a800640 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd18c001eb0 tx=0x7fd18c00a900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd23c42af9bb84a1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd17be00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c022070 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1940a7250 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.928+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fd18c0051f0 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd18c004140 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 10 client.25927 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56112841c200 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1940a7250 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fd18c029440 con 0x561127fb7d80 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 10 client.25927 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 10 client.25927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 20 client.25927 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56112841cb80 0x56112841efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 4 client.25927 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.929+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56112830de70 con 0x56112841cb80 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.930+0000 7fd199e00640 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56112841cb80 0x56112841efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.930+0000 7fd17be00640 10 client.25927 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:08.930+0000 7fd199e00640 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56112841cb80 0x56112841efa0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc828bbbcb67a32 server_cookie=a7107c5c3a69bf26 in_seq=0 out_seq=0 2024-06-06T02:43:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.199+0000 7fd17be00640 1 -- 172.21.15.82:0/2813077871 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56112830de70 con 0x56112841cb80 2024-06-06T02:43:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.199+0000 7fd17be00640 10 client.25927 handle_command_reply: tid=0 2024-06-06T02:43:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.199+0000 7fd1a839e740 1 client.25927 shutdown 2024-06-06T02:43:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.200+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 msgr2=0x5611283ae550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.200+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd18c001eb0 tx=0x7fd18c00a900 comp rx=0 tx=0).stop 2024-06-06T02:43:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 shutdown_connections 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56112841cb80 0x56112841efa0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561127ff91b0 0x5611283ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561127fd84d0 0x5611283ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 --2- 172.21.15.82:0/2813077871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561127fb7d80 0x5611283ae550 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 >> 172.21.15.82:0/2813077871 conn(0x561127fed300 msgr2=0x561128397d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd17be00640 0 client.25927 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 shutdown_connections 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 1 -- 172.21.15.82:0/2813077871 wait complete. 2024-06-06T02:43:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.201+0000 7fd1a839e740 20 client.25927 trim_cache size 0 max 16384 2024-06-06T02:43:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:43:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:43:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:43:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 msgr2=0x7fd1800b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 0x7fd1800b4d70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd19c11bd10 tx=0x7fd188000bc0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 msgr2=0x7fd19c11b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd19400cce0 tx=0x7fd19400a620 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 shutdown_connections 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd19c10ab40 0x7fd19c11b2c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c10a0b0 0x7fd19c120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fd1800b2860 0x7fd1800b4d70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 --2- 172.21.15.82:0/3060820322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd19c109760 0x7fd19c11ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.203+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 >> 172.21.15.82:0/3060820322 conn(0x7fd19c06fbe0 msgr2=0x7fd19c10b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.204+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 shutdown_connections 2024-06-06T02:43:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:09.204+0000 7fd1a1400640 1 -- 172.21.15.82:0/3060820322 wait complete. 2024-06-06T02:43:10.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:10 smithi103 ceph-mon[36349]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 74 MiB/s wr, 10.82k op/s 2024-06-06T02:43:10.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:10 smithi082 ceph-mon[31579]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 74 MiB/s wr, 10.82k op/s 2024-06-06T02:43:10.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:10 smithi184 ceph-mon[36922]: pgmap v607: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 74 MiB/s wr, 10.82k op/s 2024-06-06T02:43:12.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:12 smithi103 ceph-mon[36349]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 10.52k op/s 2024-06-06T02:43:12.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:12 smithi082 ceph-mon[31579]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 10.52k op/s 2024-06-06T02:43:12.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:12 smithi184 ceph-mon[36922]: pgmap v608: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 10.52k op/s 2024-06-06T02:43:14.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:14 smithi103 ceph-mon[36349]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 MiB/s wr, 11.15k op/s 2024-06-06T02:43:14.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:14 smithi082 ceph-mon[31579]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 MiB/s wr, 11.15k op/s 2024-06-06T02:43:14.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:14 smithi184 ceph-mon[36922]: pgmap v609: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 76 MiB/s wr, 11.15k op/s 2024-06-06T02:43:16.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:16 smithi103 ceph-mon[36349]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.67k op/s 2024-06-06T02:43:16.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:16 smithi082 ceph-mon[31579]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.67k op/s 2024-06-06T02:43:16.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:16 smithi184 ceph-mon[36922]: pgmap v610: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.67k op/s 2024-06-06T02:43:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:18 smithi103 ceph-mon[36349]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.83k op/s 2024-06-06T02:43:18.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:18 smithi082 ceph-mon[31579]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.83k op/s 2024-06-06T02:43:18.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:18 smithi184 ceph-mon[36922]: pgmap v611: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 MiB/s wr, 10.83k op/s 2024-06-06T02:43:20.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:20 smithi103 ceph-mon[36349]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 MiB/s wr, 10.51k op/s 2024-06-06T02:43:20.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:20 smithi082 ceph-mon[31579]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 MiB/s wr, 10.51k op/s 2024-06-06T02:43:20.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:20 smithi184 ceph-mon[36922]: pgmap v612: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 MiB/s wr, 10.51k op/s 2024-06-06T02:43:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:22 smithi103 ceph-mon[36349]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 MiB/s wr, 11.22k op/s 2024-06-06T02:43:22.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:22 smithi082 ceph-mon[31579]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 MiB/s wr, 11.22k op/s 2024-06-06T02:43:22.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:22 smithi184 ceph-mon[36922]: pgmap v613: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 MiB/s wr, 11.22k op/s 2024-06-06T02:43:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 -- 172.21.15.82:0/520644548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2101012c0 msgr2=0x7fe2101036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 --2- 172.21.15.82:0/520644548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2101012c0 0x7fe2101036e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe200009900 tx=0x7fe20002a420 comp rx=0 tx=0).stop 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 -- 172.21.15.82:0/520644548 shutdown_connections 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 --2- 172.21.15.82:0/520644548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe210106580 0x7fe210106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 --2- 172.21.15.82:0/520644548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe210106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 --2- 172.21.15.82:0/520644548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2101012c0 0x7fe2101036e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 -- 172.21.15.82:0/520644548 >> 172.21.15.82:0/520644548 conn(0x7fe2100fd0c0 msgr2=0x7fe2100ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.310+0000 7fe20f200640 1 -- 172.21.15.82:0/520644548 shutdown_connections 2024-06-06T02:43:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.311+0000 7fe20f200640 1 -- 172.21.15.82:0/520644548 wait complete. 2024-06-06T02:43:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.313+0000 7fe20f200640 1 Processor -- start 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.313+0000 7fe20f200640 1 -- start start 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.313+0000 7fe20f200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.313+0000 7fe20f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe21010f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe210106580 0x7fe210110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe210114bb0 con 0x7fe210103c20 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe210114a30 con 0x7fe210106580 2024-06-06T02:43:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20f200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe210114d30 con 0x7fe2101012c0 2024-06-06T02:43:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52788/0 (socket says 172.21.15.82:52788) 2024-06-06T02:43:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 -- 172.21.15.82:0/1995907377 learned_addr learned my addr 172.21.15.82:0/1995907377 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20e800640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe210106580 0x7fe210110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 -- 172.21.15.82:0/1995907377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe210106580 msgr2=0x7fe210110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe210106580 0x7fe210110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20de00640 1 -- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 msgr2=0x7fe21010f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.314+0000 7fe20d400640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe21010f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.315+0000 7fe20de00640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe21010f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.315+0000 7fe20de00640 1 -- 172.21.15.82:0/1995907377 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2101108b0 con 0x7fe2101012c0 2024-06-06T02:43:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.315+0000 7fe20d400640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe21010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:43:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.316+0000 7fe20de00640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe200031440 tx=0x7fe200003bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.316+0000 7fe206a00640 1 -- 172.21.15.82:0/1995907377 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20003f070 con 0x7fe2101012c0 2024-06-06T02:43:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.316+0000 7fe206a00640 1 -- 172.21.15.82:0/1995907377 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe200031c50 con 0x7fe2101012c0 2024-06-06T02:43:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.316+0000 7fe206a00640 1 -- 172.21.15.82:0/1995907377 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200035030 con 0x7fe2101012c0 2024-06-06T02:43:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.318+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe210110b40 con 0x7fe2101012c0 2024-06-06T02:43:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.318+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe210110fb0 con 0x7fe2101012c0 2024-06-06T02:43:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.328+0000 7fe21be44740 1 Processor -- start 2024-06-06T02:43:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.328+0000 7fe21be44740 1 -- start start 2024-06-06T02:43:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.328+0000 7fe21be44740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.328+0000 7fe21be44740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 0x559dd57e8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe21be44740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 0x559dd57ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe21be44740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559dd575a480 con 0x559dd54431b0 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe21be44740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559dd5749a20 con 0x559dd541a2f0 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe21be44740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559dd574da60 con 0x559dd54224d0 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe20e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.329+0000 7fe20d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 0x559dd57ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.330+0000 7fe20d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 0x559dd57ef2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52800/0 (socket says 172.21.15.82:52800) 2024-06-06T02:43:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.330+0000 7fe20d400640 1 -- 172.21.15.82:0/1181533808 learned_addr learned my addr 172.21.15.82:0/1181533808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.330+0000 7fe20de00640 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 0x559dd57e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.330+0000 7fe206a00640 1 -- 172.21.15.82:0/1995907377 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe200042070 con 0x7fe2101012c0 2024-06-06T02:43:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 -- 172.21.15.82:0/1181533808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 msgr2=0x559dd57ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 0x559dd57ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 -- 172.21.15.82:0/1181533808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 msgr2=0x559dd57e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 -- 172.21.15.82:0/1181533808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd57468d0 con 0x559dd541a2f0 2024-06-06T02:43:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.331+0000 7fe20de00640 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 0x559dd57e8430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe200100740 tx=0x7fe200106d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=812e3a2eff252ea3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.332+0000 7fe1fb400640 1 -- 172.21.15.82:0/1181533808 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20010bd20 con 0x559dd541a2f0 2024-06-06T02:43:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.332+0000 7fe1fb400640 1 -- 172.21.15.82:0/1181533808 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20010d8f0 con 0x559dd541a2f0 2024-06-06T02:43:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.332+0000 7fe1fb400640 1 -- 172.21.15.82:0/1181533808 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2001158a0 con 0x559dd541a2f0 2024-06-06T02:43:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 -- 172.21.15.82:0/1181533808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 msgr2=0x559dd57e8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 0x559dd57e8430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe200100740 tx=0x7fe200106d10 comp rx=0 tx=0).stop 2024-06-06T02:43:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 -- 172.21.15.82:0/1181533808 shutdown_connections 2024-06-06T02:43:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd54224d0 0x559dd57ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd541a2f0 0x559dd57e8430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 --2- 172.21.15.82:0/1181533808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57e7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 -- 172.21.15.82:0/1181533808 >> 172.21.15.82:0/1181533808 conn(0x559dd5437300 msgr2=0x559dd57e38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 -- 172.21.15.82:0/1181533808 shutdown_connections 2024-06-06T02:43:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.333+0000 7fe21be44740 1 -- 172.21.15.82:0/1181533808 wait complete. 2024-06-06T02:43:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.334+0000 7fe206a00640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 0x7fe1f40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.334+0000 7fe206a00640 1 -- 172.21.15.82:0/1995907377 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe200102ca0 con 0x7fe2101012c0 2024-06-06T02:43:23.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.337+0000 7fe21be44740 1 -- start start 2024-06-06T02:43:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.337+0000 7fe21be44740 1 Processor -- start 2024-06-06T02:43:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.338+0000 7fe20e800640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 0x7fe1f40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.340+0000 7fe21be44740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd53d71c0 0x559dd57f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559dd5684ab0 con 0x559dd54431b0 2024-06-06T02:43:23.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559dd56e7630 con 0x559dd53d71c0 2024-06-06T02:43:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559dd57efa80 con 0x559dd5401d80 2024-06-06T02:43:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe21be44740 10 client.0 _ll_register_callbacks cb 0x559dd56ed610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe20d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe20d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52802/0 (socket says 172.21.15.82:52802) 2024-06-06T02:43:23.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.341+0000 7fe20d400640 1 -- 172.21.15.82:0/2982698606 learned_addr learned my addr 172.21.15.82:0/2982698606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:23.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 -- 172.21.15.82:0/2982698606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd53d71c0 msgr2=0x559dd57f89e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:43:23.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd53d71c0 0x559dd57f89e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 -- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 msgr2=0x559dd57f15b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:43:23.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20e800640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 0x7fe1f40b4d50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe208005c40 tx=0x7fe208005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 -- 172.21.15.82:0/2982698606 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd5714170 con 0x559dd5401d80 2024-06-06T02:43:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.342+0000 7fe20d400640 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc010650 tx=0x7fe1fc010b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c63575b1a6b1359c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.343+0000 7fe1efe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:23.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.343+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc004220 con 0x559dd5401d80 2024-06-06T02:43:23.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.343+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe1fc0043c0 con 0x559dd5401d80 2024-06-06T02:43:23.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.343+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe20010d8f0 con 0x559dd5401d80 2024-06-06T02:43:23.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.344+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1fc010e50 con 0x559dd5401d80 2024-06-06T02:43:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.344+0000 7fe21be44740 10 client.25939 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.344+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559dd54ae790 con 0x559dd5401d80 2024-06-06T02:43:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.344+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20010d8f0 con 0x559dd5401d80 2024-06-06T02:43:23.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fe1fc00f040 con 0x559dd5401d80 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 10 client.25939 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 20 client.25939 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd57fce20 0x559dd57ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 4 client.25939 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dd575c3d0 con 0x559dd57fce20 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.348+0000 7fe20de00640 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd57fce20 0x559dd57ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.350+0000 7fe1efe00640 10 client.25939 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.350+0000 7fe20de00640 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd57fce20 0x559dd57ff2c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f790e2ee34057485 server_cookie=576605d17879434e in_seq=0 out_seq=0 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.356+0000 7fe1efe00640 1 -- 172.21.15.82:0/2982698606 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559dd575c3d0 con 0x559dd57fce20 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.356+0000 7fe1efe00640 10 client.25939 handle_command_reply: tid=0 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.356+0000 7fe21be44740 1 client.25939 shutdown 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.356+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 msgr2=0x559dd57f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.356+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc010650 tx=0x7fe1fc010b10 comp rx=0 tx=0).stop 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 shutdown_connections 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd53d71c0 0x559dd57f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd5401d80 0x559dd57f1af0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd57fce20 0x559dd57ff2c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 --2- 172.21.15.82:0/2982698606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd54431b0 0x559dd57f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 >> 172.21.15.82:0/2982698606 conn(0x559dd5437300 msgr2=0x559dd57e47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe1efe00640 0 client.25939 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 shutdown_connections 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 1 -- 172.21.15.82:0/2982698606 wait complete. 2024-06-06T02:43:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.357+0000 7fe21be44740 20 client.25939 trim_cache size 0 max 16384 2024-06-06T02:43:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 Processor -- start 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 -- start start 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57efe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101bb810 con 0x559dd5401d80 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101b90e0 con 0x559dd54431b0 2024-06-06T02:43:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.392+0000 7fe21be44740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101b6f10 con 0x559dd53d71c0 2024-06-06T02:43:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52810/0 (socket says 172.21.15.82:52810) 2024-06-06T02:43:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 -- 172.21.15.82:0/3620863209 learned_addr learned my addr 172.21.15.82:0/3620863209 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20e800640 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20d400640 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 -- 172.21.15.82:0/3620863209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 msgr2=0x559dd57efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 -- 172.21.15.82:0/3620863209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 msgr2=0x559dd57f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.393+0000 7fe20de00640 1 -- 172.21.15.82:0/3620863209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd5527620 con 0x559dd53d71c0 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.394+0000 7fe20de00640 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ca250 tx=0x7fe20003b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de101717ec7b6935 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.394+0000 7fe1faa00640 1 -- 172.21.15.82:0/3620863209 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000c6180 con 0x559dd53d71c0 2024-06-06T02:43:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.394+0000 7fe1faa00640 1 -- 172.21.15.82:0/3620863209 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe200031e00 con 0x559dd53d71c0 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.394+0000 7fe1faa00640 1 -- 172.21.15.82:0/3620863209 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000c6180 con 0x559dd53d71c0 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 -- 172.21.15.82:0/3620863209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 msgr2=0x559dd57e3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ca250 tx=0x7fe20003b460 comp rx=0 tx=0).stop 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 -- 172.21.15.82:0/3620863209 shutdown_connections 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 --2- 172.21.15.82:0/3620863209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57e3970 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 -- 172.21.15.82:0/3620863209 >> 172.21.15.82:0/3620863209 conn(0x559dd5437300 msgr2=0x559dd57e2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 -- 172.21.15.82:0/3620863209 shutdown_connections 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.396+0000 7fe21be44740 1 -- 172.21.15.82:0/3620863209 wait complete. 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.397+0000 7fe21be44740 1 -- start start 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.397+0000 7fe21be44740 1 Processor -- start 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101b75a0 con 0x559dd5401d80 2024-06-06T02:43:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101b8a10 con 0x559dd54431b0 2024-06-06T02:43:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101b7c70 con 0x559dd53d71c0 2024-06-06T02:43:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.398+0000 7fe21be44740 10 client.0 _ll_register_callbacks cb 0x7fe1fc009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:23.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.399+0000 7fe20e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.399+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.399+0000 7fe20de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52820/0 (socket says 172.21.15.82:52820) 2024-06-06T02:43:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.399+0000 7fe20de00640 1 -- 172.21.15.82:0/845616722 learned_addr learned my addr 172.21.15.82:0/845616722 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.399+0000 7fe20e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50222/0 (socket says 172.21.15.82:50222) 2024-06-06T02:43:23.404 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.400+0000 7fe20d400640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.400+0000 7fe20de00640 1 -- 172.21.15.82:0/845616722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 msgr2=0x559dd57f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20de00640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20de00640 1 -- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 msgr2=0x559dd57f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20de00640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20de00640 1 -- 172.21.15.82:0/845616722 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd5876b30 con 0x559dd53d71c0 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20d400640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:43:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.401+0000 7fe20e800640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:43:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.402+0000 7fe20de00640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe200005ab0 tx=0x7fe20002a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978e2a018e994fef server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.402+0000 7fe1efe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.403+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000c9a30 con 0x559dd53d71c0 2024-06-06T02:43:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.403+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe20003b4f0 con 0x559dd53d71c0 2024-06-06T02:43:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.404+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559dd5757e70 con 0x559dd53d71c0 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.404+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2000c9c10 con 0x559dd53d71c0 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.404+0000 7fe21be44740 10 client.25945 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.405+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559dd5876b30 con 0x559dd53d71c0 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.405+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2000ca9c0 con 0x559dd53d71c0 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.406+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fe2001063b0 con 0x559dd53d71c0 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 10 client.25945 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 10 client.25945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 20 client.25945 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd58780b0 0x559dd587a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 4 client.25945 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559dd5757e70 con 0x559dd58780b0 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.407+0000 7fe20d400640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd58780b0 0x559dd587a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.408+0000 7fe20d400640 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd58780b0 0x559dd587a4d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a16a0e01f03b2d server_cookie=1d9f78872ac68db5 in_seq=0 out_seq=0 2024-06-06T02:43:23.409 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.409+0000 7fe1efe00640 10 client.25945 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.746+0000 7fe1efe00640 1 -- 172.21.15.82:0/845616722 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559dd5757e70 con 0x559dd58780b0 2024-06-06T02:43:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe1efe00640 10 client.25945 handle_command_reply: tid=0 2024-06-06T02:43:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 client.25945 shutdown 2024-06-06T02:43:23.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 msgr2=0x559dd57f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe200005ab0 tx=0x7fe20002a420 comp rx=0 tx=0).stop 2024-06-06T02:43:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 shutdown_connections 2024-06-06T02:43:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559dd54431b0 0x559dd57f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559dd58780b0 0x559dd587a4d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd5401d80 0x559dd57f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 --2- 172.21.15.82:0/845616722 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559dd53d71c0 0x559dd57f8a20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.747+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 >> 172.21.15.82:0/845616722 conn(0x559dd5437300 msgr2=0x559dd57e2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.748+0000 7fe1efe00640 0 client.25945 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.748+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 shutdown_connections 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.748+0000 7fe21be44740 1 -- 172.21.15.82:0/845616722 wait complete. 2024-06-06T02:43:23.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.748+0000 7fe21be44740 20 client.25945 trim_cache size 0 max 16384 2024-06-06T02:43:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:43:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:43:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:43:23.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:43:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 msgr2=0x7fe1f40b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 0x7fe1f40b4d50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe208005c40 tx=0x7fe208005bd0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 msgr2=0x7fe21010eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:23.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe200031440 tx=0x7fe200003bf0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 shutdown_connections 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe210106580 0x7fe210110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe210103c20 0x7fe21010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe1f40b2840 0x7fe1f40b4d50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 --2- 172.21.15.82:0/1995907377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2101012c0 0x7fe21010eda0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.751+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 >> 172.21.15.82:0/1995907377 conn(0x7fe2100fd0c0 msgr2=0x7fe2100ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.752+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 shutdown_connections 2024-06-06T02:43:23.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:23.752+0000 7fe20f200640 1 -- 172.21.15.82:0/1995907377 wait complete. 2024-06-06T02:43:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:24 smithi103 ceph-mon[36349]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 82 MiB/s wr, 11.68k op/s 2024-06-06T02:43:24.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:24 smithi082 ceph-mon[31579]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 82 MiB/s wr, 11.68k op/s 2024-06-06T02:43:24.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:24 smithi184 ceph-mon[36922]: pgmap v614: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 82 MiB/s wr, 11.68k op/s 2024-06-06T02:43:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:26 smithi103 ceph-mon[36349]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.61k op/s 2024-06-06T02:43:26.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:26 smithi082 ceph-mon[31579]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.61k op/s 2024-06-06T02:43:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:26 smithi184 ceph-mon[36922]: pgmap v615: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.61k op/s 2024-06-06T02:43:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:28 smithi103 ceph-mon[36349]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 MiB/s wr, 10.91k op/s 2024-06-06T02:43:28.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:28 smithi082 ceph-mon[31579]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 MiB/s wr, 10.91k op/s 2024-06-06T02:43:28.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:28 smithi184 ceph-mon[36922]: pgmap v616: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 MiB/s wr, 10.91k op/s 2024-06-06T02:43:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:30 smithi103 ceph-mon[36349]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 81 MiB/s wr, 11.84k op/s 2024-06-06T02:43:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:30 smithi082 ceph-mon[31579]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 81 MiB/s wr, 11.84k op/s 2024-06-06T02:43:30.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:30 smithi184 ceph-mon[36922]: pgmap v617: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 81 MiB/s wr, 11.84k op/s 2024-06-06T02:43:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:32 smithi103 ceph-mon[36349]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:43:32.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:32 smithi082 ceph-mon[31579]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:43:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:32 smithi184 ceph-mon[36922]: pgmap v618: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 82 MiB/s wr, 12.10k op/s 2024-06-06T02:43:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:34 smithi103 ceph-mon[36349]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 MiB/s wr, 11.48k op/s 2024-06-06T02:43:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:34 smithi082 ceph-mon[31579]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 MiB/s wr, 11.48k op/s 2024-06-06T02:43:34.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:34 smithi184 ceph-mon[36922]: pgmap v619: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 MiB/s wr, 11.48k op/s 2024-06-06T02:43:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:36 smithi103 ceph-mon[36349]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 70 MiB/s wr, 10.65k op/s 2024-06-06T02:43:36.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:36 smithi082 ceph-mon[31579]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 70 MiB/s wr, 10.65k op/s 2024-06-06T02:43:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:36 smithi184 ceph-mon[36922]: pgmap v620: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 70 MiB/s wr, 10.65k op/s 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 -- 172.21.15.82:0/2319480095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 msgr2=0x7f03301036e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 --2- 172.21.15.82:0/2319480095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f03301036e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0320009900 tx=0x7f032002a420 comp rx=0 tx=0).stop 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 -- 172.21.15.82:0/2319480095 shutdown_connections 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 --2- 172.21.15.82:0/2319480095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330106580 0x7f0330106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 --2- 172.21.15.82:0/2319480095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330103c20 0x7f0330106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 --2- 172.21.15.82:0/2319480095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f03301036e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.305+0000 7f032fe00640 1 -- 172.21.15.82:0/2319480095 >> 172.21.15.82:0/2319480095 conn(0x7f03300fd0c0 msgr2=0x7f03300ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.306+0000 7f032fe00640 1 -- 172.21.15.82:0/2319480095 shutdown_connections 2024-06-06T02:43:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.306+0000 7f032fe00640 1 -- 172.21.15.82:0/2319480095 wait complete. 2024-06-06T02:43:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.307+0000 7f032fe00640 1 Processor -- start 2024-06-06T02:43:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.307+0000 7f032fe00640 1 -- start start 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 0x7f033019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 0x7f03301a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0330114bb0 con 0x7f0330106580 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0330114a30 con 0x7f03301012c0 2024-06-06T02:43:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032fe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0330114d30 con 0x7f0330103c20 2024-06-06T02:43:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 0x7f03301a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53628/0 (socket says 172.21.15.82:53628) 2024-06-06T02:43:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032ea00640 1 -- 172.21.15.82:0/2139389010 learned_addr learned my addr 172.21.15.82:0/2139389010 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.308+0000 7f032e000640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 0x7f033019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 -- 172.21.15.82:0/2139389010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 msgr2=0x7f033019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 0x7f033019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 -- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 msgr2=0x7f03301a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 0x7f03301a6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 -- 172.21.15.82:0/2139389010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03301a7310 con 0x7f03301012c0 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032e000640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 0x7f033019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032f400640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 0x7f03301a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:43:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032ea00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0320031440 tx=0x7f0320003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f0334a00640 1 -- 172.21.15.82:0/2139389010 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032003f070 con 0x7f03301012c0 2024-06-06T02:43:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f0334a00640 1 -- 172.21.15.82:0/2139389010 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0320031c50 con 0x7f03301012c0 2024-06-06T02:43:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f0334a00640 1 -- 172.21.15.82:0/2139389010 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320035030 con 0x7f03301012c0 2024-06-06T02:43:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03301a75a0 con 0x7f03301012c0 2024-06-06T02:43:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.309+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03301a7ac0 con 0x7f03301012c0 2024-06-06T02:43:37.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.317+0000 7f0334a00640 1 -- 172.21.15.82:0/2139389010 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0320042070 con 0x7f03301012c0 2024-06-06T02:43:37.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.319+0000 7f033cdf3740 1 Processor -- start 2024-06-06T02:43:37.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.322+0000 7f033cdf3740 1 -- start start 2024-06-06T02:43:37.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e2b1b0 0x564ff61cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564ff6142480 con 0x564ff5e022f0 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564ff6131a20 con 0x564ff5e0a4d0 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.323+0000 7f033cdf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564ff6135a60 con 0x564ff5e2b1b0 2024-06-06T02:43:37.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.324+0000 7f032ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.324+0000 7f032e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.324+0000 7f032e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53640/0 (socket says 172.21.15.82:53640) 2024-06-06T02:43:37.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.324+0000 7f032e000640 1 -- 172.21.15.82:0/3282184396 learned_addr learned my addr 172.21.15.82:0/3282184396 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.324+0000 7f032f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e2b1b0 0x564ff61cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 -- 172.21.15.82:0/3282184396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e2b1b0 msgr2=0x564ff61cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e2b1b0 0x564ff61cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 -- 172.21.15.82:0/3282184396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 msgr2=0x564ff61d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 -- 172.21.15.82:0/3282184396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff612e8d0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.325+0000 7f032e000640 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f031c00a9a0 tx=0x7f031c00ae60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdd2a4a4292694f4 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.327+0000 7f0334a00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 0x7f03140b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.327+0000 7f031be00640 1 -- 172.21.15.82:0/3282184396 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c015070 con 0x564ff5e0a4d0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.328+0000 7f031be00640 1 -- 172.21.15.82:0/3282184396 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f031c00cc00 con 0x564ff5e0a4d0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.328+0000 7f031be00640 1 -- 172.21.15.82:0/3282184396 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c0105b0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.328+0000 7f0334a00640 1 -- 172.21.15.82:0/2139389010 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0320102b20 con 0x7f03301012c0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.328+0000 7f032f400640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 0x7f03140b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.329+0000 7f033cdf3740 1 -- 172.21.15.82:0/3282184396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 msgr2=0x564ff61d72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.329+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f031c00a9a0 tx=0x7f031c00ae60 comp rx=0 tx=0).stop 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.329+0000 7f032f400640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 0x7f03140b4df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0328005fd0 tx=0x7f0328009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.330+0000 7f033cdf3740 1 -- 172.21.15.82:0/3282184396 shutdown_connections 2024-06-06T02:43:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.330+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e0a4d0 0x564ff61d72f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.330+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.330+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3282184396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e2b1b0 0x564ff61cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.331+0000 7f033cdf3740 1 -- 172.21.15.82:0/3282184396 >> 172.21.15.82:0/3282184396 conn(0x564ff5e1f300 msgr2=0x564ff61cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.331+0000 7f033cdf3740 1 -- 172.21.15.82:0/3282184396 shutdown_connections 2024-06-06T02:43:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.331+0000 7f033cdf3740 1 -- 172.21.15.82:0/3282184396 wait complete. 2024-06-06T02:43:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.332+0000 7f033cdf3740 1 -- start start 2024-06-06T02:43:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.332+0000 7f033cdf3740 1 Processor -- start 2024-06-06T02:43:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.333+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 0x564ff61e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564ff606cab0 con 0x564ff5e2b1b0 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564ff60cf630 con 0x564ff5e022f0 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x564ff61d7cc0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f033cdf3740 10 client.0 _ll_register_callbacks cb 0x564ff60d5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:53654/0 (socket says 172.21.15.82:53654) 2024-06-06T02:43:37.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 -- 172.21.15.82:0/3193388310 learned_addr learned my addr 172.21.15.82:0/3193388310 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032e000640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032f400640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 0x564ff61e0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 -- 172.21.15.82:0/3193388310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 msgr2=0x564ff61d9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61d9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 -- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 msgr2=0x564ff61e0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 0x564ff61e0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032ea00640 1 -- 172.21.15.82:0/3193388310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff60fc170 con 0x564ff5e022f0 2024-06-06T02:43:37.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.334+0000 7f032f400640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 0x564ff61e0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.335+0000 7f0318c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.335+0000 7f032ea00640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0320004770 tx=0x7f03200ca350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8734e27da5320702 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.335+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320049050 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.336+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f032003b460 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.336+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f031c00cc00 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.336+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0320031e00 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.336+0000 7f033cdf3740 10 client.25922 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.336+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564ff5e96790 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f031c00cc00 con 0x564ff5e022f0 2024-06-06T02:43:37.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f03200ca720 con 0x564ff5e022f0 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 10 client.25922 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 10 client.25922 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 20 client.25922 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5de9d80 0x564ff61e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 4 client.25922 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:43:37.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.337+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ff61443d0 con 0x564ff5de9d80 2024-06-06T02:43:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.341+0000 7f032e000640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5de9d80 0x564ff61e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.342+0000 7f0318c00640 10 client.25922 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.343+0000 7f032e000640 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5de9d80 0x564ff61e6dd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e210a7c95eb0151f server_cookie=c2a7acd411ffcb in_seq=0 out_seq=0 2024-06-06T02:43:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.345+0000 7f0318c00640 1 -- 172.21.15.82:0/3193388310 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564ff61443d0 con 0x564ff5de9d80 2024-06-06T02:43:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.345+0000 7f0318c00640 10 client.25922 handle_command_reply: tid=0 2024-06-06T02:43:37.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.345+0000 7f033cdf3740 1 client.25922 shutdown 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.346+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 msgr2=0x564ff61d9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.346+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0320004770 tx=0x7f03200ca350 comp rx=0 tx=0).stop 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.346+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 shutdown_connections 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.346+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5de9d80 0x564ff61e6dd0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e2b1b0 0x564ff61e0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61d9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3193388310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e022f0 0x564ff61d9660 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 >> 172.21.15.82:0/3193388310 conn(0x564ff5e1f300 msgr2=0x564ff61cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f0318c00640 0 client.25922 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 shutdown_connections 2024-06-06T02:43:37.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.347+0000 7f033cdf3740 1 -- 172.21.15.82:0/3193388310 wait complete. 2024-06-06T02:43:37.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.349+0000 7f033cdf3740 20 client.25922 trim_cache size 0 max 16384 2024-06-06T02:43:37.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.387+0000 7f033cdf3740 1 Processor -- start 2024-06-06T02:43:37.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 -- start start 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03301b3170 con 0x564ff5e022f0 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03301b0a40 con 0x564ff5e2b1b0 2024-06-06T02:43:37.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f033cdf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03301ae870 con 0x564ff5e0a4d0 2024-06-06T02:43:37.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f032ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f032ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48978/0 (socket says 172.21.15.82:48978) 2024-06-06T02:43:37.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f032ea00640 1 -- 172.21.15.82:0/3301375617 learned_addr learned my addr 172.21.15.82:0/3301375617 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:37.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.388+0000 7f032f400640 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032e000640 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 -- 172.21.15.82:0/3301375617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 msgr2=0x564ff61e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 -- 172.21.15.82:0/3301375617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 msgr2=0x564ff61cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 -- 172.21.15.82:0/3301375617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ff5f0f620 con 0x564ff5e022f0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.389+0000 7f032ea00640 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03200c7730 tx=0x7f03200ca3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919dbc53cef9cd31 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.390+0000 7f031b400640 1 -- 172.21.15.82:0/3301375617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03200e9070 con 0x564ff5e022f0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.390+0000 7f031b400640 1 -- 172.21.15.82:0/3301375617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03200c9fd0 con 0x564ff5e022f0 2024-06-06T02:43:37.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.390+0000 7f031b400640 1 -- 172.21.15.82:0/3301375617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0320049070 con 0x564ff5e022f0 2024-06-06T02:43:37.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.391+0000 7f033cdf3740 1 -- 172.21.15.82:0/3301375617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 msgr2=0x564ff61cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.391+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f03200c7730 tx=0x7f03200ca3c0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 -- 172.21.15.82:0/3301375617 shutdown_connections 2024-06-06T02:43:37.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3301375617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61cba10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 -- 172.21.15.82:0/3301375617 >> 172.21.15.82:0/3301375617 conn(0x564ff5e1f300 msgr2=0x564ff61cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 -- 172.21.15.82:0/3301375617 shutdown_connections 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.392+0000 7f033cdf3740 1 -- 172.21.15.82:0/3301375617 wait complete. 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.393+0000 7f033cdf3740 1 -- start start 2024-06-06T02:43:37.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.393+0000 7f033cdf3740 1 Processor -- start 2024-06-06T02:43:37.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03301aef00 con 0x564ff5e022f0 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03301b0370 con 0x564ff5e2b1b0 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f03301af5d0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.394+0000 7f033cdf3740 10 client.0 _ll_register_callbacks cb 0x7f03200c6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:37.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.395+0000 7f032e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.395+0000 7f032e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:43314/0 (socket says 172.21.15.82:43314) 2024-06-06T02:43:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.395+0000 7f032e000640 1 -- 172.21.15.82:0/3656837708 learned_addr learned my addr 172.21.15.82:0/3656837708 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.395+0000 7f032ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.395+0000 7f032f400640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.396+0000 7f032e000640 1 -- 172.21.15.82:0/3656837708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 msgr2=0x564ff61dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.396+0000 7f032e000640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.396+0000 7f032e000640 1 -- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 msgr2=0x564ff61e06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.396+0000 7f032e000640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.396+0000 7f032e000640 1 -- 172.21.15.82:0/3656837708 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ff61ddcf0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.397+0000 7f032f400640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:43:37.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.397+0000 7f032e000640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f031c011b80 tx=0x7f031c00a220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823fb232be9bab3e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.397+0000 7f0318c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.398+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031c02c070 con 0x564ff5e0a4d0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.398+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03200c9fd0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.398+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f031c00cbe0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.399+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f031c02c070 con 0x564ff5e0a4d0 2024-06-06T02:43:37.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.399+0000 7f033cdf3740 10 client.25960 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:37.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.400+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564ff624e4f0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03200c9fd0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f031c0041d0 con 0x564ff5e0a4d0 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 10 client.25960 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 10 client.25960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 20 client.25960 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5dbf1c0 0x564ff6250c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 4 client.25960 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ff613fe70 con 0x564ff5dbf1c0 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.402+0000 7f032ea00640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5dbf1c0 0x564ff6250c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.403+0000 7f0318c00640 10 client.25960 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:37.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.403+0000 7f032ea00640 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5dbf1c0 0x564ff6250c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d33191696b1ae2 server_cookie=2ae672b85352007d in_seq=0 out_seq=0 2024-06-06T02:43:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.557+0000 7f0318c00640 1 -- 172.21.15.82:0/3656837708 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ff613fe70 con 0x564ff5dbf1c0 2024-06-06T02:43:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.557+0000 7f0318c00640 10 client.25960 handle_command_reply: tid=0 2024-06-06T02:43:37.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.557+0000 7f033cdf3740 1 client.25960 shutdown 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 msgr2=0x564ff61dd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f031c011b80 tx=0x7f031c00a220 comp rx=0 tx=0).stop 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 shutdown_connections 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564ff5e2b1b0 0x564ff61dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564ff5e0a4d0 0x564ff61dd270 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.558 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x564ff5dbf1c0 0x564ff6250c10 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 --2- 172.21.15.82:0/3656837708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564ff5e022f0 0x564ff61e06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.559 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.558+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 >> 172.21.15.82:0/3656837708 conn(0x564ff5e1f300 msgr2=0x564ff61d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.560+0000 7f0318c00640 0 client.25960 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:37.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.560+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 shutdown_connections 2024-06-06T02:43:37.560 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.560+0000 7f033cdf3740 1 -- 172.21.15.82:0/3656837708 wait complete. 2024-06-06T02:43:37.561 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.560+0000 7f033cdf3740 20 client.25960 trim_cache size 0 max 16384 2024-06-06T02:43:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:43:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:43:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:43:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:43:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.564+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 msgr2=0x7f03140b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.564+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 0x7f03140b4df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0328005fd0 tx=0x7f0328009500 comp rx=0 tx=0).stop 2024-06-06T02:43:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.564+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 msgr2=0x7f033019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:37.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.564+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0320031440 tx=0x7f0320003c10 comp rx=0 tx=0).stop 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 shutdown_connections 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0330106580 0x7f03301a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f03140b28e0 0x7f03140b4df0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0330103c20 0x7f033019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 --2- 172.21.15.82:0/2139389010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03301012c0 0x7f033019f7d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.565+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 >> 172.21.15.82:0/2139389010 conn(0x7f03300fd0c0 msgr2=0x7f0330102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.567+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 shutdown_connections 2024-06-06T02:43:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:37.567+0000 7f032fe00640 1 -- 172.21.15.82:0/2139389010 wait complete. 2024-06-06T02:43:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:38 smithi103 ceph-mon[36349]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 76 MiB/s wr, 11.56k op/s 2024-06-06T02:43:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:38 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:43:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:38 smithi082 ceph-mon[31579]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 76 MiB/s wr, 11.56k op/s 2024-06-06T02:43:38.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:38 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:43:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:38 smithi184 ceph-mon[36922]: pgmap v621: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 76 MiB/s wr, 11.56k op/s 2024-06-06T02:43:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:38 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:43:40.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:40 smithi103 ceph-mon[36349]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 74 MiB/s wr, 11.26k op/s 2024-06-06T02:43:40.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:40 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:40 smithi082 ceph-mon[31579]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 74 MiB/s wr, 11.26k op/s 2024-06-06T02:43:40.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:40 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:40 smithi184 ceph-mon[36922]: pgmap v622: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 74 MiB/s wr, 11.26k op/s 2024-06-06T02:43:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:40 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-06T02:43:41.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:41 smithi184 ceph-mon[36922]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-06-06T02:43:41.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:41 smithi184 ceph-mon[36922]: Unable to set osd_memory_target on smithi184 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-06-06T02:43:41.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:41 smithi082 ceph-mon[31579]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-06-06T02:43:42.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:41 smithi103 ceph-mon[36349]: Adjusting osd_memory_target on smithi184 to 176.2M 2024-06-06T02:43:42.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:41 smithi103 ceph-mon[36349]: Unable to set osd_memory_target on smithi184 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-06-06T02:43:42.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:42 smithi082 ceph-mon[31579]: Unable to set osd_memory_target on smithi184 to 184790323: error parsing value: Value '184790323' is below minimum 939524096 2024-06-06T02:43:42.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:42 smithi184 ceph-mon[36922]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 76 MiB/s wr, 11.38k op/s 2024-06-06T02:43:43.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:42 smithi103 ceph-mon[36349]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 76 MiB/s wr, 11.38k op/s 2024-06-06T02:43:43.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:42 smithi082 ceph-mon[31579]: pgmap v623: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 76 MiB/s wr, 11.38k op/s 2024-06-06T02:43:44.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:44 smithi184 ceph-mon[36922]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 76 MiB/s wr, 11.43k op/s 2024-06-06T02:43:45.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:44 smithi103 ceph-mon[36349]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 76 MiB/s wr, 11.43k op/s 2024-06-06T02:43:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:44 smithi082 ceph-mon[31579]: pgmap v624: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 76 MiB/s wr, 11.43k op/s 2024-06-06T02:43:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:46 smithi103 ceph-mon[36349]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 MiB/s wr, 10.97k op/s 2024-06-06T02:43:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:46 smithi082 ceph-mon[31579]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 MiB/s wr, 10.97k op/s 2024-06-06T02:43:47.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:46 smithi184 ceph-mon[36922]: pgmap v625: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 73 MiB/s wr, 10.97k op/s 2024-06-06T02:43:49.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:48 smithi103 ceph-mon[36349]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 81 MiB/s wr, 12.16k op/s 2024-06-06T02:43:49.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:43:49.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:43:49.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:48 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:43:49.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:48 smithi082 ceph-mon[31579]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 81 MiB/s wr, 12.16k op/s 2024-06-06T02:43:49.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:43:49.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:43:49.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:48 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:43:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:48 smithi184 ceph-mon[36922]: pgmap v626: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 81 MiB/s wr, 12.16k op/s 2024-06-06T02:43:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:43:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:43:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:48 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:43:51.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:50 smithi103 ceph-mon[36349]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.99k op/s 2024-06-06T02:43:51.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:50 smithi082 ceph-mon[31579]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.99k op/s 2024-06-06T02:43:51.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.138+0000 7f9323e00640 1 -- 172.21.15.82:0/1064266486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 msgr2=0x7f9324109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.139 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.138+0000 7f9323e00640 1 --2- 172.21.15.82:0/1064266486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f9324109c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9314009900 tx=0x7f931402a420 comp rx=0 tx=0).stop 2024-06-06T02:43:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 -- 172.21.15.82:0/1064266486 shutdown_connections 2024-06-06T02:43:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 --2- 172.21.15.82:0/1064266486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f9324109c50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 --2- 172.21.15.82:0/1064266486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9324102a00 0x7f9324102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 --2- 172.21.15.82:0/1064266486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93241018e0 0x7f9324101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 -- 172.21.15.82:0/1064266486 >> 172.21.15.82:0/1064266486 conn(0x7f93240fd0c0 msgr2=0x7f93240ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 -- 172.21.15.82:0/1064266486 shutdown_connections 2024-06-06T02:43:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.141+0000 7f9323e00640 1 -- 172.21.15.82:0/1064266486 wait complete. 2024-06-06T02:43:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.143+0000 7f9323e00640 1 Processor -- start 2024-06-06T02:43:51.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.143+0000 7f9323e00640 1 -- start start 2024-06-06T02:43:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.144+0000 7f9323e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 0x7f9324073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9323e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 0x7f93240743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 0x7f9324073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 0x7f9324073e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:37444/0 (socket says 172.21.15.82:37444) 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9322a00640 1 -- 172.21.15.82:0/3792818124 learned_addr learned my addr 172.21.15.82:0/3792818124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f93240725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.145+0000 7f9322000640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 0x7f93240743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.146+0000 7f9323400640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f93240725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.146+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f932410d470 con 0x7f9324102a00 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.146+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f932410d2f0 con 0x7f93241018e0 2024-06-06T02:43:51.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.146+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f932410d5f0 con 0x7f9324103350 2024-06-06T02:43:51.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:50 smithi184 ceph-mon[36922]: pgmap v627: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.99k op/s 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.147+0000 7f9322000640 1 -- 172.21.15.82:0/3792818124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 msgr2=0x7f93240725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.147+0000 7f9322000640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f93240725d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.147+0000 7f9322000640 1 -- 172.21.15.82:0/3792818124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 msgr2=0x7f9324073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.147+0000 7f9322000640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 0x7f9324073e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.147+0000 7f9322000640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9324072df0 con 0x7f9324102a00 2024-06-06T02:43:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.148+0000 7f9322000640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 0x7f93240743b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f931000d6d0 tx=0x7f931000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.148+0000 7f931b400640 1 -- 172.21.15.82:0/3792818124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310017070 con 0x7f9324102a00 2024-06-06T02:43:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.148+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93240730e0 con 0x7f9324102a00 2024-06-06T02:43:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.149+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93241a9d70 con 0x7f9324102a00 2024-06-06T02:43:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.149+0000 7f931b400640 1 -- 172.21.15.82:0/3792818124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9310009820 con 0x7f9324102a00 2024-06-06T02:43:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.150+0000 7f931b400640 1 -- 172.21.15.82:0/3792818124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310017070 con 0x7f9324102a00 2024-06-06T02:43:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.161+0000 7f9330bc9740 1 Processor -- start 2024-06-06T02:43:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 -- start start 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a212f0 0x560080df27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080deeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560080d61480 con 0x560080a212f0 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560080d50a20 con 0x560080a294d0 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.162+0000 7f9330bc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560080d54a60 con 0x560080a4a1b0 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.164+0000 7f931b400640 1 -- 172.21.15.82:0/3792818124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9310005220 con 0x7f9324102a00 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.165+0000 7f9323400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.165+0000 7f9323400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44472/0 (socket says 172.21.15.82:44472) 2024-06-06T02:43:51.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.165+0000 7f9323400640 1 -- 172.21.15.82:0/2409218589 learned_addr learned my addr 172.21.15.82:0/2409218589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.166+0000 7f9323400640 1 -- 172.21.15.82:0/2409218589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 msgr2=0x560080deeec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:43:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.166+0000 7f9323400640 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080deeec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.166+0000 7f9323400640 1 -- 172.21.15.82:0/2409218589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a212f0 msgr2=0x560080df27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.166+0000 7f9323400640 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a212f0 0x560080df27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.166+0000 7f9323400640 1 -- 172.21.15.82:0/2409218589 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560080d4d8d0 con 0x560080a4a1b0 2024-06-06T02:43:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.167+0000 7f9323400640 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9314009900 tx=0x7f93140316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e0e295f6f443496 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.168+0000 7f930fe00640 1 -- 172.21.15.82:0/2409218589 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314035030 con 0x560080a4a1b0 2024-06-06T02:43:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.168+0000 7f930fe00640 1 -- 172.21.15.82:0/2409218589 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9314040070 con 0x560080a4a1b0 2024-06-06T02:43:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.168+0000 7f930fe00640 1 -- 172.21.15.82:0/2409218589 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314003bc0 con 0x560080a4a1b0 2024-06-06T02:43:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.169+0000 7f931b400640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 0x7f93080b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.170+0000 7f931b400640 1 -- 172.21.15.82:0/3792818124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f93100e12f0 con 0x7f9324102a00 2024-06-06T02:43:51.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.171+0000 7f9330bc9740 1 -- 172.21.15.82:0/2409218589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 msgr2=0x560080df22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9314009900 tx=0x7f93140316d0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 -- 172.21.15.82:0/2409218589 shutdown_connections 2024-06-06T02:43:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080deeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a212f0 0x560080df27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 --2- 172.21.15.82:0/2409218589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df22a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.172+0000 7f9330bc9740 1 -- 172.21.15.82:0/2409218589 >> 172.21.15.82:0/2409218589 conn(0x560080a3e300 msgr2=0x560080dea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.175+0000 7f9330bc9740 1 -- 172.21.15.82:0/2409218589 shutdown_connections 2024-06-06T02:43:51.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.175+0000 7f9322a00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 0x7f93080b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.176+0000 7f9330bc9740 1 -- 172.21.15.82:0/2409218589 wait complete. 2024-06-06T02:43:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.177+0000 7f9322a00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 0x7f93080b4f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560080deb680 tx=0x7f931c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.177+0000 7f9330bc9740 1 -- start start 2024-06-06T02:43:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.178+0000 7f9330bc9740 1 Processor -- start 2024-06-06T02:43:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:37452/0 (socket says 172.21.15.82:37452) 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560080c8bab0 con 0x560080a08d80 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560080cee630 con 0x560080a294d0 2024-06-06T02:43:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560080def930 con 0x560080a4a1b0 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.181+0000 7f9322a00640 1 -- 172.21.15.82:0/3486558056 learned_addr learned my addr 172.21.15.82:0/3486558056 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9330bc9740 10 client.0 _ll_register_callbacks cb 0x560080cf4610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9323400640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9322a00640 1 -- 172.21.15.82:0/3486558056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 msgr2=0x560080df8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9322a00640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9322a00640 1 -- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 msgr2=0x560080dfdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9322a00640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.182+0000 7f9322a00640 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560080d1b170 con 0x560080a294d0 2024-06-06T02:43:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.184+0000 7f9322a00640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f931c015a20 tx=0x7f931c004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4446e9d8862aaeb7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.184+0000 7f930cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:43:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.185+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c023020 con 0x560080a294d0 2024-06-06T02:43:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.186+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f931c013b40 con 0x560080a294d0 2024-06-06T02:43:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.186+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9314040070 con 0x560080a294d0 2024-06-06T02:43:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.187+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f931c01b040 con 0x560080a294d0 2024-06-06T02:43:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.187+0000 7f9330bc9740 10 client.25937 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:51.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.187+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560080ab5790 con 0x560080a294d0 2024-06-06T02:43:51.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9314040070 con 0x560080a294d0 2024-06-06T02:43:51.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f931c030020 con 0x560080a294d0 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 10 client.25937 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 10 client.25937 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 20 client.25937 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5600809de1c0 0x560080e170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 4 client.25937 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:43:51.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.188+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560080d633d0 con 0x5600809de1c0 2024-06-06T02:43:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.191+0000 7f9322000640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5600809de1c0 0x560080e170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.193+0000 7f9322000640 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5600809de1c0 0x560080e170d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee45e21c22eb76a3 server_cookie=7514f03f0eff6f8d in_seq=0 out_seq=0 2024-06-06T02:43:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.193+0000 7f930cc00640 10 client.25937 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f930cc00640 1 -- 172.21.15.82:0/3486558056 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560080d633d0 con 0x5600809de1c0 2024-06-06T02:43:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f930cc00640 10 client.25937 handle_command_reply: tid=0 2024-06-06T02:43:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f9330bc9740 1 client.25937 shutdown 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 msgr2=0x560080df86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f931c015a20 tx=0x7f931c004b50 comp rx=0 tx=0).stop 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.197+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 shutdown_connections 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5600809de1c0 0x560080e170d0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080df8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f930cc00640 0 client.25937 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f9330bc9740 1 --2- 172.21.15.82:0/3486558056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a294d0 0x560080df86e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.198+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 >> 172.21.15.82:0/3486558056 conn(0x560080a3e300 msgr2=0x560080dea8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.199+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 shutdown_connections 2024-06-06T02:43:51.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.200+0000 7f9330bc9740 1 -- 172.21.15.82:0/3486558056 wait complete. 2024-06-06T02:43:51.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.200+0000 7f9330bc9740 20 client.25937 trim_cache size 0 max 16384 2024-06-06T02:43:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.235+0000 7f9330bc9740 1 Processor -- start 2024-06-06T02:43:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.235+0000 7f9330bc9740 1 -- start start 2024-06-06T02:43:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 0x560080debdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 0x560080df6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9304010d60 con 0x560080a08d80 2024-06-06T02:43:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f930400e630 con 0x560080a4a1b0 2024-06-06T02:43:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9330bc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f930400c460 con 0x560080a294d0 2024-06-06T02:43:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.236+0000 7f9323400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 0x560080df6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.237+0000 7f9323400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 0x560080df6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:37466/0 (socket says 172.21.15.82:37466) 2024-06-06T02:43:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.237+0000 7f9322a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.237+0000 7f9323400640 1 -- 172.21.15.82:0/1598496766 learned_addr learned my addr 172.21.15.82:0/1598496766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.238+0000 7f9322000640 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 0x560080debdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.238+0000 7f9322000640 1 -- 172.21.15.82:0/1598496766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 msgr2=0x560080df6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.238+0000 7f9322000640 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 0x560080df6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.238+0000 7f9322000640 1 -- 172.21.15.82:0/1598496766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 msgr2=0x560080dfe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.238+0000 7f9322000640 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.239+0000 7f9322000640 1 -- 172.21.15.82:0/1598496766 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560080b2e620 con 0x560080a294d0 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.240+0000 7f9322000640 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 0x560080debdc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93100a4a40 tx=0x7f93100cb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941e3d28ca0c0c54 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.240+0000 7f930f400640 1 -- 172.21.15.82:0/1598496766 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310020040 con 0x560080a294d0 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.240+0000 7f930f400640 1 -- 172.21.15.82:0/1598496766 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93100a84d0 con 0x560080a294d0 2024-06-06T02:43:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.240+0000 7f930f400640 1 -- 172.21.15.82:0/1598496766 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93100a4c50 con 0x560080a294d0 2024-06-06T02:43:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.241+0000 7f9330bc9740 1 -- 172.21.15.82:0/1598496766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 msgr2=0x560080debdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.241+0000 7f9330bc9740 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 0x560080debdc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f93100a4a40 tx=0x7f93100cb040 comp rx=0 tx=0).stop 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 -- 172.21.15.82:0/1598496766 shutdown_connections 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a4a1b0 0x560080df6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a294d0 0x560080debdc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 --2- 172.21.15.82:0/1598496766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a08d80 0x560080dfe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 -- 172.21.15.82:0/1598496766 >> 172.21.15.82:0/1598496766 conn(0x560080a3e300 msgr2=0x560080deb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 -- 172.21.15.82:0/1598496766 shutdown_connections 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.242+0000 7f9330bc9740 1 -- 172.21.15.82:0/1598496766 wait complete. 2024-06-06T02:43:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.243+0000 7f9330bc9740 1 -- start start 2024-06-06T02:43:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.243+0000 7f9330bc9740 1 Processor -- start 2024-06-06T02:43:51.244 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a294d0 0x560080e270f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080e27fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f930400caf0 con 0x560080a294d0 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f930400df60 con 0x560080a08d80 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f930400d1c0 con 0x560080a4a1b0 2024-06-06T02:43:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.244+0000 7f9330bc9740 10 client.0 _ll_register_callbacks cb 0x7f931c0156d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.245+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.246+0000 7f9322a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:37476/0 (socket says 172.21.15.82:37476) 2024-06-06T02:43:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.246+0000 7f9322a00640 1 -- 172.21.15.82:0/372947260 learned_addr learned my addr 172.21.15.82:0/372947260 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.246+0000 7f9322000640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a294d0 0x560080e270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.245+0000 7f9323400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080e27fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9322a00640 1 -- 172.21.15.82:0/372947260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 msgr2=0x560080e27fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9322a00640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080e27fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9322a00640 1 -- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a294d0 msgr2=0x560080e270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9322a00640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a294d0 0x560080e270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9322a00640 1 -- 172.21.15.82:0/372947260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560080e285a0 con 0x560080a08d80 2024-06-06T02:43:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.247+0000 7f9323400640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080e27fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:43:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.248+0000 7f9322a00640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f931c015a20 tx=0x7f931c013810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33472ea2bf719c04 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.248+0000 7f930cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:43:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.249+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c037070 con 0x560080a08d80 2024-06-06T02:43:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.249+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f931c013e10 con 0x560080a08d80 2024-06-06T02:43:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.249+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93100a84d0 con 0x560080a08d80 2024-06-06T02:43:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.250+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f931c023040 con 0x560080a08d80 2024-06-06T02:43:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.250+0000 7f9330bc9740 10 client.25943 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.250+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560080e7fb80 con 0x560080a08d80 2024-06-06T02:43:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93100a84d0 con 0x560080a08d80 2024-06-06T02:43:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f931c030040 con 0x560080a08d80 2024-06-06T02:43:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f9330bc9740 10 client.25943 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f9330bc9740 10 client.25943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f9330bc9740 20 client.25943 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.251+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560080e805b0 0x560080e829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.252+0000 7f9330bc9740 4 client.25943 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.252+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560080d5ee70 con 0x560080e805b0 2024-06-06T02:43:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.252+0000 7f9322000640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560080e805b0 0x560080e829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.253+0000 7f9322000640 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560080e805b0 0x560080e829d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397679d83c99c053 server_cookie=8d4aed40af12f29e in_seq=0 out_seq=0 2024-06-06T02:43:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.253+0000 7f930cc00640 10 client.25943 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:51.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.635+0000 7f930cc00640 1 -- 172.21.15.82:0/372947260 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560080d5ee70 con 0x560080e805b0 2024-06-06T02:43:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.635+0000 7f930cc00640 10 client.25943 handle_command_reply: tid=0 2024-06-06T02:43:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.635+0000 7f9330bc9740 1 client.25943 shutdown 2024-06-06T02:43:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 msgr2=0x560080e26bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f931c015a20 tx=0x7f931c013810 comp rx=0 tx=0).stop 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 shutdown_connections 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560080a4a1b0 0x560080e27fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560080e805b0 0x560080e829d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560080a294d0 0x560080e270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 --2- 172.21.15.82:0/372947260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560080a08d80 0x560080e26bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 >> 172.21.15.82:0/372947260 conn(0x560080a3e300 msgr2=0x560080de9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.636+0000 7f930cc00640 0 client.25943 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.637+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 shutdown_connections 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.637+0000 7f9330bc9740 1 -- 172.21.15.82:0/372947260 wait complete. 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.638+0000 7f9330bc9740 20 client.25943 trim_cache size 0 max 16384 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:43:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 msgr2=0x7f93080b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 0x7f93080b4f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x560080deb680 tx=0x7f931c00b040 comp rx=0 tx=0).stop 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 msgr2=0x7f93240743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 0x7f93240743b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f931000d6d0 tx=0x7f931000db90 comp rx=0 tx=0).stop 2024-06-06T02:43:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 shutdown_connections 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f93080b2a50 0x7f93080b4f60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9324103350 0x7f93240725d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9324102a00 0x7f93240743b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 --2- 172.21.15.82:0/3792818124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93241018e0 0x7f9324073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.639+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 >> 172.21.15.82:0/3792818124 conn(0x7f93240fd0c0 msgr2=0x7f93240feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.640+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 shutdown_connections 2024-06-06T02:43:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:43:51.640+0000 7f9323e00640 1 -- 172.21.15.82:0/3792818124 wait complete. 2024-06-06T02:43:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:52 smithi103 ceph-mon[36349]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.89k op/s 2024-06-06T02:43:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:52 smithi082 ceph-mon[31579]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.89k op/s 2024-06-06T02:43:53.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:52 smithi184 ceph-mon[36922]: pgmap v628: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 73 MiB/s wr, 10.89k op/s 2024-06-06T02:43:55.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:54 smithi103 ceph-mon[36349]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 11.41k op/s 2024-06-06T02:43:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:54 smithi082 ceph-mon[31579]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 11.41k op/s 2024-06-06T02:43:55.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:54 smithi184 ceph-mon[36922]: pgmap v629: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 11.41k op/s 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.647+0000 7f238b000640 1 -- 172.21.15.82:0/1057660352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c0a6e50 msgr2=0x7f237c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.647+0000 7f238b000640 1 --2- 172.21.15.82:0/1057660352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c0a6e50 0x7f237c0a9270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2384069400 tx=0x7f2384097540 comp rx=0 tx=0).stop 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.651+0000 7f238b000640 1 -- 172.21.15.82:0/1057660352 shutdown_connections 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.651+0000 7f238b000640 1 --2- 172.21.15.82:0/1057660352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c0a6e50 0x7f237c0a9270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.651+0000 7f238b000640 1 --2- 172.21.15.82:0/1057660352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 0x7f237c0a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:56.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.651+0000 7f238b000640 1 --2- 172.21.15.82:0/1057660352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c006d20 0x7f237c007130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:56.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.651+0000 7f238b000640 1 -- 172.21.15.82:0/1057660352 >> 172.21.15.82:0/1057660352 conn(0x7f237c091b30 msgr2=0x7f237c093f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.653+0000 7f238b000640 1 -- 172.21.15.82:0/1057660352 shutdown_connections 2024-06-06T02:43:56.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.653+0000 7f238b000640 1 -- 172.21.15.82:0/1057660352 wait complete. 2024-06-06T02:43:56.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.657+0000 7f238b000640 1 Processor -- start 2024-06-06T02:43:56.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.657+0000 7f238b000640 1 -- start start 2024-06-06T02:43:56.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:56.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 0x7f237c133560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c0a6e50 0x7f237c137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f237c0ac640 con 0x7f237c007670 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f237c0ac4c0 con 0x7f237c0a6e50 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.658+0000 7f238b000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f237c0ac7c0 con 0x7f237c006d20 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.659+0000 7f2389c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.659+0000 7f2389c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52948/0 (socket says 172.21.15.82:52948) 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.659+0000 7f2389c00640 1 -- 172.21.15.82:0/2999349921 learned_addr learned my addr 172.21.15.82:0/2999349921 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.659+0000 7f2389200640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 0x7f237c133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:56.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.659+0000 7f238a600640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c0a6e50 0x7f237c137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 -- 172.21.15.82:0/2999349921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c0a6e50 msgr2=0x7f237c137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c0a6e50 0x7f237c137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 -- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 msgr2=0x7f237c133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 0x7f237c133560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 -- 172.21.15.82:0/2999349921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c137e70 con 0x7f237c006d20 2024-06-06T02:43:56.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.660+0000 7f2389c00640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f237800e9f0 tx=0x7f237800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:56.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.662+0000 7f2382000640 1 -- 172.21.15.82:0/2999349921 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237800ccc0 con 0x7f237c006d20 2024-06-06T02:43:56.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.662+0000 7f2382000640 1 -- 172.21.15.82:0/2999349921 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f237800ce60 con 0x7f237c006d20 2024-06-06T02:43:56.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.662+0000 7f2382000640 1 -- 172.21.15.82:0/2999349921 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378010430 con 0x7f237c006d20 2024-06-06T02:43:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.665+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c138160 con 0x7f237c006d20 2024-06-06T02:43:56.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.666+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c138620 con 0x7f237c006d20 2024-06-06T02:43:56.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.681+0000 7f2382000640 1 -- 172.21.15.82:0/2999349921 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f23780046c0 con 0x7f237c006d20 2024-06-06T02:43:56.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.684+0000 7f2382000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 0x7f236c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:56.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.684+0000 7f2382000640 1 -- 172.21.15.82:0/2999349921 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f23780e28d0 con 0x7f237c006d20 2024-06-06T02:43:56.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.685+0000 7f2389200640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 0x7f236c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:56.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:56.686+0000 7f2389200640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 0x7f236c0b4d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f237c092f90 tx=0x7f2370008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:56.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:56 smithi082 ceph-mon[31579]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 70 MiB/s wr, 10.19k op/s 2024-06-06T02:43:57.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:56 smithi103 ceph-mon[36349]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 70 MiB/s wr, 10.19k op/s 2024-06-06T02:43:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:56 smithi184 ceph-mon[36922]: pgmap v630: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 70 MiB/s wr, 10.19k op/s 2024-06-06T02:43:57.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.195+0000 7f2392cde740 1 Processor -- start 2024-06-06T02:43:57.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.196+0000 7f2392cde740 1 -- start start 2024-06-06T02:43:57.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.196+0000 7f2392cde740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0969a5350 0x55a096d4b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2392cde740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2392cde740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a096984670 0x55a096d4baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2392cde740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a096cbfc60 con 0x55a0969a5350 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2392cde740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a096caf200 con 0x55a09697c490 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2392cde740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a096cb3240 con 0x55a096984670 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2389200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2389200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38412/0 (socket says 172.21.15.82:38412) 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.197+0000 7f2389200640 1 -- 172.21.15.82:0/2440827926 learned_addr learned my addr 172.21.15.82:0/2440827926 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.198+0000 7f2389200640 1 -- 172.21.15.82:0/2440827926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a096984670 msgr2=0x55a096d4baf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.198+0000 7f2389200640 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a096984670 0x55a096d4baf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.198+0000 7f2389200640 1 -- 172.21.15.82:0/2440827926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0969a5350 msgr2=0x55a096d4b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.198+0000 7f2389200640 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0969a5350 0x55a096d4b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.198+0000 7f2389200640 1 -- 172.21.15.82:0/2440827926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a096a10930 con 0x55a09697c490 2024-06-06T02:43:57.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.199+0000 7f2389200640 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f237000c9b0 tx=0x7f237000f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f93b42415e2dd39 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:57.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.200+0000 7f2376a00640 1 -- 172.21.15.82:0/2440827926 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370023070 con 0x55a09697c490 2024-06-06T02:43:57.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.201+0000 7f2376a00640 1 -- 172.21.15.82:0/2440827926 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370013db0 con 0x55a09697c490 2024-06-06T02:43:57.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.202+0000 7f2392cde740 1 -- 172.21.15.82:0/2440827926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 msgr2=0x55a096d4b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.204+0000 7f2376a00640 1 -- 172.21.15.82:0/2440827926 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370023070 con 0x55a09697c490 2024-06-06T02:43:57.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.204+0000 7f2392cde740 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f237000c9b0 tx=0x7f237000f000 comp rx=0 tx=0).stop 2024-06-06T02:43:57.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.207+0000 7f2392cde740 1 -- 172.21.15.82:0/2440827926 shutdown_connections 2024-06-06T02:43:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.207+0000 7f2392cde740 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a096984670 0x55a096d4baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.207+0000 7f2392cde740 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d4b5b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.207+0000 7f2392cde740 1 --2- 172.21.15.82:0/2440827926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a0969a5350 0x55a096d4b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.207+0000 7f2392cde740 1 -- 172.21.15.82:0/2440827926 >> 172.21.15.82:0/2440827926 conn(0x55a096999740 msgr2=0x55a096d478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:57.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.208+0000 7f2392cde740 1 -- 172.21.15.82:0/2440827926 shutdown_connections 2024-06-06T02:43:57.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.208+0000 7f2392cde740 1 -- 172.21.15.82:0/2440827926 wait complete. 2024-06-06T02:43:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.211+0000 7f2392cde740 1 -- start start 2024-06-06T02:43:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.211+0000 7f2392cde740 1 Processor -- start 2024-06-06T02:43:57.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.213+0000 7f2392cde740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.213+0000 7f2392cde740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d55d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.214+0000 7f2392cde740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.214+0000 7f2392cde740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a096b13890 con 0x55a096984670 2024-06-06T02:43:57.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.215+0000 7f2389c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.215+0000 7f2389c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38426/0 (socket says 172.21.15.82:38426) 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.215+0000 7f2392cde740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a096c4c2c0 con 0x55a09697c490 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.216+0000 7f238a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.216+0000 7f2392cde740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a096d58230 con 0x55a0969a5350 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.216+0000 7f238a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52970/0 (socket says 172.21.15.82:52970) 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.216+0000 7f238a600640 1 -- 172.21.15.82:0/4110783620 learned_addr learned my addr 172.21.15.82:0/4110783620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.216+0000 7f2392cde740 10 client.0 _ll_register_callbacks cb 0x55a096c51430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 -- 172.21.15.82:0/4110783620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 msgr2=0x55a096d557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 -- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 msgr2=0x55a096d55d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d55d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 -- 172.21.15.82:0/4110783620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a096d5bba0 con 0x55a0969a5350 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f238a600640 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2384097a60 tx=0x7f238409e460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e910ea3f86c5f60f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.217+0000 7f236b400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.218+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384069c40 con 0x55a0969a5350 2024-06-06T02:43:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.218+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2370013db0 con 0x55a0969a5350 2024-06-06T02:43:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.218+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f23840a4070 con 0x55a0969a5350 2024-06-06T02:43:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.219+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2384069de0 con 0x55a0969a5350 2024-06-06T02:43:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.219+0000 7f2392cde740 10 client.25984 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.219+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a096d64600 con 0x55a0969a5350 2024-06-06T02:43:57.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.220+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370013db0 con 0x55a0969a5350 2024-06-06T02:43:57.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.220+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f23840b3020 con 0x55a0969a5350 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 10 client.25984 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 10 client.25984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 20 client.25984 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096963cd0 0x55a096d67b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 4 client.25984 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:43:57.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.222+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a096cc1bb0 con 0x55a096963cd0 2024-06-06T02:43:57.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.224+0000 7f2389c00640 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096963cd0 0x55a096d67b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.225+0000 7f2389c00640 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096963cd0 0x55a096d67b20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d403309aeadf315 server_cookie=e24bc07c2d68d21a in_seq=0 out_seq=0 2024-06-06T02:43:57.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.226+0000 7f236b400640 10 client.25984 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:57.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.227+0000 7f236b400640 1 -- 172.21.15.82:0/4110783620 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a096cc1bb0 con 0x55a096963cd0 2024-06-06T02:43:57.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.227+0000 7f236b400640 10 client.25984 handle_command_reply: tid=0 2024-06-06T02:43:57.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.227+0000 7f2392cde740 1 client.25984 shutdown 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.230+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 msgr2=0x55a096d5b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.230+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2384097a60 tx=0x7f238409e460 comp rx=0 tx=0).stop 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 shutdown_connections 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5b5b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096963cd0 0x55a096d67b20 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d55d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 --2- 172.21.15.82:0/4110783620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.231+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 >> 172.21.15.82:0/4110783620 conn(0x55a096999740 msgr2=0x55a096d4b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:57.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.232+0000 7f236b400640 0 client.25984 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:57.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.232+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 shutdown_connections 2024-06-06T02:43:57.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.232+0000 7f2392cde740 1 -- 172.21.15.82:0/4110783620 wait complete. 2024-06-06T02:43:57.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.232+0000 7f2392cde740 20 client.25984 trim_cache size 0 max 16384 2024-06-06T02:43:57.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.282+0000 7f2392cde740 1 Processor -- start 2024-06-06T02:43:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.283+0000 7f2392cde740 1 -- start start 2024-06-06T02:43:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a09697c490 0x55a096d54870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d6d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f237c14a920 con 0x55a09697c490 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1481f0 con 0x55a096984670 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.284+0000 7f2392cde740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f237c146020 con 0x55a0969a5350 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f238a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d6d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38432/0 (socket says 172.21.15.82:38432) 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 -- 172.21.15.82:0/708852584 learned_addr learned my addr 172.21.15.82:0/708852584 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f238a600640 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d6d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52980/0 (socket says 172.21.15.82:52980) 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 -- 172.21.15.82:0/708852584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 msgr2=0x55a096d6d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d6d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 -- 172.21.15.82:0/708852584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a09697c490 msgr2=0x55a096d54870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a09697c490 0x55a096d54870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.285+0000 7f2389200640 1 -- 172.21.15.82:0/708852584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a096d4c470 con 0x55a096984670 2024-06-06T02:43:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.286+0000 7f2389200640 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2370021040 tx=0x7f237000c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2b6198217b9f28 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.286+0000 7f2376000640 1 -- 172.21.15.82:0/708852584 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370023050 con 0x55a096984670 2024-06-06T02:43:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.286+0000 7f2376000640 1 -- 172.21.15.82:0/708852584 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370024040 con 0x55a096984670 2024-06-06T02:43:57.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.286+0000 7f2376000640 1 -- 172.21.15.82:0/708852584 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237002a6b0 con 0x55a096984670 2024-06-06T02:43:57.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 -- 172.21.15.82:0/708852584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 msgr2=0x55a096d5b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2370021040 tx=0x7f237000c6c0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 -- 172.21.15.82:0/708852584 shutdown_connections 2024-06-06T02:43:57.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d6d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a096984670 0x55a096d5b520 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 --2- 172.21.15.82:0/708852584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a09697c490 0x55a096d54870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.290+0000 7f2392cde740 1 -- 172.21.15.82:0/708852584 >> 172.21.15.82:0/708852584 conn(0x55a096999740 msgr2=0x55a096d4f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:57.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.291+0000 7f2392cde740 1 -- 172.21.15.82:0/708852584 shutdown_connections 2024-06-06T02:43:57.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.291+0000 7f2392cde740 1 -- 172.21.15.82:0/708852584 wait complete. 2024-06-06T02:43:57.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.292+0000 7f2392cde740 1 -- start start 2024-06-06T02:43:57.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.293+0000 7f2392cde740 1 Processor -- start 2024-06-06T02:43:57.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.296+0000 7f2392cde740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.296+0000 7f2392cde740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d5da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.296+0000 7f2392cde740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2392cde740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1466b0 con 0x55a096984670 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2389c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2389200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d5da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2389c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:38448/0 (socket says 172.21.15.82:38448) 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2389c00640 1 -- 172.21.15.82:0/690746620 learned_addr learned my addr 172.21.15.82:0/690746620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f237c147b20 con 0x55a09697c490 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f237c146d80 con 0x55a0969a5350 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f2392cde740 10 client.0 _ll_register_callbacks cb 0x7f2378005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:43:57.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.297+0000 7f238a600640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.298+0000 7f238a600640 1 -- 172.21.15.82:0/690746620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 msgr2=0x55a096d5d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.298+0000 7f238a600640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.298+0000 7f238a600640 1 -- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 msgr2=0x55a096d5da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.299+0000 7f238a600640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d5da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.299+0000 7f238a600640 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a096dcf2d0 con 0x55a0969a5350 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.299+0000 7f2389200640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d5da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.299+0000 7f2389c00640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.300+0000 7f236b400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:43:57.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.300+0000 7f238a600640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5dfc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2384068820 tx=0x7f238409ef30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795bf64ba39fdab3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:43:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.300+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384069c40 con 0x55a0969a5350 2024-06-06T02:43:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.300+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2370024040 con 0x55a0969a5350 2024-06-06T02:43:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.300+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f23840a4070 con 0x55a0969a5350 2024-06-06T02:43:57.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.301+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2384069c40 con 0x55a0969a5350 2024-06-06T02:43:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.301+0000 7f2392cde740 10 client.25990 fetch_fsmap learned FSMap version 29 2024-06-06T02:43:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.301+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a096dd0590 con 0x55a0969a5350 2024-06-06T02:43:57.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2370024040 con 0x55a0969a5350 2024-06-06T02:43:57.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f23840be610 con 0x55a0969a5350 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 10 client.25990 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 10 client.25990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 20 client.25990 populate_metadata read hostname 'smithi082' 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096939080 0x55a096dd2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 4 client.25990 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.302+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a096cbd650 con 0x55a096939080 2024-06-06T02:43:57.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.303+0000 7f2389c00640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096939080 0x55a096dd2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:43:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.304+0000 7f2389c00640 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096939080 0x55a096dd2ca0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54e7f1b73bf8dcc server_cookie=4f1d3a07d3263610 in_seq=0 out_seq=0 2024-06-06T02:43:57.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.304+0000 7f236b400640 10 client.25990 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.309+0000 7f236b400640 1 -- 172.21.15.82:0/690746620 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a096cbd650 con 0x55a096939080 2024-06-06T02:43:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.309+0000 7f236b400640 10 client.25990 handle_command_reply: tid=0 2024-06-06T02:43:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.309+0000 7f2392cde740 1 client.25990 shutdown 2024-06-06T02:43:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.309+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 msgr2=0x55a096d5dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.309+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5dfc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2384068820 tx=0x7f238409ef30 comp rx=0 tx=0).stop 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 shutdown_connections 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a0969a5350 0x55a096d5dfc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a096939080 0x55a096dd2ca0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a096984670 0x55a096d5da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 --2- 172.21.15.82:0/690746620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a09697c490 0x55a096d5d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 >> 172.21.15.82:0/690746620 conn(0x55a096999740 msgr2=0x55a096d45f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f236b400640 0 client.25990 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 shutdown_connections 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.310+0000 7f2392cde740 1 -- 172.21.15.82:0/690746620 wait complete. 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.311+0000 7f2392cde740 20 client.25990 trim_cache size 0 max 16384 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-06-06T02:43:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "72912f9e-c74e-4d3e-8f13-163c4d2f6c40", 2024-06-06T02:43:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-06-06T02:43:57.313 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:43:57.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.313+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 msgr2=0x7f236c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.313+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 0x7f236c0b4d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f237c092f90 tx=0x7f2370008040 comp rx=0 tx=0).stop 2024-06-06T02:43:57.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.313+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 msgr2=0x7f237c133000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:43:57.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.313+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f237800e9f0 tx=0x7f237800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 shutdown_connections 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f237c0a6e50 0x7f237c137830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237c007670 0x7f237c133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f236c0b2870 0x7f236c0b4d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 --2- 172.21.15.82:0/2999349921 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f237c006d20 0x7f237c133000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.314+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 >> 172.21.15.82:0/2999349921 conn(0x7f237c091b30 msgr2=0x7f237c0931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.315+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 shutdown_connections 2024-06-06T02:43:57.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:43:57.315+0000 7f238b000640 1 -- 172.21.15.82:0/2999349921 wait complete. 2024-06-06T02:43:59.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:58 smithi103 ceph-mon[36349]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.92k op/s 2024-06-06T02:43:59.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:58 smithi103 ceph-mon[36349]: scrub queued for path: / 2024-06-06T02:43:59.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:58 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:43:59.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:58 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:43:59.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:43:58 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:58 smithi082 ceph-mon[31579]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.92k op/s 2024-06-06T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:58 smithi082 ceph-mon[31579]: scrub queued for path: / 2024-06-06T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:58 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:58 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:43:59.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:43:58 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:43:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:58 smithi184 ceph-mon[36922]: pgmap v631: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 75 MiB/s wr, 10.92k op/s 2024-06-06T02:43:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:58 smithi184 ceph-mon[36922]: scrub queued for path: / 2024-06-06T02:43:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:58 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:43:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:58 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:43:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:43:58 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:44:01.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:00 smithi103 ceph-mon[36349]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 MiB/s wr, 10.30k op/s 2024-06-06T02:44:01.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:00 smithi082 ceph-mon[31579]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 MiB/s wr, 10.30k op/s 2024-06-06T02:44:01.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:00 smithi184 ceph-mon[36922]: pgmap v632: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 72 MiB/s wr, 10.30k op/s 2024-06-06T02:44:03.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:02 smithi103 ceph-mon[36349]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 76 MiB/s wr, 10.70k op/s 2024-06-06T02:44:03.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:02 smithi082 ceph-mon[31579]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 76 MiB/s wr, 10.70k op/s 2024-06-06T02:44:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:02 smithi184 ceph-mon[36922]: pgmap v633: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 76 MiB/s wr, 10.70k op/s 2024-06-06T02:44:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:04 smithi103 ceph-mon[36349]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.71k op/s 2024-06-06T02:44:05.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:04 smithi082 ceph-mon[31579]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.71k op/s 2024-06-06T02:44:05.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:04 smithi184 ceph-mon[36922]: pgmap v634: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 83 MiB/s wr, 11.71k op/s 2024-06-06T02:44:05.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.285+0000 7f7ef2400640 1 -- 172.21.15.82:0/3396144033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 msgr2=0x7f7eec111360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.285+0000 7f7ef2400640 1 --2- 172.21.15.82:0/3396144033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec111360 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009be0 tx=0x7f7ee402a6c0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 -- 172.21.15.82:0/3396144033 shutdown_connections 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 --2- 172.21.15.82:0/3396144033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec111360 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 --2- 172.21.15.82:0/3396144033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec10a110 0x7f7eec10a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 --2- 172.21.15.82:0/3396144033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec108ff0 0x7f7eec109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 -- 172.21.15.82:0/3396144033 >> 172.21.15.82:0/3396144033 conn(0x7f7eec078220 msgr2=0x7f7eec07a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 -- 172.21.15.82:0/3396144033 shutdown_connections 2024-06-06T02:44:05.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.286+0000 7f7ef2400640 1 -- 172.21.15.82:0/3396144033 wait complete. 2024-06-06T02:44:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.287+0000 7f7ef2400640 1 Processor -- start 2024-06-06T02:44:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 -- start start 2024-06-06T02:44:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 0x7f7eec19f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec10a110 0x7f7eec19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec114b20 con 0x7f7eec108ff0 2024-06-06T02:44:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1149a0 con 0x7f7eec10aa60 2024-06-06T02:44:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.288+0000 7f7ef2400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec114ca0 con 0x7f7eec10a110 2024-06-06T02:44:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34406/0 (socket says 172.21.15.82:34406) 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 -- 172.21.15.82:0/2166571751 learned_addr learned my addr 172.21.15.82:0/2166571751 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec10a110 0x7f7eec19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1000640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 0x7f7eec19f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 -- 172.21.15.82:0/2166571751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec10a110 msgr2=0x7f7eec19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec10a110 0x7f7eec19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 -- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 msgr2=0x7f7eec19f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 0x7f7eec19f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.289+0000 7f7ef1a00640 1 -- 172.21.15.82:0/2166571751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec1a72c0 con 0x7f7eec10aa60 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.290+0000 7f7ef1000640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 0x7f7eec19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.290+0000 7f7ef1a00640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4030c80 tx=0x7f7ee4030cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.290+0000 7f7ee9600640 1 -- 172.21.15.82:0/2166571751 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4041020 con 0x7f7eec10aa60 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.291+0000 7f7ee9600640 1 -- 172.21.15.82:0/2166571751 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee4003e20 con 0x7f7eec10aa60 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.291+0000 7f7ee9600640 1 -- 172.21.15.82:0/2166571751 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4036040 con 0x7f7eec10aa60 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.291+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec1a7550 con 0x7f7eec10aa60 2024-06-06T02:44:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.291+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec1a7a90 con 0x7f7eec10aa60 2024-06-06T02:44:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.298+0000 7f7efaa7c740 1 Processor -- start 2024-06-06T02:44:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.299+0000 7f7ee9600640 1 -- 172.21.15.82:0/2166571751 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7ee4044020 con 0x7f7eec10aa60 2024-06-06T02:44:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.299+0000 7f7efaa7c740 1 -- start start 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.299+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.299+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.299+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41074d0 0x5623c44d4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.300+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623c443f480 con 0x5623c41074d0 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.300+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623c442ea20 con 0x5623c40ff2f0 2024-06-06T02:44:05.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.300+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5623c4432a60 con 0x5623c41281b0 2024-06-06T02:44:05.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.301+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.301+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34410/0 (socket says 172.21.15.82:34410) 2024-06-06T02:44:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.301+0000 7f7ef1000640 1 -- 172.21.15.82:0/1506164335 learned_addr learned my addr 172.21.15.82:0/1506164335 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.301+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41074d0 0x5623c44d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.302+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7ef1000640 1 -- 172.21.15.82:0/1506164335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 msgr2=0x5623c44ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7ef1000640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7ef1000640 1 -- 172.21.15.82:0/1506164335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41074d0 msgr2=0x5623c44d4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7ef1000640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41074d0 0x5623c44d4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7ef1000640 1 -- 172.21.15.82:0/1506164335 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c442b8d0 con 0x5623c40ff2f0 2024-06-06T02:44:05.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.303+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:44:05.304 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.305+0000 7f7ef1000640 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009c00 tx=0x7f7edc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3347ce8b11738d14 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.308+0000 7f7eda000640 1 -- 172.21.15.82:0/1506164335 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc004030 con 0x5623c40ff2f0 2024-06-06T02:44:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.308+0000 7f7eda000640 1 -- 172.21.15.82:0/1506164335 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc0035f0 con 0x5623c40ff2f0 2024-06-06T02:44:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.308+0000 7f7eda000640 1 -- 172.21.15.82:0/1506164335 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0126b0 con 0x5623c40ff2f0 2024-06-06T02:44:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.308+0000 7f7ee9600640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 0x7f7ed40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.308+0000 7f7ee9600640 1 -- 172.21.15.82:0/2166571751 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7ee41028e0 con 0x7f7eec10aa60 2024-06-06T02:44:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1506164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 msgr2=0x5623c44cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009c00 tx=0x7f7edc010740 comp rx=0 tx=0).stop 2024-06-06T02:44:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1506164335 shutdown_connections 2024-06-06T02:44:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41074d0 0x5623c44d4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44cd480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1506164335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7eebe00640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 0x7f7ed40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.313+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1506164335 >> 172.21.15.82:0/1506164335 conn(0x5623c411c300 msgr2=0x5623c44c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.315+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1506164335 shutdown_connections 2024-06-06T02:44:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.315+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1506164335 wait complete. 2024-06-06T02:44:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.316+0000 7f7efaa7c740 1 -- start start 2024-06-06T02:44:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.316+0000 7f7efaa7c740 1 Processor -- start 2024-06-06T02:44:05.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.317+0000 7f7eebe00640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 0x7f7ed40b4dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1a0820 tx=0x7f7ee0015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.319+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 0x5623c44d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 0x5623c44d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 0x5623c44d6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42934/0 (socket says 172.21.15.82:42934) 2024-06-06T02:44:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623c4369ab0 con 0x5623c40ff2f0 2024-06-06T02:44:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623c43cc630 con 0x5623c41074d0 2024-06-06T02:44:05.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5623c44d4d10 con 0x5623c41281b0 2024-06-06T02:44:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34424/0 (socket says 172.21.15.82:34424) 2024-06-06T02:44:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7eebe00640 1 -- 172.21.15.82:0/2298429726 learned_addr learned my addr 172.21.15.82:0/2298429726 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.320+0000 7f7efaa7c740 10 client.0 _ll_register_callbacks cb 0x5623c43d2610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:05.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.321+0000 7f7ef1a00640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.322+0000 7f7eebe00640 1 -- 172.21.15.82:0/2298429726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 msgr2=0x5623c44ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.322+0000 7f7eebe00640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.322+0000 7f7eebe00640 1 -- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 msgr2=0x5623c44d6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.322+0000 7f7eebe00640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 0x5623c44d6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.322+0000 7f7eebe00640 1 -- 172.21.15.82:0/2298429726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c43f9170 con 0x5623c41074d0 2024-06-06T02:44:05.322 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.323+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc0035f0 con 0x5623c41074d0 2024-06-06T02:44:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.323+0000 7f7eebe00640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0010c20 tx=0x7f7ee0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22549bb7b824900e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.324+0000 7f7ecea00640 10 client.25967 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.324+0000 7f7ecea00640 1 -- 172.21.15.82:0/2298429726 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee002e060 con 0x5623c41074d0 2024-06-06T02:44:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.324+0000 7f7ecea00640 1 -- 172.21.15.82:0/2298429726 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7ee001a050 con 0x5623c41074d0 2024-06-06T02:44:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.324+0000 7f7ecea00640 1 -- 172.21.15.82:0/2298429726 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ee001ece0 con 0x5623c41074d0 2024-06-06T02:44:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.325+0000 7f7efaa7c740 10 client.25967 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:05.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.325+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5623c4193790 con 0x5623c41074d0 2024-06-06T02:44:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.325+0000 7f7ecea00640 1 -- 172.21.15.82:0/2298429726 <== mon.2 v2:172.21.15.103:3300/0 4 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f7ee001c070 con 0x5623c41074d0 2024-06-06T02:44:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 10 client.25967 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:05.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 10 client.25967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 20 client.25967 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c40e6d80 0x5623c44e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 4 client.25967 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:44:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.326+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623c44413d0 con 0x5623c40e6d80 2024-06-06T02:44:05.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.327+0000 7f7ef1000640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c40e6d80 0x5623c44e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.328+0000 7f7ecea00640 10 client.25967 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:05.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.329+0000 7f7ef1000640 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c40e6d80 0x5623c44e3d70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58ddc1fd2a96ccb server_cookie=2bb25c9ee6f4d315 in_seq=0 out_seq=0 2024-06-06T02:44:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.330+0000 7f7ecea00640 1 -- 172.21.15.82:0/2298429726 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5623c44413d0 con 0x5623c40e6d80 2024-06-06T02:44:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.331+0000 7f7ecea00640 10 client.25967 handle_command_reply: tid=0 2024-06-06T02:44:05.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.331+0000 7f7efaa7c740 1 client.25967 shutdown 2024-06-06T02:44:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 msgr2=0x5623c44d6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0010c20 tx=0x7f7ee0004730 comp rx=0 tx=0).stop 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 shutdown_connections 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c41074d0 0x5623c44d6c80 secure :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0010c20 tx=0x7f7ee0004730 comp rx=0 tx=0).stop 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c40e6d80 0x5623c44e3d70 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/2298429726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40ff2f0 0x5623c44d6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7ecea00640 0 client.25967 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:05.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.332+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 >> 172.21.15.82:0/2298429726 conn(0x5623c411c300 msgr2=0x5623c44c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.337+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 shutdown_connections 2024-06-06T02:44:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.337+0000 7f7efaa7c740 1 -- 172.21.15.82:0/2298429726 wait complete. 2024-06-06T02:44:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.337+0000 7f7efaa7c740 20 client.25967 trim_cache size 0 max 16384 2024-06-06T02:44:05.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.379+0000 7f7efaa7c740 1 Processor -- start 2024-06-06T02:44:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.380+0000 7f7efaa7c740 1 -- start start 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40bc1c0 0x5623c44d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1b3220 con 0x5623c40bc1c0 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1b0af0 con 0x5623c40ff2f0 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.381+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1ae920 con 0x5623c41281b0 2024-06-06T02:44:05.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34434/0 (socket says 172.21.15.82:34434) 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 -- 172.21.15.82:0/168357204 learned_addr learned my addr 172.21.15.82:0/168357204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1a00640 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40bc1c0 0x5623c44d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 -- 172.21.15.82:0/168357204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 msgr2=0x5623c44ddba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 -- 172.21.15.82:0/168357204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40bc1c0 msgr2=0x5623c44d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40bc1c0 0x5623c44d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.382+0000 7f7ef1000640 1 -- 172.21.15.82:0/168357204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623c420c620 con 0x5623c40ff2f0 2024-06-06T02:44:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.383+0000 7f7ef1000640 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009c00 tx=0x7f7edc01e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebf6b9897687e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.383+0000 7f7ed9600640 1 -- 172.21.15.82:0/168357204 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0053d0 con 0x5623c40ff2f0 2024-06-06T02:44:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.384+0000 7f7ed9600640 1 -- 172.21.15.82:0/168357204 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc003c50 con 0x5623c40ff2f0 2024-06-06T02:44:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.384+0000 7f7ed9600640 1 -- 172.21.15.82:0/168357204 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc012c80 con 0x5623c40ff2f0 2024-06-06T02:44:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.385+0000 7f7efaa7c740 1 -- 172.21.15.82:0/168357204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 msgr2=0x5623c44c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.385+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009c00 tx=0x7f7edc01e040 comp rx=0 tx=0).stop 2024-06-06T02:44:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 -- 172.21.15.82:0/168357204 shutdown_connections 2024-06-06T02:44:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c40bc1c0 0x5623c44d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c41281b0 0x5623c44ddba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/168357204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44c9dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 -- 172.21.15.82:0/168357204 >> 172.21.15.82:0/168357204 conn(0x5623c411c300 msgr2=0x5623c44c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 -- 172.21.15.82:0/168357204 shutdown_connections 2024-06-06T02:44:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.386+0000 7f7efaa7c740 1 -- 172.21.15.82:0/168357204 wait complete. 2024-06-06T02:44:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.387+0000 7f7efaa7c740 1 -- start start 2024-06-06T02:44:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.388+0000 7f7efaa7c740 1 Processor -- start 2024-06-06T02:44:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 0x5623c44daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41281b0 0x5623c44dc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1aefb0 con 0x5623c41281b0 2024-06-06T02:44:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1b0420 con 0x5623c40ff2f0 2024-06-06T02:44:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec1af680 con 0x5623c40bc1c0 2024-06-06T02:44:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.389+0000 7f7efaa7c740 10 client.0 _ll_register_callbacks cb 0x7f7ee00108a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 0x5623c44daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7ef1000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 0x5623c44daf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:35074/0 (socket says 172.21.15.82:35074) 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7ef1000640 1 -- 172.21.15.82:0/1227989213 learned_addr learned my addr 172.21.15.82:0/1227989213 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7ef1a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41281b0 0x5623c44dc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 -- 172.21.15.82:0/1227989213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 msgr2=0x5623c44daf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 0x5623c44daf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 -- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41281b0 msgr2=0x5623c44dc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41281b0 0x5623c44dc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.390+0000 7f7eebe00640 1 -- 172.21.15.82:0/1227989213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623c44dc9d0 con 0x5623c40ff2f0 2024-06-06T02:44:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.391+0000 7f7eebe00640 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44db4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5623c44d7b40 tx=0x7f7ee001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e37749f9cb5f6e6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.391+0000 7f7ecea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.391+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee002e040 con 0x5623c40ff2f0 2024-06-06T02:44:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.391+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7ee0004220 con 0x5623c40ff2f0 2024-06-06T02:44:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.391+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc003c50 con 0x5623c40ff2f0 2024-06-06T02:44:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.392+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ee0004420 con 0x5623c40ff2f0 2024-06-06T02:44:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.392+0000 7f7efaa7c740 10 client.25973 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.392+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5623c44ddcd0 con 0x5623c40ff2f0 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.392+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7edc003c50 con 0x5623c40ff2f0 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f7ee00035f0 con 0x5623c40ff2f0 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 10 client.25973 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 10 client.25973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 20 client.25973 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c454ca90 0x5623c454eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 4 client.25973 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:44:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.393+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623c443ce70 con 0x5623c454ca90 2024-06-06T02:44:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.394+0000 7f7ef1000640 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c454ca90 0x5623c454eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.396+0000 7f7ecea00640 10 client.25973 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.396+0000 7f7ef1000640 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c454ca90 0x5623c454eeb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25bb72c1d3e8da6f server_cookie=42b1235fec4f631c in_seq=0 out_seq=0 2024-06-06T02:44:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.676+0000 7f7ecea00640 1 -- 172.21.15.82:0/1227989213 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623c443ce70 con 0x5623c454ca90 2024-06-06T02:44:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.676+0000 7f7ecea00640 10 client.25973 handle_command_reply: tid=0 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.676+0000 7f7efaa7c740 1 client.25973 shutdown 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.676+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 msgr2=0x5623c44db4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.676+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44db4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5623c44d7b40 tx=0x7f7ee001c000 comp rx=0 tx=0).stop 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 shutdown_connections 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x5623c454ca90 0x5623c454eeb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623c41281b0 0x5623c44dc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623c40ff2f0 0x5623c44db4b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 --2- 172.21.15.82:0/1227989213 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5623c40bc1c0 0x5623c44daf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 >> 172.21.15.82:0/1227989213 conn(0x5623c411c300 msgr2=0x5623c44c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.677+0000 7f7ecea00640 0 client.25973 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.678+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 shutdown_connections 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.678+0000 7f7efaa7c740 1 -- 172.21.15.82:0/1227989213 wait complete. 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.678+0000 7f7efaa7c740 20 client.25973 trim_cache size 0 max 16384 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:44:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:44:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:44:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:44:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.679+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 msgr2=0x7f7ed40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.679+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 0x7f7ed40b4dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7eec1a0820 tx=0x7f7ee0015040 comp rx=0 tx=0).stop 2024-06-06T02:44:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.679+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 msgr2=0x7f7eec1a6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.679+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4030c80 tx=0x7f7ee4030cb0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 shutdown_connections 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7eec10aa60 0x7f7eec1a6c50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7ed40b28b0 0x7f7ed40b4dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eec10a110 0x7f7eec19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 --2- 172.21.15.82:0/2166571751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eec108ff0 0x7f7eec19f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 >> 172.21.15.82:0/2166571751 conn(0x7f7eec078220 msgr2=0x7f7eec10d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 shutdown_connections 2024-06-06T02:44:05.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:05.680+0000 7f7ef2400640 1 -- 172.21.15.82:0/2166571751 wait complete. 2024-06-06T02:44:06.741 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:06 smithi082 ceph-mon[31579]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 73 MiB/s wr, 10.27k op/s 2024-06-06T02:44:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:06 smithi103 ceph-mon[36349]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 73 MiB/s wr, 10.27k op/s 2024-06-06T02:44:07.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:06 smithi184 ceph-mon[36922]: pgmap v635: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 73 MiB/s wr, 10.27k op/s 2024-06-06T02:44:09.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:08 smithi103 ceph-mon[36349]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 MiB/s wr, 10.17k op/s 2024-06-06T02:44:09.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:08 smithi082 ceph-mon[31579]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 MiB/s wr, 10.17k op/s 2024-06-06T02:44:09.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:08 smithi184 ceph-mon[36922]: pgmap v636: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 73 MiB/s wr, 10.17k op/s 2024-06-06T02:44:11.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:10 smithi103 ceph-mon[36349]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 80 MiB/s wr, 10.92k op/s 2024-06-06T02:44:11.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:10 smithi082 ceph-mon[31579]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 80 MiB/s wr, 10.92k op/s 2024-06-06T02:44:11.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:10 smithi184 ceph-mon[36922]: pgmap v637: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 80 MiB/s wr, 10.92k op/s 2024-06-06T02:44:13.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:12 smithi103 ceph-mon[36349]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 73 MiB/s wr, 9.96k op/s 2024-06-06T02:44:13.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:12 smithi082 ceph-mon[31579]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 73 MiB/s wr, 9.96k op/s 2024-06-06T02:44:13.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:12 smithi184 ceph-mon[36922]: pgmap v638: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 73 MiB/s wr, 9.96k op/s 2024-06-06T02:44:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:14 smithi103 ceph-mon[36349]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 MiB/s wr, 10.28k op/s 2024-06-06T02:44:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:14 smithi082 ceph-mon[31579]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 MiB/s wr, 10.28k op/s 2024-06-06T02:44:15.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:14 smithi184 ceph-mon[36922]: pgmap v639: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 MiB/s wr, 10.28k op/s 2024-06-06T02:44:16.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:15 smithi103 ceph-mon[36349]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 MiB/s wr, 9.64k op/s 2024-06-06T02:44:16.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:15 smithi082 ceph-mon[31579]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 MiB/s wr, 9.64k op/s 2024-06-06T02:44:16.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:15 smithi184 ceph-mon[36922]: pgmap v640: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 69 MiB/s wr, 9.64k op/s 2024-06-06T02:44:17.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:44:18.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:18 smithi082 ceph-mon[31579]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 68 MiB/s wr, 9.62k op/s 2024-06-06T02:44:18.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:18 smithi184 ceph-mon[36922]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 68 MiB/s wr, 9.62k op/s 2024-06-06T02:44:18.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:18 smithi103 ceph-mon[36349]: pgmap v641: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 68 MiB/s wr, 9.62k op/s 2024-06-06T02:44:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.026+0000 7f7e19e00640 1 -- 172.21.15.82:0/274845218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410c4c0 msgr2=0x7f7e1410c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.026+0000 7f7e19e00640 1 --2- 172.21.15.82:0/274845218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410c4c0 0x7f7e1410c8d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009900 tx=0x7f7e0002a410 comp rx=0 tx=0).stop 2024-06-06T02:44:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.027+0000 7f7e19e00640 1 -- 172.21.15.82:0/274845218 shutdown_connections 2024-06-06T02:44:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.027+0000 7f7e19e00640 1 --2- 172.21.15.82:0/274845218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410ce10 0x7f7e14113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.027+0000 7f7e19e00640 1 --2- 172.21.15.82:0/274845218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410c4c0 0x7f7e1410c8d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.027+0000 7f7e19e00640 1 --2- 172.21.15.82:0/274845218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e1410b3a0 0x7f7e1410b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.027+0000 7f7e19e00640 1 -- 172.21.15.82:0/274845218 >> 172.21.15.82:0/274845218 conn(0x7f7e14071dc0 msgr2=0x7f7e14074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.028+0000 7f7e19e00640 1 -- 172.21.15.82:0/274845218 shutdown_connections 2024-06-06T02:44:19.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.028+0000 7f7e19e00640 1 -- 172.21.15.82:0/274845218 wait complete. 2024-06-06T02:44:19.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.030+0000 7f7e19e00640 1 Processor -- start 2024-06-06T02:44:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.030+0000 7f7e19e00640 1 -- start start 2024-06-06T02:44:19.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e1410b3a0 0x7f7e14110f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410c4c0 0x7f7e14111450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14116f20 con 0x7f7e1410c4c0 2024-06-06T02:44:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14116da0 con 0x7f7e1410ce10 2024-06-06T02:44:19.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.031+0000 7f7e19e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7e141170a0 con 0x7f7e1410b3a0 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.032+0000 7f7e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.032+0000 7f7e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56868/0 (socket says 172.21.15.82:56868) 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.032+0000 7f7e12000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410c4c0 0x7f7e14111450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.032+0000 7f7e13400640 1 -- 172.21.15.82:0/1455532119 learned_addr learned my addr 172.21.15.82:0/1455532119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 -- 172.21.15.82:0/1455532119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e1410b3a0 msgr2=0x7f7e14110f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e1410b3a0 0x7f7e14110f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 -- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410c4c0 msgr2=0x7f7e14111450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410c4c0 0x7f7e14111450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 -- 172.21.15.82:0/1455532119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1410e280 con 0x7f7e1410ce10 2024-06-06T02:44:19.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.033+0000 7f7e13400640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cad0 tx=0x7f7e0c00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.034+0000 7f7e18a00640 1 -- 172.21.15.82:0/1455532119 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00ae20 con 0x7f7e1410ce10 2024-06-06T02:44:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.035+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1410e570 con 0x7f7e1410ce10 2024-06-06T02:44:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.035+0000 7f7e18a00640 1 -- 172.21.15.82:0/1455532119 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c005020 con 0x7f7e1410ce10 2024-06-06T02:44:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.035+0000 7f7e18a00640 1 -- 172.21.15.82:0/1455532119 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00ae20 con 0x7f7e1410ce10 2024-06-06T02:44:19.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.035+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e141b04b0 con 0x7f7e1410ce10 2024-06-06T02:44:19.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.040+0000 7f7e20d88740 1 Processor -- start 2024-06-06T02:44:19.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.042+0000 7f7e18a00640 1 -- 172.21.15.82:0/1455532119 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7e0c00f450 con 0x7f7e1410ce10 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 -- start start 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55935a346480 con 0x55935a02f1b0 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55935a335a20 con 0x55935a0062f0 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.043+0000 7f7e20d88740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55935a339a60 con 0x55935a00e4d0 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56876/0 (socket says 172.21.15.82:56876) 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 -- 172.21.15.82:0/3902942994 learned_addr learned my addr 172.21.15.82:0/3902942994 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:19.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12000640 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 -- 172.21.15.82:0/3902942994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 msgr2=0x55935a3db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 -- 172.21.15.82:0/3902942994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 msgr2=0x55935a3d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.044+0000 7f7e12a00640 1 -- 172.21.15.82:0/3902942994 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55935a3328d0 con 0x55935a0062f0 2024-06-06T02:44:19.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.045+0000 7f7e18a00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 0x7f7df80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ba50 tx=0x7f7e0400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5279b9d4a148d01f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7e18a00640 1 -- 172.21.15.82:0/1455532119 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7e0c0e1e70 con 0x7f7e1410ce10 2024-06-06T02:44:19.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7e12000640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 0x7f7df80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7dffe00640 1 -- 172.21.15.82:0/3902942994 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04016070 con 0x55935a0062f0 2024-06-06T02:44:19.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7dffe00640 1 -- 172.21.15.82:0/3902942994 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e040054d0 con 0x55935a0062f0 2024-06-06T02:44:19.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.046+0000 7f7dffe00640 1 -- 172.21.15.82:0/3902942994 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04010460 con 0x55935a0062f0 2024-06-06T02:44:19.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 -- 172.21.15.82:0/3902942994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 msgr2=0x55935a3d4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400ba50 tx=0x7f7e0400bf10 comp rx=0 tx=0).stop 2024-06-06T02:44:19.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 -- 172.21.15.82:0/3902942994 shutdown_connections 2024-06-06T02:44:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3d4240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3902942994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.048+0000 7f7e20d88740 1 -- 172.21.15.82:0/3902942994 >> 172.21.15.82:0/3902942994 conn(0x55935a023300 msgr2=0x55935a3cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.050+0000 7f7e12000640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 0x7f7df80b4fe0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002aa00 tx=0x7f7e00031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.050+0000 7f7e20d88740 1 -- 172.21.15.82:0/3902942994 shutdown_connections 2024-06-06T02:44:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.050+0000 7f7e20d88740 1 -- 172.21.15.82:0/3902942994 wait complete. 2024-06-06T02:44:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.052+0000 7f7e20d88740 1 -- start start 2024-06-06T02:44:19.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.052+0000 7f7e20d88740 1 Processor -- start 2024-06-06T02:44:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a0062f0 0x55935a3dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55935a270ab0 con 0x55935a0062f0 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55935a2d3630 con 0x55935a02f1b0 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55935a3dbad0 con 0x55935a00e4d0 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e20d88740 10 client.0 _ll_register_callbacks cb 0x55935a2d9610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56890/0 (socket says 172.21.15.82:56890) 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e13400640 1 -- 172.21.15.82:0/198124355 learned_addr learned my addr 172.21.15.82:0/198124355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.054+0000 7f7e13400640 1 -- 172.21.15.82:0/198124355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 msgr2=0x55935a3dd980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7e13400640 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7e13400640 1 -- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a0062f0 msgr2=0x55935a3dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7e13400640 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a0062f0 0x55935a3dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7e13400640 1 -- 172.21.15.82:0/198124355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55935a300170 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7e13400640 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0a9150 tx=0x7f7e0c0a9510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97944e56b4f7912d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.055+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c091070 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.056+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7e0c0a3b70 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.056+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e040054d0 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.056+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e0c0a3d70 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.057+0000 7f7e20d88740 10 client.25985 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.057+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55935a09a790 con 0x55935a02f1b0 2024-06-06T02:44:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.057+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e040054d0 con 0x55935a02f1b0 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.059+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f7e0c0a8120 con 0x55935a02f1b0 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.059+0000 7f7e20d88740 10 client.25985 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.059+0000 7f7e20d88740 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.059+0000 7f7e20d88740 20 client.25985 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.059+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fedd80 0x55935a3eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.060+0000 7f7e20d88740 4 client.25985 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.060+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55935a3483d0 con 0x559359fedd80 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.060+0000 7f7e12a00640 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fedd80 0x55935a3eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.061+0000 7f7e12a00640 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fedd80 0x55935a3eadb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b1c9995d8e9053 server_cookie=99038d7a0c6ebbc3 in_seq=0 out_seq=0 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.061+0000 7f7dfcc00640 10 client.25985 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.063+0000 7f7dfcc00640 1 -- 172.21.15.82:0/198124355 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55935a3483d0 con 0x559359fedd80 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.063+0000 7f7dfcc00640 10 client.25985 handle_command_reply: tid=0 2024-06-06T02:44:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.063+0000 7f7e20d88740 1 client.25985 shutdown 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 msgr2=0x55935a3e4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0a9150 tx=0x7f7e0c0a9510 comp rx=0 tx=0).stop 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 shutdown_connections 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a02f1b0 0x55935a3e4870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3dd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fedd80 0x55935a3eadb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 --2- 172.21.15.82:0/198124355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a0062f0 0x55935a3dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7dfcc00640 0 client.25985 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.065+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 >> 172.21.15.82:0/198124355 conn(0x55935a023300 msgr2=0x55935a3d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.066+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 shutdown_connections 2024-06-06T02:44:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.066+0000 7f7e20d88740 1 -- 172.21.15.82:0/198124355 wait complete. 2024-06-06T02:44:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.067+0000 7f7e20d88740 20 client.25985 trim_cache size 0 max 16384 2024-06-06T02:44:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.169+0000 7f7e20d88740 1 Processor -- start 2024-06-06T02:44:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.173+0000 7f7e20d88740 1 -- start start 2024-06-06T02:44:19.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7df4010d80 con 0x55935a02f1b0 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7df400e650 con 0x55935a0062f0 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e20d88740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7df400c480 con 0x55935a00e4d0 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e12a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:56902/0 (socket says 172.21.15.82:56902) 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e12a00640 1 -- 172.21.15.82:0/3303699412 learned_addr learned my addr 172.21.15.82:0/3303699412 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:19.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.177+0000 7f7e13400640 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.178+0000 7f7e12a00640 1 -- 172.21.15.82:0/3303699412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 msgr2=0x55935a3e4800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:44:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.178+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3e4800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.178+0000 7f7e12a00640 1 -- 172.21.15.82:0/3303699412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 msgr2=0x55935a3d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.178+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.178+0000 7f7e12a00640 1 -- 172.21.15.82:0/3303699412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55935a113620 con 0x55935a0062f0 2024-06-06T02:44:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.182+0000 7f7e12a00640 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55935a3d4db0 tx=0x7f7e0400dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9bff05989a35ec server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.182+0000 7f7dff400640 1 -- 172.21.15.82:0/3303699412 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04016040 con 0x55935a0062f0 2024-06-06T02:44:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.182+0000 7f7dff400640 1 -- 172.21.15.82:0/3303699412 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e04005850 con 0x55935a0062f0 2024-06-06T02:44:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.182+0000 7f7dff400640 1 -- 172.21.15.82:0/3303699412 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040044a0 con 0x55935a0062f0 2024-06-06T02:44:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.184+0000 7f7e20d88740 1 -- 172.21.15.82:0/3303699412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 msgr2=0x55935a3cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.184+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55935a3d4db0 tx=0x7f7e0400dbb0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.187+0000 7f7e20d88740 1 -- 172.21.15.82:0/3303699412 shutdown_connections 2024-06-06T02:44:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.187+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a02f1b0 0x55935a3d0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.187+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a00e4d0 0x55935a3e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.187+0000 7f7e20d88740 1 --2- 172.21.15.82:0/3303699412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3cf730 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.187+0000 7f7e20d88740 1 -- 172.21.15.82:0/3303699412 >> 172.21.15.82:0/3303699412 conn(0x55935a023300 msgr2=0x55935a3cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.192+0000 7f7e20d88740 1 -- 172.21.15.82:0/3303699412 shutdown_connections 2024-06-06T02:44:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.192+0000 7f7e20d88740 1 -- 172.21.15.82:0/3303699412 wait complete. 2024-06-06T02:44:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.192+0000 7f7e20d88740 1 -- start start 2024-06-06T02:44:19.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.193+0000 7f7e20d88740 1 Processor -- start 2024-06-06T02:44:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3e1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 0x55935a3e1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7df400cb10 con 0x55935a00e4d0 2024-06-06T02:44:19.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7df400df80 con 0x55935a0062f0 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f7df400d1e0 con 0x55935a02f1b0 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.197+0000 7f7e20d88740 10 client.0 _ll_register_callbacks cb 0x7f7e0c0a9b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.198+0000 7f7e12000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 0x55935a3e1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.198+0000 7f7e13400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.200+0000 7f7e13400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44602/0 (socket says 172.21.15.82:44602) 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.200+0000 7f7e13400640 1 -- 172.21.15.82:0/800981035 learned_addr learned my addr 172.21.15.82:0/800981035 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.201+0000 7f7e12a00640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3e1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.202+0000 7f7e12a00640 1 -- 172.21.15.82:0/800981035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 msgr2=0x55935a3e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.202+0000 7f7e12a00640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.202+0000 7f7e12a00640 1 -- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 msgr2=0x55935a3e1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.202+0000 7f7e12a00640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 0x55935a3e1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.202+0000 7f7e12a00640 1 -- 172.21.15.82:0/800981035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55935a3e33f0 con 0x55935a0062f0 2024-06-06T02:44:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.203+0000 7f7e12a00640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3e1990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55935a3d47a0 tx=0x7f7e0400de80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8eeb912ddf0050 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.203+0000 7f7e12000640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 0x55935a3e1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:44:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.203+0000 7f7e13400640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:44:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.203+0000 7f7dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.204+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04031060 con 0x55935a0062f0 2024-06-06T02:44:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.204+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f7e040035f0 con 0x55935a0062f0 2024-06-06T02:44:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.204+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e04005850 con 0x55935a0062f0 2024-06-06T02:44:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.206+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7e04016070 con 0x55935a0062f0 2024-06-06T02:44:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.206+0000 7f7e20d88740 10 client.25991 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.207+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55935a3e4680 con 0x55935a0062f0 2024-06-06T02:44:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.210+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e04005850 con 0x55935a0062f0 2024-06-06T02:44:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.210+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f7e04023850 con 0x55935a0062f0 2024-06-06T02:44:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 10 client.25991 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 10 client.25991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 20 client.25991 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fc31c0 0x55935a4555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 4 client.25991 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:44:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.214+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55935a343e70 con 0x559359fc31c0 2024-06-06T02:44:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.215+0000 7f7e12000640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fc31c0 0x55935a4555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.218+0000 7f7dfcc00640 10 client.25991 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.218+0000 7f7e12000640 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fc31c0 0x55935a4555a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68bfc2a4e80a6663 server_cookie=7f67fd310aa14fbe in_seq=0 out_seq=0 2024-06-06T02:44:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:44:19.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.898+0000 7f7dfcc00640 1 -- 172.21.15.82:0/800981035 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55935a343e70 con 0x559359fc31c0 2024-06-06T02:44:19.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.898+0000 7f7dfcc00640 10 client.25991 handle_command_reply: tid=0 2024-06-06T02:44:19.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 client.25991 shutdown 2024-06-06T02:44:19.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 msgr2=0x55935a3e1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3e1990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55935a3d47a0 tx=0x7f7e0400de80 comp rx=0 tx=0).stop 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 shutdown_connections 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55935a02f1b0 0x55935a3e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559359fc31c0 0x55935a4555a0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55935a00e4d0 0x55935a3e1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 --2- 172.21.15.82:0/800981035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55935a0062f0 0x55935a3e1990 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55935a3d47a0 tx=0x7f7e0400de80 comp rx=0 tx=0).stop 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 >> 172.21.15.82:0/800981035 conn(0x55935a023300 msgr2=0x55935a3d6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.899+0000 7f7dfcc00640 0 client.25991 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.900+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 shutdown_connections 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.900+0000 7f7e20d88740 1 -- 172.21.15.82:0/800981035 wait complete. 2024-06-06T02:44:19.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.900+0000 7f7e20d88740 20 client.25991 trim_cache size 0 max 16384 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.901+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 msgr2=0x7f7df80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.901+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 0x7f7df80b4fe0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e0002aa00 tx=0x7f7e00031400 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.901+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 msgr2=0x7f7e1410da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.901+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00cad0 tx=0x7f7e0c00cf90 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 shutdown_connections 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e1410ce10 0x7f7e1410da60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e1410c4c0 0x7f7e14111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f7df80b2ad0 0x7f7df80b4fe0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 --2- 172.21.15.82:0/1455532119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e1410b3a0 0x7f7e14110f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 >> 172.21.15.82:0/1455532119 conn(0x7f7e14071dc0 msgr2=0x7f7e1406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 shutdown_connections 2024-06-06T02:44:19.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:19.902+0000 7f7e19e00640 1 -- 172.21.15.82:0/1455532119 wait complete. 2024-06-06T02:44:20.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:20 smithi184 ceph-mon[36922]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 MiB/s wr, 10.81k op/s 2024-06-06T02:44:20.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:20 smithi103 ceph-mon[36349]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 MiB/s wr, 10.81k op/s 2024-06-06T02:44:20.625 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:20 smithi082 ceph-mon[31579]: pgmap v642: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 77 MiB/s wr, 10.81k op/s 2024-06-06T02:44:22.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:22 smithi103 ceph-mon[36349]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 70 MiB/s wr, 9.99k op/s 2024-06-06T02:44:22.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:22 smithi082 ceph-mon[31579]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 70 MiB/s wr, 9.99k op/s 2024-06-06T02:44:22.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:22 smithi184 ceph-mon[36922]: pgmap v643: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 70 MiB/s wr, 9.99k op/s 2024-06-06T02:44:24.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:24 smithi103 ceph-mon[36349]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 MiB/s wr, 9.77k op/s 2024-06-06T02:44:24.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:24 smithi082 ceph-mon[31579]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 MiB/s wr, 9.77k op/s 2024-06-06T02:44:24.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:24 smithi184 ceph-mon[36922]: pgmap v644: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 68 MiB/s wr, 9.77k op/s 2024-06-06T02:44:26.488 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:26 smithi082 ceph-mon[31579]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 66 MiB/s wr, 9.38k op/s 2024-06-06T02:44:26.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:26 smithi103 ceph-mon[36349]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 66 MiB/s wr, 9.38k op/s 2024-06-06T02:44:26.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:26 smithi184 ceph-mon[36922]: pgmap v645: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 66 MiB/s wr, 9.38k op/s 2024-06-06T02:44:28.450 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:28 smithi184 ceph-mon[36922]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 67 MiB/s wr, 9.37k op/s 2024-06-06T02:44:28.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:28 smithi082 ceph-mon[31579]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 67 MiB/s wr, 9.37k op/s 2024-06-06T02:44:28.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:28 smithi103 ceph-mon[36349]: pgmap v646: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 67 MiB/s wr, 9.37k op/s 2024-06-06T02:44:30.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:30 smithi103 ceph-mon[36349]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 MiB/s wr, 9.55k op/s 2024-06-06T02:44:30.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:30 smithi082 ceph-mon[31579]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 MiB/s wr, 9.55k op/s 2024-06-06T02:44:30.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:30 smithi184 ceph-mon[36922]: pgmap v647: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 70 MiB/s wr, 9.55k op/s 2024-06-06T02:44:32.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:32 smithi103 ceph-mon[36349]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 66 MiB/s wr, 9.15k op/s 2024-06-06T02:44:32.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:32 smithi082 ceph-mon[31579]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 66 MiB/s wr, 9.15k op/s 2024-06-06T02:44:32.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:32 smithi184 ceph-mon[36922]: pgmap v648: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 66 MiB/s wr, 9.15k op/s 2024-06-06T02:44:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.283+0000 7f3a05800640 1 -- 172.21.15.82:0/2778518530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00109940 msgr2=0x7f3a00109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.283+0000 7f3a05800640 1 --2- 172.21.15.82:0/2778518530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00109940 0x7f3a00109d50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ca0 tx=0x7f39f802a960 comp rx=0 tx=0).stop 2024-06-06T02:44:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 -- 172.21.15.82:0/2778518530 shutdown_connections 2024-06-06T02:44:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 --2- 172.21.15.82:0/2778518530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00111330 0x7f3a00113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 --2- 172.21.15.82:0/2778518530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0010a290 0x7f3a0010a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 --2- 172.21.15.82:0/2778518530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a00109940 0x7f3a00109d50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 -- 172.21.15.82:0/2778518530 >> 172.21.15.82:0/2778518530 conn(0x7f3a0006fbe0 msgr2=0x7f3a00072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 -- 172.21.15.82:0/2778518530 shutdown_connections 2024-06-06T02:44:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.286+0000 7f3a05800640 1 -- 172.21.15.82:0/2778518530 wait complete. 2024-06-06T02:44:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.288+0000 7f3a05800640 1 Processor -- start 2024-06-06T02:44:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.289+0000 7f3a05800640 1 -- start start 2024-06-06T02:44:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.290+0000 7f3a05800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00109940 0x7f3a001a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.290+0000 7f3a05800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.290+0000 7f3a05800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 0x7f3a001ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.291 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.291+0000 7f39fe000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.291+0000 7f39fea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00109940 0x7f3a001a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.291+0000 7f39fe000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53588/0 (socket says 172.21.15.82:53588) 2024-06-06T02:44:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.292+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00116f90 con 0x7f3a0010a290 2024-06-06T02:44:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.292+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00116e10 con 0x7f3a00111330 2024-06-06T02:44:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.292+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3a00117110 con 0x7f3a00109940 2024-06-06T02:44:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.292+0000 7f39ff400640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 0x7f3a001ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.293+0000 7f39ff400640 1 -- 172.21.15.82:0/1564054688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00109940 msgr2=0x7f3a001a3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.293+0000 7f39ff400640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00109940 0x7f3a001a3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.293+0000 7f39ff400640 1 -- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 msgr2=0x7f3a001a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.293+0000 7f39ff400640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.293+0000 7f39ff400640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a001ab870 con 0x7f3a00111330 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.291+0000 7f39fe000640 1 -- 172.21.15.82:0/1564054688 learned_addr learned my addr 172.21.15.82:0/1564054688 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.295+0000 7f39ff400640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 0x7f3a001ab280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009f50 tx=0x7f39e800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.295+0000 7f39fe000640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-06T02:44:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.296+0000 7f39f7400640 1 -- 172.21.15.82:0/1564054688 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8026020 con 0x7f3a00111330 2024-06-06T02:44:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.296+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0019c6d0 con 0x7f3a00111330 2024-06-06T02:44:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.297+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0019ccf0 con 0x7f3a00111330 2024-06-06T02:44:33.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.297+0000 7f39f7400640 1 -- 172.21.15.82:0/1564054688 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e8022af0 con 0x7f3a00111330 2024-06-06T02:44:33.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.297+0000 7f39f7400640 1 -- 172.21.15.82:0/1564054688 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8021b40 con 0x7f3a00111330 2024-06-06T02:44:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.307+0000 7f39f7400640 1 -- 172.21.15.82:0/1564054688 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f39e8029020 con 0x7f3a00111330 2024-06-06T02:44:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.310+0000 7f39f7400640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 0x7f39e40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.310+0000 7f39f7400640 1 -- 172.21.15.82:0/1564054688 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39e80f3700 con 0x7f3a00111330 2024-06-06T02:44:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.311+0000 7f3a0c7df740 1 Processor -- start 2024-06-06T02:44:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.311+0000 7f3a0c7df740 1 -- start start 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.311+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df46bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df09e2f0 0x55a1df46c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1df3de480 con 0x55a1df0c71b0 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a1df3cda20 con 0x55a1df0a64d0 2024-06-06T02:44:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a1df3d1a60 con 0x55a1df09e2f0 2024-06-06T02:44:33.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.312+0000 7f39fea00640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 0x7f39e40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.313+0000 7f39fea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df46bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.313+0000 7f39ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.313+0000 7f39ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45490/0 (socket says 172.21.15.82:45490) 2024-06-06T02:44:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.313+0000 7f39ff400640 1 -- 172.21.15.82:0/3860230667 learned_addr learned my addr 172.21.15.82:0/3860230667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:33.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.313+0000 7f39fe000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df09e2f0 0x55a1df46c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.314+0000 7f39ff400640 1 -- 172.21.15.82:0/3860230667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df09e2f0 msgr2=0x55a1df46c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.314+0000 7f39ff400640 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df09e2f0 0x55a1df46c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.315+0000 7f39ff400640 1 -- 172.21.15.82:0/3860230667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 msgr2=0x55a1df46bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.315+0000 7f39ff400640 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df46bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.315+0000 7f39ff400640 1 -- 172.21.15.82:0/3860230667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1df3ca8d0 con 0x55a1df0a64d0 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.316+0000 7f39fea00640 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df46bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:44:33.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.316+0000 7f39ff400640 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006fd0 tx=0x7f39e8021390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20220fcab7edd44b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.316+0000 7f39efe00640 1 -- 172.21.15.82:0/3860230667 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e80bb3e0 con 0x55a1df0a64d0 2024-06-06T02:44:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.316+0000 7f39efe00640 1 -- 172.21.15.82:0/3860230667 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e80d2030 con 0x55a1df0a64d0 2024-06-06T02:44:33.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.317+0000 7f39efe00640 1 -- 172.21.15.82:0/3860230667 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8022ca0 con 0x55a1df0a64d0 2024-06-06T02:44:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.318+0000 7f3a0c7df740 1 -- 172.21.15.82:0/3860230667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 msgr2=0x55a1df473100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.318+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39e8006fd0 tx=0x7f39e8021390 comp rx=0 tx=0).stop 2024-06-06T02:44:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.318+0000 7f3a0c7df740 1 -- 172.21.15.82:0/3860230667 shutdown_connections 2024-06-06T02:44:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.318+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0a64d0 0x55a1df473100 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.319+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df09e2f0 0x55a1df46c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.319+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/3860230667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df46bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.319+0000 7f3a0c7df740 1 -- 172.21.15.82:0/3860230667 >> 172.21.15.82:0/3860230667 conn(0x55a1df0bb300 msgr2=0x55a1df4676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.320+0000 7f3a0c7df740 1 -- 172.21.15.82:0/3860230667 shutdown_connections 2024-06-06T02:44:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.320+0000 7f3a0c7df740 1 -- 172.21.15.82:0/3860230667 wait complete. 2024-06-06T02:44:33.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.320+0000 7f39fea00640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 0x7f39e40b4e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006010 tx=0x7f39f802a960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.320+0000 7f3a0c7df740 1 -- start start 2024-06-06T02:44:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.322+0000 7f3a0c7df740 1 Processor -- start 2024-06-06T02:44:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.323+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df475420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.323+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df475960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f39fea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df475420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df47c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f39fea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df475420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45496/0 (socket says 172.21.15.82:45496) 2024-06-06T02:44:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f39fea00640 1 -- 172.21.15.82:0/1805691103 learned_addr learned my addr 172.21.15.82:0/1805691103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a1df308ab0 con 0x55a1df0c71b0 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a1df36b630 con 0x55a1df09e2f0 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a1df473ad0 con 0x55a1df0a64d0 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f39fe000640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df475960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.324+0000 7f39ff400640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df47c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f3a0c7df740 10 client.0 _ll_register_callbacks cb 0x55a1df371610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 -- 172.21.15.82:0/1805691103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 msgr2=0x55a1df475420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df475420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 -- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 msgr2=0x55a1df47c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df47c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1df398170 con 0x55a1df0a64d0 2024-06-06T02:44:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39fe000640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df475960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39f0005fd0 tx=0x7f39f0010eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b7f78d62db11c8d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f39ecc00640 10 client.26020 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:44:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.325+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39e80d2030 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.326+0000 7f39ecc00640 1 -- 172.21.15.82:0/1805691103 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f001d060 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.326+0000 7f39ecc00640 1 -- 172.21.15.82:0/1805691103 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39f0015070 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.327+0000 7f39ecc00640 1 -- 172.21.15.82:0/1805691103 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39f001d060 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.327+0000 7f3a0c7df740 10 client.26020 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.327+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a1df132790 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f39ecc00640 1 -- 172.21.15.82:0/1805691103 <== mon.1 v2:172.21.15.184:3300/0 4 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f39f000eb70 con 0x55a1df0a64d0 2024-06-06T02:44:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 10 client.26020 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 10 client.26020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 20 client.26020 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df085d80 0x55a1df482a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 4 client.26020 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.328+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1df3e03d0 con 0x55a1df085d80 2024-06-06T02:44:33.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.329+0000 7f39fea00640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df085d80 0x55a1df482a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.330+0000 7f39fea00640 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df085d80 0x55a1df482a10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f72d8c4fc213282 server_cookie=53a37b60556567c9 in_seq=0 out_seq=0 2024-06-06T02:44:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.330+0000 7f39ecc00640 10 client.26020 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.332+0000 7f39ecc00640 1 -- 172.21.15.82:0/1805691103 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a1df3e03d0 con 0x55a1df085d80 2024-06-06T02:44:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.332+0000 7f39ecc00640 10 client.26020 handle_command_reply: tid=0 2024-06-06T02:44:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.332+0000 7f3a0c7df740 1 client.26020 shutdown 2024-06-06T02:44:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 msgr2=0x55a1df475960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df475960 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39f0005fd0 tx=0x7f39f0010eb0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 shutdown_connections 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df085d80 0x55a1df482a10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0c71b0 0x55a1df47c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f39ecc00640 0 client.26020 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df475960 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/1805691103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df475420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.333+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 >> 172.21.15.82:0/1805691103 conn(0x55a1df0bb300 msgr2=0x55a1df4685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.334+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 shutdown_connections 2024-06-06T02:44:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.334+0000 7f3a0c7df740 1 -- 172.21.15.82:0/1805691103 wait complete. 2024-06-06T02:44:33.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.334+0000 7f3a0c7df740 20 client.26020 trim_cache size 0 max 16384 2024-06-06T02:44:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.377+0000 7f3a0c7df740 1 Processor -- start 2024-06-06T02:44:33.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 -- start start 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df467690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0a64d0 0x55a1df47c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 0x55a1df46edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc010de0 con 0x55a1df0a64d0 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc00e6b0 con 0x55a1df09e2f0 2024-06-06T02:44:33.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.379+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc00c4a0 con 0x55a1df0c71b0 2024-06-06T02:44:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.380+0000 7f39ff400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 0x55a1df46edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.380+0000 7f39ff400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 0x55a1df46edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44122/0 (socket says 172.21.15.82:44122) 2024-06-06T02:44:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.380+0000 7f39fea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df467690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.380+0000 7f39ff400640 1 -- 172.21.15.82:0/286448546 learned_addr learned my addr 172.21.15.82:0/286448546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:33.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fea00640 1 -- 172.21.15.82:0/286448546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 msgr2=0x55a1df46edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fea00640 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 0x55a1df46edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fea00640 1 -- 172.21.15.82:0/286448546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0a64d0 msgr2=0x55a1df47c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fe000640 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0a64d0 0x55a1df47c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fea00640 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0a64d0 0x55a1df47c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.381+0000 7f39fea00640 1 -- 172.21.15.82:0/286448546 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1df1ab620 con 0x55a1df09e2f0 2024-06-06T02:44:33.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.382+0000 7f39fea00640 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df467690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39f802f9a0 tx=0x7f39f803d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd675620e0f53c22 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.384+0000 7f39ef400640 1 -- 172.21.15.82:0/286448546 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8041040 con 0x55a1df09e2f0 2024-06-06T02:44:33.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.384+0000 7f39ef400640 1 -- 172.21.15.82:0/286448546 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f804da60 con 0x55a1df09e2f0 2024-06-06T02:44:33.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.385+0000 7f3a0c7df740 1 -- 172.21.15.82:0/286448546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 msgr2=0x55a1df467690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.385+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df467690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39f802f9a0 tx=0x7f39f803d040 comp rx=0 tx=0).stop 2024-06-06T02:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 -- 172.21.15.82:0/286448546 shutdown_connections 2024-06-06T02:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0c71b0 0x55a1df46edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df0a64d0 0x55a1df47c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/286448546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df09e2f0 0x55a1df467690 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 -- 172.21.15.82:0/286448546 >> 172.21.15.82:0/286448546 conn(0x55a1df0bb300 msgr2=0x55a1df466f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:33.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 -- 172.21.15.82:0/286448546 shutdown_connections 2024-06-06T02:44:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.386+0000 7f3a0c7df740 1 -- 172.21.15.82:0/286448546 wait complete. 2024-06-06T02:44:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.387+0000 7f3a0c7df740 1 -- start start 2024-06-06T02:44:33.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.388+0000 7f3a0c7df740 1 Processor -- start 2024-06-06T02:44:33.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.390+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 0x55a1df479f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.391+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df47a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f3a0c7df740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc00cb70 con 0x55a1df09e2f0 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc00dfe0 con 0x55a1df0c71b0 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f3a0c7df740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc00d240 con 0x55a1df0a64d0 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f3a0c7df740 10 client.0 _ll_register_callbacks cb 0x7f39f000bd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f39ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f39ff400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:45508/0 (socket says 172.21.15.82:45508) 2024-06-06T02:44:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f39ff400640 1 -- 172.21.15.82:0/2827268002 learned_addr learned my addr 172.21.15.82:0/2827268002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f39ff400640 1 -- 172.21.15.82:0/2827268002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 msgr2=0x55a1df47a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:44:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.392+0000 7f39ff400640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df47a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.393+0000 7f39ff400640 1 -- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 msgr2=0x55a1df479f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:44:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.394+0000 7f39fea00640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 0x55a1df479f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.395+0000 7f39ff400640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 0x55a1df479f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.395+0000 7f39ff400640 1 -- 172.21.15.82:0/2827268002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1df47b970 con 0x55a1df0c71b0 2024-06-06T02:44:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.395+0000 7f39fea00640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 0x55a1df479f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:44:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.395+0000 7f39ff400640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f39e80092c0 tx=0x7f39e80d5370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d545b0d44fa5462e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:33.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.395+0000 7f39ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.397+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8099070 con 0x55a1df0c71b0 2024-06-06T02:44:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.397+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f39e8022640 con 0x55a1df0c71b0 2024-06-06T02:44:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.398+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39f804da60 con 0x55a1df0c71b0 2024-06-06T02:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.398+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39e80bf090 con 0x55a1df0c71b0 2024-06-06T02:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.398+0000 7f3a0c7df740 10 client.26006 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.398+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1df4eb1c0 con 0x55a1df0c71b0 2024-06-06T02:44:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.399+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f804da60 con 0x55a1df0c71b0 2024-06-06T02:44:33.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.399+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f39e8021070 con 0x55a1df0c71b0 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 10 client.26006 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 10 client.26006 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 20 client.26006 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df05b1c0 0x55a1df4ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 4 client.26006 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:44:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.400+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1df3dbe70 con 0x55a1df05b1c0 2024-06-06T02:44:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.401+0000 7f39fea00640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df05b1c0 0x55a1df4ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.405+0000 7f39fea00640 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df05b1c0 0x55a1df4ed5b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56eec3884f14beba server_cookie=9f15e5afb0dfe39a in_seq=0 out_seq=0 2024-06-06T02:44:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.405+0000 7f39ecc00640 10 client.26006 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.993+0000 7f39ecc00640 1 -- 172.21.15.82:0/2827268002 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1df3dbe70 con 0x55a1df05b1c0 2024-06-06T02:44:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.994+0000 7f39ecc00640 10 client.26006 handle_command_reply: tid=0 2024-06-06T02:44:33.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.994+0000 7f3a0c7df740 1 client.26006 shutdown 2024-06-06T02:44:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.996+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 msgr2=0x55a1df47b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:33.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.996+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f39e80092c0 tx=0x7f39e80d5370 comp rx=0 tx=0).stop 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.996+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 shutdown_connections 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a1df0c71b0 0x55a1df47b380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a1df0a64d0 0x55a1df47a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a1df05b1c0 0x55a1df4ed5b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 --2- 172.21.15.82:0/2827268002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a1df09e2f0 0x55a1df479f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 >> 172.21.15.82:0/2827268002 conn(0x55a1df0bb300 msgr2=0x55a1df468ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f39ecc00640 0 client.26006 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 shutdown_connections 2024-06-06T02:44:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.997+0000 7f3a0c7df740 1 -- 172.21.15.82:0/2827268002 wait complete. 2024-06-06T02:44:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:33.998+0000 7f3a0c7df740 20 client.26006 trim_cache size 0 max 16384 2024-06-06T02:44:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:44:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:44:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:44:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 msgr2=0x7f39e40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 0x7f39e40b4e40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39f8006010 tx=0x7f39f802a960 comp rx=0 tx=0).stop 2024-06-06T02:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 msgr2=0x7f3a001ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 0x7f3a001ab280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009f50 tx=0x7f39e800b870 comp rx=0 tx=0).stop 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 shutdown_connections 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a00111330 0x7f3a001ab280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a0010a290 0x7f3a001a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f39e40b2930 0x7f39e40b4e40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 --2- 172.21.15.82:0/1564054688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3a00109940 0x7f3a001a3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.000+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 >> 172.21.15.82:0/1564054688 conn(0x7f3a0006fbe0 msgr2=0x7f3a0010b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.001+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 shutdown_connections 2024-06-06T02:44:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:34.001+0000 7f3a05800640 1 -- 172.21.15.82:0/1564054688 wait complete. 2024-06-06T02:44:34.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:34 smithi103 ceph-mon[36349]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 MiB/s wr, 8.62k op/s 2024-06-06T02:44:34.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:34 smithi082 ceph-mon[31579]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 MiB/s wr, 8.62k op/s 2024-06-06T02:44:34.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:34 smithi184 ceph-mon[36922]: pgmap v649: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 63 MiB/s wr, 8.62k op/s 2024-06-06T02:44:36.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:36 smithi103 ceph-mon[36349]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 MiB/s wr, 9.14k op/s 2024-06-06T02:44:36.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:36 smithi082 ceph-mon[31579]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 MiB/s wr, 9.14k op/s 2024-06-06T02:44:36.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:36 smithi184 ceph-mon[36922]: pgmap v650: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 67 MiB/s wr, 9.14k op/s 2024-06-06T02:44:38.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:38 smithi103 ceph-mon[36349]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 71 MiB/s wr, 9.64k op/s 2024-06-06T02:44:38.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:38 smithi082 ceph-mon[31579]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 71 MiB/s wr, 9.64k op/s 2024-06-06T02:44:38.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:38 smithi184 ceph-mon[36922]: pgmap v651: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 71 MiB/s wr, 9.64k op/s 2024-06-06T02:44:40.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:40 smithi103 ceph-mon[36349]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 73 MiB/s wr, 10.11k op/s 2024-06-06T02:44:40.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:40 smithi082 ceph-mon[31579]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 73 MiB/s wr, 10.11k op/s 2024-06-06T02:44:40.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:40 smithi184 ceph-mon[36922]: pgmap v652: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 73 MiB/s wr, 10.11k op/s 2024-06-06T02:44:42.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:42 smithi103 ceph-mon[36349]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 MiB/s wr, 10.89k op/s 2024-06-06T02:44:42.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:42 smithi082 ceph-mon[31579]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 MiB/s wr, 10.89k op/s 2024-06-06T02:44:42.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:42 smithi184 ceph-mon[36922]: pgmap v653: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 MiB/s wr, 10.89k op/s 2024-06-06T02:44:44.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:44 smithi103 ceph-mon[36349]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 MiB/s wr, 10.01k op/s 2024-06-06T02:44:44.624 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:44 smithi082 ceph-mon[31579]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 MiB/s wr, 10.01k op/s 2024-06-06T02:44:44.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:44 smithi184 ceph-mon[36922]: pgmap v654: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 MiB/s wr, 10.01k op/s 2024-06-06T02:44:46.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:46 smithi082 ceph-mon[31579]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 73 MiB/s wr, 10.20k op/s 2024-06-06T02:44:46.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:46 smithi103 ceph-mon[36349]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 73 MiB/s wr, 10.20k op/s 2024-06-06T02:44:46.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:46 smithi184 ceph-mon[36922]: pgmap v655: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 73 MiB/s wr, 10.20k op/s 2024-06-06T02:44:48.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:48 smithi103 ceph-mon[36349]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 80 MiB/s wr, 11.35k op/s 2024-06-06T02:44:48.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:48 smithi082 ceph-mon[31579]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 80 MiB/s wr, 11.35k op/s 2024-06-06T02:44:48.647 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:48 smithi184 ceph-mon[36922]: pgmap v656: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 80 MiB/s wr, 11.35k op/s 2024-06-06T02:44:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 -- 172.21.15.82:0/3980800769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0381029d0 msgr2=0x7fb038102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 --2- 172.21.15.82:0/3980800769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0381029d0 0x7fb038102de0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb028009900 tx=0x7fb02802a400 comp rx=0 tx=0).stop 2024-06-06T02:44:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 -- 172.21.15.82:0/3980800769 shutdown_connections 2024-06-06T02:44:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 --2- 172.21.15.82:0/3980800769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb038104440 0x7fb03810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 --2- 172.21.15.82:0/3980800769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 0x7fb038103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 --2- 172.21.15.82:0/3980800769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0381029d0 0x7fb038102de0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 -- 172.21.15.82:0/3980800769 >> 172.21.15.82:0/3980800769 conn(0x7fb0380fe1d0 msgr2=0x7fb038100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 -- 172.21.15.82:0/3980800769 shutdown_connections 2024-06-06T02:44:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.318+0000 7fb037e00640 1 -- 172.21.15.82:0/3980800769 wait complete. 2024-06-06T02:44:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 Processor -- start 2024-06-06T02:44:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 -- start start 2024-06-06T02:44:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 0x7fb038199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb038104440 0x7fb0381a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb03810e4c0 con 0x7fb038103af0 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb03810e340 con 0x7fb038104440 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb037e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb03810e640 con 0x7fb0381029d0 2024-06-06T02:44:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.320+0000 7fb036a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52134/0 (socket says 172.21.15.82:52134) 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 -- 172.21.15.82:0/2835540012 learned_addr learned my addr 172.21.15.82:0/2835540012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 0x7fb038199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb037400640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb038104440 0x7fb0381a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 -- 172.21.15.82:0/2835540012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb038104440 msgr2=0x7fb0381a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb038104440 0x7fb0381a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 -- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 msgr2=0x7fb038199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 0x7fb038199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 -- 172.21.15.82:0/2835540012 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0381a0c40 con 0x7fb0381029d0 2024-06-06T02:44:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb036a00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb028006010 tx=0x7fb028004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb02f400640 1 -- 172.21.15.82:0/2835540012 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02803f030 con 0x7fb0381029d0 2024-06-06T02:44:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.321+0000 7fb02f400640 1 -- 172.21.15.82:0/2835540012 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb028003aa0 con 0x7fb0381029d0 2024-06-06T02:44:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.322+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0381a0ed0 con 0x7fb0381029d0 2024-06-06T02:44:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.322+0000 7fb02f400640 1 -- 172.21.15.82:0/2835540012 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028035070 con 0x7fb0381029d0 2024-06-06T02:44:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.322+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0381a12e0 con 0x7fb0381029d0 2024-06-06T02:44:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 Processor -- start 2024-06-06T02:44:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 -- start start 2024-06-06T02:44:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb02f400640 1 -- 172.21.15.82:0/2835540012 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb028042030 con 0x7fb0381029d0 2024-06-06T02:44:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff31f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff39340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55893fea4480 con 0x55893fb8d1b0 2024-06-06T02:44:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55893fe93a20 con 0x55893fb642f0 2024-06-06T02:44:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.326+0000 7fb0445e2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55893fe97a60 con 0x55893fb6c4d0 2024-06-06T02:44:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb037400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff31f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60152/0 (socket says 172.21.15.82:60152) 2024-06-06T02:44:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 -- 172.21.15.82:0/2456368181 learned_addr learned my addr 172.21.15.82:0/2456368181 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb037400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff31f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43680/0 (socket says 172.21.15.82:43680) 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036000640 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff39340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 -- 172.21.15.82:0/2456368181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 msgr2=0x55893ff39340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff39340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 -- 172.21.15.82:0/2456368181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 msgr2=0x55893ff31f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff31f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 -- 172.21.15.82:0/2456368181 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893fe908d0 con 0x55893fb642f0 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.327+0000 7fb036a00640 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb028108c20 tx=0x7fb028108d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba00803a05d1d9e server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.328+0000 7fb023400640 1 -- 172.21.15.82:0/2456368181 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028111070 con 0x55893fb642f0 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.328+0000 7fb023400640 1 -- 172.21.15.82:0/2456368181 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0281040d0 con 0x55893fb642f0 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.328+0000 7fb023400640 1 -- 172.21.15.82:0/2456368181 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02810d660 con 0x55893fb642f0 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 -- 172.21.15.82:0/2456368181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 msgr2=0x55893ff32480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb028108c20 tx=0x7fb028108d10 comp rx=0 tx=0).stop 2024-06-06T02:44:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 -- 172.21.15.82:0/2456368181 shutdown_connections 2024-06-06T02:44:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff39340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff32480 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2456368181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff31f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 -- 172.21.15.82:0/2456368181 >> 172.21.15.82:0/2456368181 conn(0x55893fb81300 msgr2=0x55893ff2d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb02f400640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 0x7fb01c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb037400640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 0x7fb01c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 -- 172.21.15.82:0/2456368181 shutdown_connections 2024-06-06T02:44:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb02f400640 1 -- 172.21.15.82:0/2835540012 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb028102890 con 0x7fb0381029d0 2024-06-06T02:44:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.329+0000 7fb0445e2740 1 -- 172.21.15.82:0/2456368181 wait complete. 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 -- start start 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb037400640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 0x7fb01c0b4cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb030005fd0 tx=0x7fb030009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 Processor -- start 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff3b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55893fdceab0 con 0x55893fb8d1b0 2024-06-06T02:44:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55893fe31630 con 0x55893fb642f0 2024-06-06T02:44:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55893ff39ad0 con 0x55893fb6c4d0 2024-06-06T02:44:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60156/0 (socket says 172.21.15.82:60156) 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 -- 172.21.15.82:0/2840953486 learned_addr learned my addr 172.21.15.82:0/2840953486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb037400640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036000640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff3b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.330+0000 7fb0445e2740 10 client.0 _ll_register_callbacks cb 0x55893fe37610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 -- 172.21.15.82:0/2840953486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 msgr2=0x55893ff3b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff3b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 -- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 msgr2=0x55893ff427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 -- 172.21.15.82:0/2840953486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893fe5e170 con 0x55893fb642f0 2024-06-06T02:44:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb036a00640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb028108bf0 tx=0x7fb028003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e506b90c24a65e87 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb017e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028049070 con 0x55893fb642f0 2024-06-06T02:44:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb028105e00 con 0x55893fb642f0 2024-06-06T02:44:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.331+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0281040d0 con 0x55893fb642f0 2024-06-06T02:44:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.332+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb028111030 con 0x55893fb642f0 2024-06-06T02:44:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.332+0000 7fb0445e2740 10 client.26018 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.332+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55893fbf8790 con 0x55893fb642f0 2024-06-06T02:44:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0281040d0 con 0x55893fb642f0 2024-06-06T02:44:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fb028003c50 con 0x55893fb642f0 2024-06-06T02:44:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 10 client.26018 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 10 client.26018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 20 client.26018 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb4bd80 0x55893ff48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 4 client.26018 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55893fea63d0 con 0x55893fb4bd80 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.333+0000 7fb036000640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb4bd80 0x55893ff48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.334+0000 7fb036000640 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb4bd80 0x55893ff48660 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc6fe3a4f9fc962 server_cookie=b6983904ad304fb in_seq=0 out_seq=0 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.334+0000 7fb017e00640 10 client.26018 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb017e00640 1 -- 172.21.15.82:0/2840953486 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55893fea63d0 con 0x55893fb4bd80 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb017e00640 10 client.26018 handle_command_reply: tid=0 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb0445e2740 1 client.26018 shutdown 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 msgr2=0x55893ff3b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb028108bf0 tx=0x7fb028003f90 comp rx=0 tx=0).stop 2024-06-06T02:44:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.335+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 shutdown_connections 2024-06-06T02:44:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb4bd80 0x55893ff48660 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff3b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 --2- 172.21.15.82:0/2840953486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff3b370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 >> 172.21.15.82:0/2840953486 conn(0x55893fb81300 msgr2=0x55893ff2e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb017e00640 0 client.26018 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 shutdown_connections 2024-06-06T02:44:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 1 -- 172.21.15.82:0/2840953486 wait complete. 2024-06-06T02:44:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.336+0000 7fb0445e2740 20 client.26018 trim_cache size 0 max 16384 2024-06-06T02:44:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.356+0000 7fb0445e2740 1 Processor -- start 2024-06-06T02:44:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.356+0000 7fb0445e2740 1 -- start start 2024-06-06T02:44:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff2edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff42710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381aa710 con 0x55893fb8d1b0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a7fe0 con 0x55893fb642f0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb0445e2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a5e10 con 0x55893fb6c4d0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb037400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb037400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43690/0 (socket says 172.21.15.82:43690) 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.357+0000 7fb037400640 1 -- 172.21.15.82:0/3856994420 learned_addr learned my addr 172.21.15.82:0/3856994420 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb036a00640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff2edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb036000640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff42710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb037400640 1 -- 172.21.15.82:0/3856994420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 msgr2=0x55893ff42710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb037400640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff42710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb037400640 1 -- 172.21.15.82:0/3856994420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 msgr2=0x55893ff2edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb037400640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff2edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb037400640 1 -- 172.21.15.82:0/3856994420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893fc71620 con 0x55893fb8d1b0 2024-06-06T02:44:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb036000640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff42710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:44:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.358+0000 7fb036a00640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff2edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:44:49.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.359+0000 7fb037400640 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb030023e40 tx=0x7fb030016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb41271c780eba server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.365+0000 7fb022a00640 1 -- 172.21.15.82:0/3856994420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030034070 con 0x55893fb8d1b0 2024-06-06T02:44:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.365+0000 7fb022a00640 1 -- 172.21.15.82:0/3856994420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb03002faa0 con 0x55893fb8d1b0 2024-06-06T02:44:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.365+0000 7fb022a00640 1 -- 172.21.15.82:0/3856994420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03002e980 con 0x55893fb8d1b0 2024-06-06T02:44:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.366+0000 7fb0445e2740 1 -- 172.21.15.82:0/3856994420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 msgr2=0x55893ff34fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.366+0000 7fb0445e2740 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb030023e40 tx=0x7fb030016000 comp rx=0 tx=0).stop 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 -- 172.21.15.82:0/3856994420 shutdown_connections 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb8d1b0 0x55893ff34fc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb6c4d0 0x55893ff42710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 --2- 172.21.15.82:0/3856994420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff2edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 -- 172.21.15.82:0/3856994420 >> 172.21.15.82:0/3856994420 conn(0x55893fb81300 msgr2=0x55893ff2e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 -- 172.21.15.82:0/3856994420 shutdown_connections 2024-06-06T02:44:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.367+0000 7fb0445e2740 1 -- 172.21.15.82:0/3856994420 wait complete. 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.368+0000 7fb0445e2740 1 -- start start 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.368+0000 7fb0445e2740 1 Processor -- start 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.368+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.368+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb6c4d0 0x55893ff3f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.368+0000 7fb0445e2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb8d1b0 0x55893ff3f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb0445e2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a64a0 con 0x55893fb6c4d0 2024-06-06T02:44:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb0445e2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a7910 con 0x55893fb642f0 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb0445e2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb0381a6b70 con 0x55893fb8d1b0 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb0445e2740 10 client.0 _ll_register_callbacks cb 0x7fb028108a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb036a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:60172/0 (socket says 172.21.15.82:60172) 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.369+0000 7fb036a00640 1 -- 172.21.15.82:0/1560110313 learned_addr learned my addr 172.21.15.82:0/1560110313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.370+0000 7fb036a00640 1 -- 172.21.15.82:0/1560110313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb8d1b0 msgr2=0x55893ff3f980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.370+0000 7fb036a00640 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb8d1b0 0x55893ff3f980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.370+0000 7fb036a00640 1 -- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb6c4d0 msgr2=0x55893ff3f2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:44:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.371+0000 7fb036a00640 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb6c4d0 0x55893ff3f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.371+0000 7fb036a00640 1 -- 172.21.15.82:0/1560110313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55893ffaee80 con 0x55893fb642f0 2024-06-06T02:44:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.373+0000 7fb036a00640 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0280c9eb0 tx=0x7fb028009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d96838e72d4258ea server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.373+0000 7fb017e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.373+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028049070 con 0x55893fb642f0 2024-06-06T02:44:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.373+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb0280c6510 con 0x55893fb642f0 2024-06-06T02:44:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.374+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb03002faa0 con 0x55893fb642f0 2024-06-06T02:44:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.374+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb0280c5de0 con 0x55893fb642f0 2024-06-06T02:44:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.374+0000 7fb0445e2740 10 client.26024 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.374+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55893ffaee80 con 0x55893fb642f0 2024-06-06T02:44:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.375+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb03002faa0 con 0x55893fb642f0 2024-06-06T02:44:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fb028108300 con 0x55893fb642f0 2024-06-06T02:44:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 10 client.26024 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 10 client.26024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 20 client.26024 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb211c0 0x55893ffc3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 4 client.26024 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:44:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.376+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55893fea1e70 con 0x55893fb211c0 2024-06-06T02:44:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.377+0000 7fb036000640 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb211c0 0x55893ffc3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.379+0000 7fb036000640 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb211c0 0x55893ffc3800 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4768baf93c299a7 server_cookie=d5c09e655abf2596 in_seq=0 out_seq=0 2024-06-06T02:44:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.379+0000 7fb017e00640 10 client.26024 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.519+0000 7fb017e00640 1 -- 172.21.15.82:0/1560110313 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55893fea1e70 con 0x55893fb211c0 2024-06-06T02:44:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.519+0000 7fb017e00640 10 client.26024 handle_command_reply: tid=0 2024-06-06T02:44:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.519+0000 7fb0445e2740 1 client.26024 shutdown 2024-06-06T02:44:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 msgr2=0x55893ff42710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb0280c9eb0 tx=0x7fb028009260 comp rx=0 tx=0).stop 2024-06-06T02:44:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 shutdown_connections 2024-06-06T02:44:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55893fb8d1b0 0x55893ff3f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55893fb211c0 0x55893ffc3800 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55893fb6c4d0 0x55893ff3f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 --2- 172.21.15.82:0/1560110313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55893fb642f0 0x55893ff42710 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb017e00640 0 client.26024 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.523+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 >> 172.21.15.82:0/1560110313 conn(0x55893fb81300 msgr2=0x55893ff2be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.524+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 shutdown_connections 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.524+0000 7fb0445e2740 1 -- 172.21.15.82:0/1560110313 wait complete. 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.524+0000 7fb0445e2740 20 client.26024 trim_cache size 0 max 16384 2024-06-06T02:44:49.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 msgr2=0x7fb01c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 0x7fb01c0b4cf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb030005fd0 tx=0x7fb030009600 comp rx=0 tx=0).stop 2024-06-06T02:44:49.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 msgr2=0x7fb038199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb028006010 tx=0x7fb028004270 comp rx=0 tx=0).stop 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 shutdown_connections 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb038104440 0x7fb0381a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb038103af0 0x7fb038199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb01c0b27e0 0x7fb01c0b4cf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 --2- 172.21.15.82:0/2835540012 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0381029d0 0x7fb038199100 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 >> 172.21.15.82:0/2835540012 conn(0x7fb0380fe1d0 msgr2=0x7fb038106df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.526+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 shutdown_connections 2024-06-06T02:44:49.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:44:49.527+0000 7fb037e00640 1 -- 172.21.15.82:0/2835540012 wait complete. 2024-06-06T02:44:49.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:49 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:44:49.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:49 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:44:49.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:49 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:44:50.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:50 smithi103 ceph-mon[36349]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 78 MiB/s wr, 11.29k op/s 2024-06-06T02:44:50.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:50 smithi082 ceph-mon[31579]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 78 MiB/s wr, 11.29k op/s 2024-06-06T02:44:50.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:50 smithi184 ceph-mon[36922]: pgmap v657: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 78 MiB/s wr, 11.29k op/s 2024-06-06T02:44:52.525 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:52 smithi082 ceph-mon[31579]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 MiB/s wr, 11.31k op/s 2024-06-06T02:44:52.525 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:44:52.525 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:44:52.526 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:44:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:52 smithi103 ceph-mon[36349]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 MiB/s wr, 11.31k op/s 2024-06-06T02:44:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:44:52.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:44:52.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:44:52.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:52 smithi184 ceph-mon[36922]: pgmap v658: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 MiB/s wr, 11.31k op/s 2024-06-06T02:44:52.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:44:52.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:44:52.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.570+0000 7fbaf3200640 1 -- 172.21.15.82:0/3059070253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf4104f20 msgr2=0x7fbaf4105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.570+0000 7fbaf3200640 1 --2- 172.21.15.82:0/3059070253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf4104f20 0x7fbaf4105330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009930 tx=0x7fbae402a440 comp rx=0 tx=0).stop 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 -- 172.21.15.82:0/3059070253 shutdown_connections 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 --2- 172.21.15.82:0/3059070253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf410a1a0 0x7fbaf4111b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 --2- 172.21.15.82:0/3059070253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf4109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 --2- 172.21.15.82:0/3059070253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf4104f20 0x7fbaf4105330 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009930 tx=0x7fbae402a440 comp rx=0 tx=0).stop 2024-06-06T02:44:54.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 -- 172.21.15.82:0/3059070253 >> 172.21.15.82:0/3059070253 conn(0x7fbaf4100a00 msgr2=0x7fbaf4102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 -- 172.21.15.82:0/3059070253 shutdown_connections 2024-06-06T02:44:54.572 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:54 smithi082 ceph-mon[31579]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 MiB/s wr, 10.25k op/s 2024-06-06T02:44:54.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.571+0000 7fbaf3200640 1 -- 172.21.15.82:0/3059070253 wait complete. 2024-06-06T02:44:54.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.573+0000 7fbaf3200640 1 Processor -- start 2024-06-06T02:44:54.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.573+0000 7fbaf3200640 1 -- start start 2024-06-06T02:44:54.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 0x7fbaf41a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 0x7fbaf419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4114f00 con 0x7fbaf419b850 2024-06-06T02:44:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4114d80 con 0x7fbaf410a1a0 2024-06-06T02:44:54.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf3200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4115080 con 0x7fbaf4109850 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57356/0 (socket says 172.21.15.82:57356) 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.574+0000 7fbaf1e00640 1 -- 172.21.15.82:0/97971767 learned_addr learned my addr 172.21.15.82:0/97971767 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.575+0000 7fbaf2800640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 0x7fbaf419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.575+0000 7fbaf2800640 1 -- 172.21.15.82:0/97971767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 msgr2=0x7fbaf41a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf1400640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 0x7fbaf41a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf2800640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf2800640 1 -- 172.21.15.82:0/97971767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 msgr2=0x7fbaf41a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf2800640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 0x7fbaf41a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf2800640 1 -- 172.21.15.82:0/97971767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf419c3a0 con 0x7fbaf419b850 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf1400640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 0x7fbaf41a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.576+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:44:54.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.577+0000 7fbaf2800640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 0x7fbaf419bc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c710 tx=0x7fbae000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.578+0000 7fbaeaa00640 1 -- 172.21.15.82:0/97971767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0004220 con 0x7fbaf419b850 2024-06-06T02:44:54.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.578+0000 7fbaeaa00640 1 -- 172.21.15.82:0/97971767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae000ce20 con 0x7fbaf419b850 2024-06-06T02:44:54.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.578+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf419c690 con 0x7fbaf419b850 2024-06-06T02:44:54.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.578+0000 7fbaeaa00640 1 -- 172.21.15.82:0/97971767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae0003d50 con 0x7fbaf419b850 2024-06-06T02:44:54.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.578+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf4076ee0 con 0x7fbaf419b850 2024-06-06T02:44:54.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.587+0000 7fbaeaa00640 1 -- 172.21.15.82:0/97971767 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fbae00079b0 con 0x7fbaf419b850 2024-06-06T02:44:54.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.590+0000 7fbaeaa00640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 0x7fbad80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.590+0000 7fbaeaa00640 1 -- 172.21.15.82:0/97971767 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbae00e1a80 con 0x7fbaf419b850 2024-06-06T02:44:54.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.592+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 0x7fbad80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.594+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 0x7fbad80b4e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006010 tx=0x7fbae4040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.601+0000 7fbaff7a2740 1 Processor -- start 2024-06-06T02:44:54.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.602+0000 7fbaff7a2740 1 -- start start 2024-06-06T02:44:54.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.603+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d85f01ae00 con 0x55d85ecd71b0 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d85f00a3a0 con 0x55d85ed00070 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d85f00e3e0 con 0x55d85ecdf390 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.604+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33894/0 (socket says 172.21.15.82:33894) 2024-06-06T02:44:54.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50976/0 (socket says 172.21.15.82:50976) 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf1e00640 1 -- 172.21.15.82:0/3501592112 learned_addr learned my addr 172.21.15.82:0/3501592112 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf1e00640 1 -- 172.21.15.82:0/3501592112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 msgr2=0x55d85f0a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.605+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf1e00640 1 -- 172.21.15.82:0/3501592112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 msgr2=0x55d85f0a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf1e00640 1 -- 172.21.15.82:0/3501592112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85ed6b650 con 0x55d85ed00070 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf1400640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:44:54.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbae4033000 tx=0x7fbae4044000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb19703019cdffc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.606+0000 7fbadf400640 1 -- 172.21.15.82:0/3501592112 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035050 con 0x55d85ed00070 2024-06-06T02:44:54.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.607+0000 7fbadf400640 1 -- 172.21.15.82:0/3501592112 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae4003ca0 con 0x55d85ed00070 2024-06-06T02:44:54.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.607+0000 7fbadf400640 1 -- 172.21.15.82:0/3501592112 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4049ca0 con 0x55d85ed00070 2024-06-06T02:44:54.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.608+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3501592112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 msgr2=0x55d85f0a6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.608+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbae4033000 tx=0x7fbae4044000 comp rx=0 tx=0).stop 2024-06-06T02:44:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.609+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3501592112 shutdown_connections 2024-06-06T02:44:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.609+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.609+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecd71b0 0x55d85f0a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.609+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3501592112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0a6540 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.609+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3501592112 >> 172.21.15.82:0/3501592112 conn(0x55d85ecf4460 msgr2=0x55d85f0a2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.610+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3501592112 shutdown_connections 2024-06-06T02:44:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.610+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3501592112 wait complete. 2024-06-06T02:44:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.611+0000 7fbaff7a2740 1 -- start start 2024-06-06T02:44:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.611+0000 7fbaff7a2740 1 Processor -- start 2024-06-06T02:44:54.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.614+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.614+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.615+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.615+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.615+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57372/0 (socket says 172.21.15.82:57372) 2024-06-06T02:44:54.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.615+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33910/0 (socket says 172.21.15.82:33910) 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.615+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0b6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.616+0000 7fbaf1e00640 1 -- 172.21.15.82:0/3686222068 learned_addr learned my addr 172.21.15.82:0/3686222068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.616+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.616+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d85ee6e700 con 0x55d85ecdf390 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.616+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d85efa7700 con 0x55d85ed00070 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.616+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d85f0b3650 con 0x55d85ecd71b0 2024-06-06T02:44:54.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf2800640 1 -- 172.21.15.82:0/3686222068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 msgr2=0x55d85f0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.618 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:54 smithi103 ceph-mon[36349]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 MiB/s wr, 10.25k op/s 2024-06-06T02:44:54.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf2800640 1 -- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 msgr2=0x55d85f0b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf1400640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaf2800640 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85efd2fb0 con 0x55d85ed00070 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.617+0000 7fbaff7a2740 10 client.0 _ll_register_callbacks cb 0x55d85efb3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.618+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae4003ca0 con 0x55d85ed00070 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.618+0000 7fbad3e00640 10 client.26033 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.618+0000 7fbaf2800640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0b6950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005fd0 tx=0x7fbae0003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e1cc7ad4e8c619 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.618+0000 7fbad3e00640 1 -- 172.21.15.82:0/3686222068 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00c3060 con 0x55d85ed00070 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.619+0000 7fbad3e00640 1 -- 172.21.15.82:0/3686222068 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbae00a5650 con 0x55d85ed00070 2024-06-06T02:44:54.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.619+0000 7fbad3e00640 1 -- 172.21.15.82:0/3686222068 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbae00c3060 con 0x55d85ed00070 2024-06-06T02:44:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.620+0000 7fbaff7a2740 10 client.26033 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.620+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d85f0bf5a0 con 0x55d85ed00070 2024-06-06T02:44:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.621+0000 7fbad3e00640 1 -- 172.21.15.82:0/3686222068 <== mon.2 v2:172.21.15.103:3300/0 4 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fbae0020060 con 0x55d85ed00070 2024-06-06T02:44:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.621+0000 7fbaff7a2740 10 client.26033 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:54.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.621+0000 7fbaff7a2740 10 client.26033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.621+0000 7fbaff7a2740 20 client.26033 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.621+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ecbe9f0 0x55d85f0c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.622+0000 7fbaff7a2740 4 client.26033 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:44:54.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.622+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d85f01cd50 con 0x55d85ecbe9f0 2024-06-06T02:44:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.622+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ecbe9f0 0x55d85f0c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.623+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ecbe9f0 0x55d85f0c2aa0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afdf968840ac1e8d server_cookie=6a5a871c1150176e in_seq=0 out_seq=0 2024-06-06T02:44:54.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.623+0000 7fbad3e00640 10 client.26033 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.626+0000 7fbad3e00640 1 -- 172.21.15.82:0/3686222068 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d85f01cd50 con 0x55d85ecbe9f0 2024-06-06T02:44:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.626+0000 7fbad3e00640 10 client.26033 handle_command_reply: tid=0 2024-06-06T02:44:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.626+0000 7fbaff7a2740 1 client.26033 shutdown 2024-06-06T02:44:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.627+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 msgr2=0x55d85f0b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.627+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0b6950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005fd0 tx=0x7fbae0003730 comp rx=0 tx=0).stop 2024-06-06T02:44:54.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 shutdown_connections 2024-06-06T02:44:54.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ed00070 0x55d85f0b6950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ecbe9f0 0x55d85f0c2aa0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ecdf390 0x55d85f0b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/3686222068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.628+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 >> 172.21.15.82:0/3686222068 conn(0x55d85ecf4460 msgr2=0x55d85f0a82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.629+0000 7fbad3e00640 0 client.26033 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.629+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 shutdown_connections 2024-06-06T02:44:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.629+0000 7fbaff7a2740 1 -- 172.21.15.82:0/3686222068 wait complete. 2024-06-06T02:44:54.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.630+0000 7fbaff7a2740 20 client.26033 trim_cache size 0 max 16384 2024-06-06T02:44:54.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:54 smithi184 ceph-mon[36922]: pgmap v659: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 71 MiB/s wr, 10.25k op/s 2024-06-06T02:44:54.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.671+0000 7fbaff7a2740 1 Processor -- start 2024-06-06T02:44:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 -- start start 2024-06-06T02:44:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecdf390 0x55d85f0b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41af420 con 0x55d85ed00070 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41accf0 con 0x55d85ecdf390 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.673+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41aab40 con 0x55d85ecd71b0 2024-06-06T02:44:54.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.674+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.674+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57386/0 (socket says 172.21.15.82:57386) 2024-06-06T02:44:54.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.674+0000 7fbaf1e00640 1 -- 172.21.15.82:0/2232313233 learned_addr learned my addr 172.21.15.82:0/2232313233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:54.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.674+0000 7fbaf2800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.676+0000 7fbaf2800640 1 -- 172.21.15.82:0/2232313233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 msgr2=0x55d85f0aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.676+0000 7fbaf2800640 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.676+0000 7fbaf2800640 1 -- 172.21.15.82:0/2232313233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecdf390 msgr2=0x55d85f0b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.676+0000 7fbaf2800640 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecdf390 0x55d85f0b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.676+0000 7fbaf2800640 1 -- 172.21.15.82:0/2232313233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d85ecbec20 con 0x55d85ed00070 2024-06-06T02:44:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.677+0000 7fbaf2800640 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f0c8260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbae0003ff0 tx=0x7fbae0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0b948366589a02 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.679+0000 7fbadea00640 1 -- 172.21.15.82:0/2232313233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae001d040 con 0x55d85ed00070 2024-06-06T02:44:54.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.679+0000 7fbadea00640 1 -- 172.21.15.82:0/2232313233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae4003ca0 con 0x55d85ed00070 2024-06-06T02:44:54.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.679+0000 7fbadea00640 1 -- 172.21.15.82:0/2232313233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae00a49d0 con 0x55d85ed00070 2024-06-06T02:44:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 -- 172.21.15.82:0/2232313233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 msgr2=0x55d85f0c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f0c8260 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbae0003ff0 tx=0x7fbae0019000 comp rx=0 tx=0).stop 2024-06-06T02:44:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 -- 172.21.15.82:0/2232313233 shutdown_connections 2024-06-06T02:44:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f0c8260 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecdf390 0x55d85f0b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/2232313233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecd71b0 0x55d85f0aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 -- 172.21.15.82:0/2232313233 >> 172.21.15.82:0/2232313233 conn(0x55d85ecf4460 msgr2=0x55d85f0aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.680+0000 7fbaff7a2740 1 -- 172.21.15.82:0/2232313233 shutdown_connections 2024-06-06T02:44:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.681+0000 7fbaff7a2740 1 -- 172.21.15.82:0/2232313233 wait complete. 2024-06-06T02:44:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.681+0000 7fbaff7a2740 1 -- start start 2024-06-06T02:44:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.682+0000 7fbaff7a2740 1 Processor -- start 2024-06-06T02:44:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaff7a2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f124270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaf1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:51018/0 (socket says 172.21.15.82:51018) 2024-06-06T02:44:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaf1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0b98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:57392/0 (socket says 172.21.15.82:57392) 2024-06-06T02:44:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaf1400640 1 -- 172.21.15.82:0/750637319 learned_addr learned my addr 172.21.15.82:0/750637319 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:44:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.685+0000 7fbaff7a2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41ab1b0 con 0x55d85ed00070 2024-06-06T02:44:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41ac620 con 0x55d85ecd71b0 2024-06-06T02:44:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf41ab880 con 0x55d85ecdf390 2024-06-06T02:44:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaff7a2740 10 client.0 _ll_register_callbacks cb 0x7fbae00a8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:44:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.686+0000 7fbaf2800640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f124270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 -- 172.21.15.82:0/750637319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 msgr2=0x55d85f0b98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0b98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 -- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 msgr2=0x55d85f124270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f124270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85f1247e0 con 0x55d85ecd71b0 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf2800640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f124270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.687+0000 7fbaf1e00640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbae4004010 tx=0x7fbae402a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ae96c4f9a0cc1a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.688+0000 7fbad3e00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.688+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4035030 con 0x55d85ecd71b0 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.688+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae4003ca0 con 0x55d85ecd71b0 2024-06-06T02:44:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.689+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbae4003a00 con 0x55d85ecd71b0 2024-06-06T02:44:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.689+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbae40498f0 con 0x55d85ecd71b0 2024-06-06T02:44:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.689+0000 7fbaff7a2740 10 client.26036 fetch_fsmap learned FSMap version 29 2024-06-06T02:44:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.689+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d85f12bb00 con 0x55d85ecd71b0 2024-06-06T02:44:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae4003ca0 con 0x55d85ecd71b0 2024-06-06T02:44:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fbae4052020 con 0x55d85ecd71b0 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 10 client.26036 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 10 client.26036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 20 client.26036 populate_metadata read hostname 'smithi082' 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ec93da0 0x55d85f12dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 4 client.26036 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.690+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d85f0187f0 con 0x55d85ec93da0 2024-06-06T02:44:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.691+0000 7fbaf1400640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ec93da0 0x55d85f12dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:44:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.692+0000 7fbaf1400640 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ec93da0 0x55d85f12dea0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a58eef4dffd30f8 server_cookie=10af093c6452f3c1 in_seq=0 out_seq=0 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbad3e00640 10 client.26036 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbad3e00640 1 -- 172.21.15.82:0/750637319 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x55d85f0187f0 con 0x55d85ec93da0 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbad3e00640 10 client.26036 handle_command_reply: tid=0 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 client.26036 shutdown 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 msgr2=0x55d85f0b9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbae4004010 tx=0x7fbae402a440 comp rx=0 tx=0).stop 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 shutdown_connections 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d85ec93da0 0x55d85f12dea0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d85ed00070 0x55d85f124270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d85ecdf390 0x55d85f0b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 --2- 172.21.15.82:0/750637319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d85ecd71b0 0x55d85f0b9390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbad3e00640 0 client.26036 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:44:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.694+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 >> 172.21.15.82:0/750637319 conn(0x55d85ecf4460 msgr2=0x55d85f0a6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.695+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 shutdown_connections 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.695+0000 7fbaff7a2740 1 -- 172.21.15.82:0/750637319 wait complete. 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.695+0000 7fbaff7a2740 20 client.26036 trim_cache size 0 max 16384 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (43 inodes in the stack)", 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-06-06T02:44:54.696 INFO:teuthology.orchestra.run.smithi082.stdout: "72912f9e-c74e-4d3e-8f13-163c4d2f6c40": { 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "72912f9e-c74e-4d3e-8f13-163c4d2f6c40", 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:44:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 msgr2=0x7fbad80b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 0x7fbad80b4e00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbae4006010 tx=0x7fbae4040040 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 msgr2=0x7fbaf419bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 0x7fbaf419bc60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbae000c710 tx=0x7fbae000cbd0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 shutdown_connections 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaf419b850 0x7fbaf419bc60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbaf410a1a0 0x7fbaf41a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbad80b28f0 0x7fbad80b4e00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 --2- 172.21.15.82:0/97971767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaf4109850 0x7fbaf41a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.696+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 >> 172.21.15.82:0/97971767 conn(0x7fbaf4100a00 msgr2=0x7fbaf4102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.697+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 shutdown_connections 2024-06-06T02:44:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:44:54.697+0000 7fbaf3200640 1 -- 172.21.15.82:0/97971767 wait complete. 2024-06-06T02:44:56.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:56 smithi082 ceph-mon[31579]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 76 MiB/s wr, 10.85k op/s 2024-06-06T02:44:56.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:56 smithi103 ceph-mon[36349]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 76 MiB/s wr, 10.85k op/s 2024-06-06T02:44:56.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:56 smithi184 ceph-mon[36922]: pgmap v660: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 76 MiB/s wr, 10.85k op/s 2024-06-06T02:44:58.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:44:58 smithi103 ceph-mon[36349]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 81 MiB/s wr, 11.55k op/s 2024-06-06T02:44:58.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:44:58 smithi082 ceph-mon[31579]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 81 MiB/s wr, 11.55k op/s 2024-06-06T02:44:58.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:44:58 smithi184 ceph-mon[36922]: pgmap v661: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 81 MiB/s wr, 11.55k op/s 2024-06-06T02:45:00.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:00 smithi103 ceph-mon[36349]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 MiB/s wr, 10.37k op/s 2024-06-06T02:45:00.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:00 smithi082 ceph-mon[31579]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 MiB/s wr, 10.37k op/s 2024-06-06T02:45:00.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:00 smithi184 ceph-mon[36922]: pgmap v662: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 MiB/s wr, 10.37k op/s 2024-06-06T02:45:01.015 INFO:tasks.cephfs.filesystem:scrub status for tag:72912f9e-c74e-4d3e-8f13-163c4d2f6c40 - {'path': '/', 'tag': '72912f9e-c74e-4d3e-8f13-163c4d2f6c40', 'options': 'recursive,force'} 2024-06-06T02:45:02.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:02 smithi103 ceph-mon[36349]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 74 MiB/s wr, 10.56k op/s 2024-06-06T02:45:02.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:02 smithi082 ceph-mon[31579]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 74 MiB/s wr, 10.56k op/s 2024-06-06T02:45:02.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:02 smithi184 ceph-mon[36922]: pgmap v663: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 74 MiB/s wr, 10.56k op/s 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.911+0000 7f4b0a600640 1 -- 172.21.15.82:0/2196336301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b04108790 msgr2=0x7f4b0410abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.911+0000 7f4b0a600640 1 --2- 172.21.15.82:0/2196336301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b04108790 0x7f4b0410abb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009ca0 tx=0x7f4afc02a8c0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 -- 172.21.15.82:0/2196336301 shutdown_connections 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 --2- 172.21.15.82:0/2196336301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b04108790 0x7f4b0410abb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 --2- 172.21.15.82:0/2196336301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 0x7f4b04108250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 --2- 172.21.15.82:0/2196336301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b041034d0 0x7f4b041058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 -- 172.21.15.82:0/2196336301 >> 172.21.15.82:0/2196336301 conn(0x7f4b040fd0c0 msgr2=0x7f4b040ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:02.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 -- 172.21.15.82:0/2196336301 shutdown_connections 2024-06-06T02:45:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.912+0000 7f4b0a600640 1 -- 172.21.15.82:0/2196336301 wait complete. 2024-06-06T02:45:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.914+0000 7f4b0a600640 1 Processor -- start 2024-06-06T02:45:02.914 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.915+0000 7f4b0a600640 1 -- start start 2024-06-06T02:45:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.916+0000 7f4b0a600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.916+0000 7f4b0a600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 0x7f4b0419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.916+0000 7f4b0a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b04108790 0x7f4b041a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.916+0000 7f4b09200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b09200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34408/0 (socket says 172.21.15.82:34408) 2024-06-06T02:45:02.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b09200640 1 -- 172.21.15.82:0/3838150220 learned_addr learned my addr 172.21.15.82:0/3838150220 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:02.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b09c00640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b04108790 0x7f4b041a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b04103320 con 0x7f4b04105e30 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4b041031a0 con 0x7f4b041034d0 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4b04110890 con 0x7f4b04108790 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b03e00640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 0x7f4b0419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.917+0000 7f4b09200640 1 -- 172.21.15.82:0/3838150220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b04108790 msgr2=0x7f4b041a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.918+0000 7f4b09200640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b04108790 0x7f4b041a2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.918+0000 7f4b09200640 1 -- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 msgr2=0x7f4b0419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.918+0000 7f4b09200640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 0x7f4b0419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.918+0000 7f4b09200640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b041a2db0 con 0x7f4b041034d0 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.918+0000 7f4b09200640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c970 tx=0x7f4af400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.919+0000 7f4b01600640 1 -- 172.21.15.82:0/3838150220 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004220 con 0x7f4b041034d0 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.919+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b041a30a0 con 0x7f4b041034d0 2024-06-06T02:45:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.919+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b041a35f0 con 0x7f4b041034d0 2024-06-06T02:45:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.920+0000 7f4b01600640 1 -- 172.21.15.82:0/3838150220 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af40043c0 con 0x7f4b041034d0 2024-06-06T02:45:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.920+0000 7f4b01600640 1 -- 172.21.15.82:0/3838150220 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004a00 con 0x7f4b041034d0 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.927+0000 7f4b12c15740 1 Processor -- start 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 -- start start 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bc0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bc0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f917b2a480 con 0x55f9178131b0 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f917b19a20 con 0x55f9177f24d0 2024-06-06T02:45:02.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.928+0000 7f4b12c15740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f917b1da60 con 0x55f9177ea2f0 2024-06-06T02:45:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34422/0 (socket says 172.21.15.82:34422) 2024-06-06T02:45:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 -- 172.21.15.82:0/2970851587 learned_addr learned my addr 172.21.15.82:0/2970851587 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b01600640 1 -- 172.21.15.82:0/3838150220 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4af4004ba0 con 0x7f4b041034d0 2024-06-06T02:45:02.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 -- 172.21.15.82:0/2970851587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 msgr2=0x55f917bc0c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bc0c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 -- 172.21.15.82:0/2970851587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 msgr2=0x55f917bc0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bc0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.929+0000 7f4b03e00640 1 -- 172.21.15.82:0/2970851587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f917b168d0 con 0x55f9177f24d0 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.930+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009b40 tx=0x7f4af8010370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84bf978a69efbf99 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.931+0000 7f4af2000640 1 -- 172.21.15.82:0/2970851587 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8010da0 con 0x55f9177f24d0 2024-06-06T02:45:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.931+0000 7f4af2000640 1 -- 172.21.15.82:0/2970851587 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af80054d0 con 0x55f9177f24d0 2024-06-06T02:45:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.931+0000 7f4af2000640 1 -- 172.21.15.82:0/2970851587 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8010da0 con 0x55f9177f24d0 2024-06-06T02:45:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.932+0000 7f4b12c15740 1 -- 172.21.15.82:0/2970851587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 msgr2=0x55f917bc7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.932+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009b40 tx=0x7f4af8010370 comp rx=0 tx=0).stop 2024-06-06T02:45:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 -- 172.21.15.82:0/2970851587 shutdown_connections 2024-06-06T02:45:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bc7b50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bc0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2970851587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bc0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 -- 172.21.15.82:0/2970851587 >> 172.21.15.82:0/2970851587 conn(0x55f917807300 msgr2=0x55f917bbc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 -- 172.21.15.82:0/2970851587 shutdown_connections 2024-06-06T02:45:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.933+0000 7f4b12c15740 1 -- 172.21.15.82:0/2970851587 wait complete. 2024-06-06T02:45:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.934+0000 7f4b12c15740 1 -- start start 2024-06-06T02:45:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.935+0000 7f4b01600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 0x7f4aec0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.935+0000 7f4b01600640 1 -- 172.21.15.82:0/3838150220 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4af40e1ea0 con 0x7f4b041034d0 2024-06-06T02:45:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.935+0000 7f4b12c15740 1 Processor -- start 2024-06-06T02:45:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b09c00640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 0x7f4aec0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bc9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.936 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bd13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f917a54ab0 con 0x55f9177ea2f0 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f917ab7630 con 0x55f9177f24d0 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55f917bc8520 con 0x55f9178131b0 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.937+0000 7f4b12c15740 10 client.0 _ll_register_callbacks cb 0x55f917abd610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:34426/0 (socket says 172.21.15.82:34426) 2024-06-06T02:45:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b03e00640 1 -- 172.21.15.82:0/2694406841 learned_addr learned my addr 172.21.15.82:0/2694406841 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:02.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b09200640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bc9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b09c00640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bd13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.938+0000 7f4b03e00640 1 -- 172.21.15.82:0/2694406841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 msgr2=0x55f917bd13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.939+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bd13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.939+0000 7f4b03e00640 1 -- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 msgr2=0x55f917bc9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.939+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bc9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.939+0000 7f4b03e00640 1 -- 172.21.15.82:0/2694406841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f917ae4170 con 0x55f9177f24d0 2024-06-06T02:45:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.940+0000 7f4b03e00640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4af8005010 tx=0x7f4af8005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c539045fafbb7ce5 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.940+0000 7f4ae6a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:45:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.940+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af802a060 con 0x55f9177f24d0 2024-06-06T02:45:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.940+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4af8012450 con 0x55f9177f24d0 2024-06-06T02:45:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.941+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af80054d0 con 0x55f9177f24d0 2024-06-06T02:45:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.941+0000 7f4b09c00640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 0x7f4aec0b4c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031b50 tx=0x7f4afc009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.942+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4af8009780 con 0x55f9177f24d0 2024-06-06T02:45:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.942+0000 7f4b12c15740 10 client.26048 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.942+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f91787e790 con 0x55f9177f24d0 2024-06-06T02:45:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.942+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4af80054d0 con 0x55f9177f24d0 2024-06-06T02:45:02.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f4af800f040 con 0x55f9177f24d0 2024-06-06T02:45:02.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 10 client.26048 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:02.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 10 client.26048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:02.944 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 20 client.26048 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177d1d80 0x55f917bd73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 4 client.26048 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:45:02.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.944+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f917b2c3d0 con 0x55f9177d1d80 2024-06-06T02:45:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.949+0000 7f4b09200640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177d1d80 0x55f917bd73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.950+0000 7f4b09200640 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177d1d80 0x55f917bd73b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eabaa8a95e6896c server_cookie=c5ca08630eb470fd in_seq=0 out_seq=0 2024-06-06T02:45:02.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.951+0000 7f4ae6a00640 10 client.26048 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.952+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2694406841 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f917b2c3d0 con 0x55f9177d1d80 2024-06-06T02:45:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.952+0000 7f4ae6a00640 10 client.26048 handle_command_reply: tid=0 2024-06-06T02:45:02.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.952+0000 7f4b12c15740 1 client.26048 shutdown 2024-06-06T02:45:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.952+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 msgr2=0x55f917bca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.952+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4af8005010 tx=0x7f4af8005040 comp rx=0 tx=0).stop 2024-06-06T02:45:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 shutdown_connections 2024-06-06T02:45:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bd13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bca4a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177d1d80 0x55f917bd73b0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2694406841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bc9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 >> 172.21.15.82:0/2694406841 conn(0x55f917807300 msgr2=0x55f917bbd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:02.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4ae6a00640 0 client.26048 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 shutdown_connections 2024-06-06T02:45:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 1 -- 172.21.15.82:0/2694406841 wait complete. 2024-06-06T02:45:02.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.953+0000 7f4b12c15740 20 client.26048 trim_cache size 0 max 16384 2024-06-06T02:45:02.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 Processor -- start 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 -- start start 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bbd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8010e50 con 0x55f9178131b0 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae800e720 con 0x55f9177f24d0 2024-06-06T02:45:02.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.986+0000 7f4b12c15740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae800c550 con 0x55f9177ea2f0 2024-06-06T02:45:02.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.987+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bbd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43810/0 (socket says 172.21.15.82:43810) 2024-06-06T02:45:02.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 -- 172.21.15.82:0/4094495661 learned_addr learned my addr 172.21.15.82:0/4094495661 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 -- 172.21.15.82:0/4094495661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 msgr2=0x55f917bbd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bbd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 -- 172.21.15.82:0/4094495661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 msgr2=0x55f917bd1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.988+0000 7f4b09c00640 1 -- 172.21.15.82:0/4094495661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9178f7620 con 0x55f9178131b0 2024-06-06T02:45:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.989+0000 7f4b09c00640 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031740 tx=0x7f4afc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d868ba20259fb6b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.990+0000 7f4af1600640 1 -- 172.21.15.82:0/4094495661 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc004230 con 0x55f9178131b0 2024-06-06T02:45:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.990+0000 7f4af1600640 1 -- 172.21.15.82:0/4094495661 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4afc02f660 con 0x55f9178131b0 2024-06-06T02:45:02.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.990+0000 7f4af1600640 1 -- 172.21.15.82:0/4094495661 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc030820 con 0x55f9178131b0 2024-06-06T02:45:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 -- 172.21.15.82:0/4094495661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 msgr2=0x55f917bbc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031740 tx=0x7f4afc0095c0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 -- 172.21.15.82:0/4094495661 shutdown_connections 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9178131b0 0x55f917bbc1d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 --2- 172.21.15.82:0/4094495661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9177ea2f0 0x55f917bbd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 -- 172.21.15.82:0/4094495661 >> 172.21.15.82:0/4094495661 conn(0x55f917807300 msgr2=0x55f917bb1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 -- 172.21.15.82:0/4094495661 shutdown_connections 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.991+0000 7f4b12c15740 1 -- 172.21.15.82:0/4094495661 wait complete. 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.992+0000 7f4b12c15740 1 -- start start 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.992+0000 7f4b12c15740 1 Processor -- start 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bd0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae800cbe0 con 0x55f9177ea2f0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae800e050 con 0x55f9177f24d0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae800d2b0 con 0x55f9178131b0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.993+0000 7f4b12c15740 10 client.0 _ll_register_callbacks cb 0x7f4af8010dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:46482/0 (socket says 172.21.15.82:46482) 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 -- 172.21.15.82:0/2434493245 learned_addr learned my addr 172.21.15.82:0/2434493245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09200640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bd0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 -- 172.21.15.82:0/2434493245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 msgr2=0x55f917bd1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 -- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 msgr2=0x55f917bd0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bd0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.994+0000 7f4b09c00640 1 -- 172.21.15.82:0/2434493245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f917bce030 con 0x55f9178131b0 2024-06-06T02:45:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.995+0000 7f4b09c00640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4afc02ade0 tx=0x7f4afc02fcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffdd798b4b3b5d6a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.995+0000 7f4ae6a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.995+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc059070 con 0x55f9178131b0 2024-06-06T02:45:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.995+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f4afc0044c0 con 0x55f9178131b0 2024-06-06T02:45:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.996+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4afc02f660 con 0x55f9178131b0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.996+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4afc063050 con 0x55f9178131b0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.996+0000 7f4b12c15740 10 client.26062 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.996+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f917bb6b30 con 0x55f9178131b0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4afc02f660 con 0x55f9178131b0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f4afc05e4b0 con 0x55f9178131b0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 10 client.26062 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 20 client.26062 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177a71c0 0x55f917bb95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 4 client.26062 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.997+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f917b27e70 con 0x55f9177a71c0 2024-06-06T02:45:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.998+0000 7f4b09200640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177a71c0 0x55f917bb95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.999+0000 7f4b09200640 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177a71c0 0x55f917bb95a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629eee01d5bd3e56 server_cookie=bdb2586018c9bd2b in_seq=0 out_seq=0 2024-06-06T02:45:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:02.999+0000 7f4ae6a00640 10 client.26062 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:03.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.602+0000 7f4ae6a00640 1 -- 172.21.15.82:0/2434493245 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f917b27e70 con 0x55f9177a71c0 2024-06-06T02:45:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.602+0000 7f4ae6a00640 10 client.26062 handle_command_reply: tid=0 2024-06-06T02:45:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.602+0000 7f4b12c15740 1 client.26062 shutdown 2024-06-06T02:45:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.602+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 msgr2=0x55f917bcd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:03.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.602+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4afc02ade0 tx=0x7f4afc02fcd0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 shutdown_connections 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f9178131b0 0x55f917bcd8c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f9177f24d0 0x55f917bd1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55f9177a71c0 0x55f917bb95a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 --2- 172.21.15.82:0/2434493245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f9177ea2f0 0x55f917bd0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 >> 172.21.15.82:0/2434493245 conn(0x55f917807300 msgr2=0x55f917bbd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.604+0000 7f4ae6a00640 0 client.26062 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.605+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 shutdown_connections 2024-06-06T02:45:03.605 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.605+0000 7f4b12c15740 1 -- 172.21.15.82:0/2434493245 wait complete. 2024-06-06T02:45:03.606 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.605+0000 7f4b12c15740 20 client.26062 trim_cache size 0 max 16384 2024-06-06T02:45:03.607 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:45:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:45:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:45:03.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:45:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 msgr2=0x7f4aec0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 0x7f4aec0b4c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4afc031b50 tx=0x7f4afc009920 comp rx=0 tx=0).stop 2024-06-06T02:45:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 msgr2=0x7f4b0419b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c970 tx=0x7f4af400ce30 comp rx=0 tx=0).stop 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 shutdown_connections 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f4aec0b2770 0x7f4aec0b4c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b04108790 0x7f4b041a2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b04105e30 0x7f4b0419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.611+0000 7f4b0a600640 1 --2- 172.21.15.82:0/3838150220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b041034d0 0x7f4b0419b270 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.612+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 >> 172.21.15.82:0/3838150220 conn(0x7f4b040fd0c0 msgr2=0x7f4b04103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.612+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 shutdown_connections 2024-06-06T02:45:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:03.612+0000 7f4b0a600640 1 -- 172.21.15.82:0/3838150220 wait complete. 2024-06-06T02:45:04.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:04 smithi103 ceph-mon[36349]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 66 MiB/s wr, 9.43k op/s 2024-06-06T02:45:04.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:04 smithi082 ceph-mon[31579]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 66 MiB/s wr, 9.43k op/s 2024-06-06T02:45:04.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:04 smithi184 ceph-mon[36922]: pgmap v664: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 66 MiB/s wr, 9.43k op/s 2024-06-06T02:45:06.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:06 smithi103 ceph-mon[36349]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 9.93k op/s 2024-06-06T02:45:06.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:06 smithi082 ceph-mon[31579]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 9.93k op/s 2024-06-06T02:45:06.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:06 smithi184 ceph-mon[36922]: pgmap v665: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 69 MiB/s wr, 9.93k op/s 2024-06-06T02:45:08.617 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:08 smithi103 ceph-mon[36349]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 11.05k op/s 2024-06-06T02:45:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:08 smithi082 ceph-mon[31579]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 11.05k op/s 2024-06-06T02:45:08.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:08 smithi184 ceph-mon[36922]: pgmap v666: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 75 MiB/s wr, 11.05k op/s 2024-06-06T02:45:10.648 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:10 smithi184 ceph-mon[36922]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 10.88k op/s 2024-06-06T02:45:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:10 smithi103 ceph-mon[36349]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 10.88k op/s 2024-06-06T02:45:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:10 smithi082 ceph-mon[31579]: pgmap v667: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 74 MiB/s wr, 10.88k op/s 2024-06-06T02:45:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:12 smithi103 ceph-mon[36349]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 71 MiB/s wr, 10.42k op/s 2024-06-06T02:45:12.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:12 smithi082 ceph-mon[31579]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 71 MiB/s wr, 10.42k op/s 2024-06-06T02:45:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:12 smithi184 ceph-mon[36922]: pgmap v668: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 71 MiB/s wr, 10.42k op/s 2024-06-06T02:45:14.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:14 smithi103 ceph-mon[36349]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 69 MiB/s wr, 10.18k op/s 2024-06-06T02:45:14.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:14 smithi082 ceph-mon[31579]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 69 MiB/s wr, 10.18k op/s 2024-06-06T02:45:14.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:14 smithi184 ceph-mon[36922]: pgmap v669: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 69 MiB/s wr, 10.18k op/s 2024-06-06T02:45:16.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:16 smithi082 ceph-mon[31579]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:16.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:16 smithi103 ceph-mon[36349]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:16 smithi184 ceph-mon[36922]: pgmap v670: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.987+0000 7f0746e00640 1 -- 172.21.15.82:0/1692085050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 msgr2=0x7f0740111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:16.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.987+0000 7f0746e00640 1 --2- 172.21.15.82:0/1692085050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f0740111430 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0738009cd0 tx=0x7f073802a8f0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 -- 172.21.15.82:0/1692085050 shutdown_connections 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 --2- 172.21.15.82:0/1692085050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f0740111430 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 --2- 172.21.15.82:0/1692085050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740075090 0x7f0740075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 --2- 172.21.15.82:0/1692085050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740076690 0x7f0740074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 -- 172.21.15.82:0/1692085050 >> 172.21.15.82:0/1692085050 conn(0x7f07400fe1d0 msgr2=0x7f0740100680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 -- 172.21.15.82:0/1692085050 shutdown_connections 2024-06-06T02:45:16.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.988+0000 7f0746e00640 1 -- 172.21.15.82:0/1692085050 wait complete. 2024-06-06T02:45:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.990+0000 7f0746e00640 1 Processor -- start 2024-06-06T02:45:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.990+0000 7f0746e00640 1 -- start start 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740075090 0x7f074019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f07401a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0740114b10 con 0x7f0740075090 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0740114990 con 0x7f074010f010 2024-06-06T02:45:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.991+0000 7f0746e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f0740114c90 con 0x7f0740076690 2024-06-06T02:45:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:16.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47830/0 (socket says 172.21.15.82:47830) 2024-06-06T02:45:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 -- 172.21.15.82:0/2635520474 learned_addr learned my addr 172.21.15.82:0/2635520474 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0746400640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f07401a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745a00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740075090 0x7f074019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 -- 172.21.15.82:0/2635520474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 msgr2=0x7f07401a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f07401a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 -- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740075090 msgr2=0x7f074019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740075090 0x7f074019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.992+0000 7f0745000640 1 -- 172.21.15.82:0/2635520474 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07401a7130 con 0x7f0740076690 2024-06-06T02:45:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f0745000640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c970 tx=0x7f072c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f073e000640 1 -- 172.21.15.82:0/2635520474 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c014070 con 0x7f0740076690 2024-06-06T02:45:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07401a7420 con 0x7f0740076690 2024-06-06T02:45:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f073e000640 1 -- 172.21.15.82:0/2635520474 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072c004440 con 0x7f0740076690 2024-06-06T02:45:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f073e000640 1 -- 172.21.15.82:0/2635520474 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c003d70 con 0x7f0740076690 2024-06-06T02:45:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:16.995+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07401a79c0 con 0x7f0740076690 2024-06-06T02:45:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.001+0000 7f074f3ab740 1 Processor -- start 2024-06-06T02:45:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.001+0000 7f073e000640 1 -- 172.21.15.82:0/2635520474 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f072c017070 con 0x7f0740076690 2024-06-06T02:45:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.004+0000 7f073e000640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 0x7f07280b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.004+0000 7f073e000640 1 -- 172.21.15.82:0/2635520474 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f072c0e2000 con 0x7f0740076690 2024-06-06T02:45:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.004+0000 7f0746400640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 0x7f07280b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 -- start start 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53c21b0 0x55a8f5766f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5767480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8f56d9480 con 0x55a8f53c21b0 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8f56c8a20 con 0x55a8f53a14d0 2024-06-06T02:45:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.007+0000 7f074f3ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8f56cca60 con 0x55a8f53992f0 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.008+0000 7f0746400640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 0x7f07280b4d40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0738006010 tx=0x7f0738005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.008+0000 7f0746400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.008+0000 7f0746400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42452/0 (socket says 172.21.15.82:42452) 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.008+0000 7f0746400640 1 -- 172.21.15.82:0/84329337 learned_addr learned my addr 172.21.15.82:0/84329337 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.008+0000 7f0745000640 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5767480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0745a00640 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53c21b0 0x55a8f5766f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 -- 172.21.15.82:0/84329337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 msgr2=0x55a8f5767480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5767480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 -- 172.21.15.82:0/84329337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53c21b0 msgr2=0x55a8f5766f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53c21b0 0x55a8f5766f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 -- 172.21.15.82:0/84329337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f56c58d0 con 0x55a8f53a14d0 2024-06-06T02:45:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.009+0000 7f0746400640 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0738009cd0 tx=0x7f073803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59593ab6fcd80025 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:17.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.010+0000 7f0732a00640 1 -- 172.21.15.82:0/84329337 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738030cc0 con 0x55a8f53a14d0 2024-06-06T02:45:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.010+0000 7f0732a00640 1 -- 172.21.15.82:0/84329337 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0738003b70 con 0x55a8f53a14d0 2024-06-06T02:45:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.011+0000 7f074f3ab740 1 -- 172.21.15.82:0/84329337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 msgr2=0x55a8f576e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.011+0000 7f0732a00640 1 -- 172.21.15.82:0/84329337 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07380457b0 con 0x55a8f53a14d0 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.011+0000 7f074f3ab740 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0738009cd0 tx=0x7f073803f000 comp rx=0 tx=0).stop 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 -- 172.21.15.82:0/84329337 shutdown_connections 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f576e340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5767480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 --2- 172.21.15.82:0/84329337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53c21b0 0x55a8f5766f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 -- 172.21.15.82:0/84329337 >> 172.21.15.82:0/84329337 conn(0x55a8f53b6300 msgr2=0x55a8f57628f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 -- 172.21.15.82:0/84329337 shutdown_connections 2024-06-06T02:45:17.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.012+0000 7f074f3ab740 1 -- 172.21.15.82:0/84329337 wait complete. 2024-06-06T02:45:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.013+0000 7f074f3ab740 1 -- start start 2024-06-06T02:45:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.013+0000 7f074f3ab740 1 Processor -- start 2024-06-06T02:45:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 0x55a8f57704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f57709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53c21b0 0x55a8f57778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a8f5603ab0 con 0x55a8f53a14d0 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8f5666630 con 0x55a8f53992f0 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a8f576eb30 con 0x55a8f53c21b0 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f074f3ab740 10 client.0 _ll_register_callbacks cb 0x55a8f566c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f0745a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 0x55a8f57704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f0745a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 0x55a8f57704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42460/0 (socket says 172.21.15.82:42460) 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f0745a00640 1 -- 172.21.15.82:0/2788132384 learned_addr learned my addr 172.21.15.82:0/2788132384 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.014+0000 7f0746400640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53c21b0 0x55a8f57778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.015+0000 7f0745000640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f57709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.016+0000 7f0745000640 1 -- 172.21.15.82:0/2788132384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53c21b0 msgr2=0x55a8f57778e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.016+0000 7f0745000640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53c21b0 0x55a8f57778e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.016+0000 7f0745000640 1 -- 172.21.15.82:0/2788132384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 msgr2=0x55a8f57704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.016+0000 7f0745000640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 0x55a8f57704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.016+0000 7f0745000640 1 -- 172.21.15.82:0/2788132384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8f5693170 con 0x55a8f53a14d0 2024-06-06T02:45:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.020+0000 7f0745000640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f57709f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f072c0dfb00 tx=0x7f072c0a8eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4701155b143f0cbc server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.020+0000 7f0727400640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:45:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.021+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c0a9130 con 0x55a8f53a14d0 2024-06-06T02:45:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.021+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f072c08fda0 con 0x55a8f53a14d0 2024-06-06T02:45:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.021+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0738003b70 con 0x55a8f53a14d0 2024-06-06T02:45:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.022+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f072c0a9d20 con 0x55a8f53a14d0 2024-06-06T02:45:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.025+0000 7f074f3ab740 10 client.15729 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:17.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.025+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a8f542d790 con 0x55a8f53a14d0 2024-06-06T02:45:17.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.025+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0738003b70 con 0x55a8f53a14d0 2024-06-06T02:45:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f072c0a82f0 con 0x55a8f53a14d0 2024-06-06T02:45:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 10 client.15729 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:17.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 20 client.15729 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f5380d80 0x55a8f577dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 4 client.15729 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:45:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.027+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8f56db3d0 con 0x55a8f5380d80 2024-06-06T02:45:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.028+0000 7f0745a00640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f5380d80 0x55a8f577dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.029+0000 7f0745a00640 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f5380d80 0x55a8f577dc60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eb4c015de8d36b2 server_cookie=ebdea9ff1f60306 in_seq=0 out_seq=0 2024-06-06T02:45:17.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.029+0000 7f0727400640 10 client.15729 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.030+0000 7f0727400640 1 -- 172.21.15.82:0/2788132384 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a8f56db3d0 con 0x55a8f5380d80 2024-06-06T02:45:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.030+0000 7f0727400640 10 client.15729 handle_command_reply: tid=0 2024-06-06T02:45:17.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.031+0000 7f074f3ab740 1 client.15729 shutdown 2024-06-06T02:45:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.032+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 msgr2=0x55a8f57709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.032+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f57709f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f072c0dfb00 tx=0x7f072c0a8eb0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 shutdown_connections 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53c21b0 0x55a8f57778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f5380d80 0x55a8f577dc60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f57709f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 --2- 172.21.15.82:0/2788132384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53992f0 0x55a8f57704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 >> 172.21.15.82:0/2788132384 conn(0x55a8f53b6300 msgr2=0x55a8f57637f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f0727400640 0 client.15729 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 shutdown_connections 2024-06-06T02:45:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.035+0000 7f074f3ab740 1 -- 172.21.15.82:0/2788132384 wait complete. 2024-06-06T02:45:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.036+0000 7f074f3ab740 20 client.15729 trim_cache size 0 max 16384 2024-06-06T02:45:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.075+0000 7f074f3ab740 1 Processor -- start 2024-06-06T02:45:17.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.076+0000 7f074f3ab740 1 -- start start 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53b6300 0x55a8f5762b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f5763d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07401b2e20 con 0x55a8f53a14d0 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07401b06f0 con 0x55a8f53b6300 2024-06-06T02:45:17.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f074f3ab740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07401ae5f0 con 0x55a8f53992f0 2024-06-06T02:45:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f0745000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f0745000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47866/0 (socket says 172.21.15.82:47866) 2024-06-06T02:45:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f0745000640 1 -- 172.21.15.82:0/3915969642 learned_addr learned my addr 172.21.15.82:0/3915969642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:17.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f0746400640 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f5763d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.077+0000 7f0745a00640 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53b6300 0x55a8f5762b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.078+0000 7f0745000640 1 -- 172.21.15.82:0/3915969642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53b6300 msgr2=0x55a8f5762b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.078+0000 7f0745000640 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53b6300 0x55a8f5762b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.078+0000 7f0745000640 1 -- 172.21.15.82:0/3915969642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 msgr2=0x55a8f5763d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.078+0000 7f0745000640 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f5763d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.078+0000 7f0745000640 1 -- 172.21.15.82:0/3915969642 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8f54a6620 con 0x55a8f53992f0 2024-06-06T02:45:17.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.079+0000 7f0745000640 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f072c0e22a0 tx=0x7f072c00af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c3ecbd3ac7ca8a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.081+0000 7f0732000640 1 -- 172.21.15.82:0/3915969642 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c0ad9d0 con 0x55a8f53992f0 2024-06-06T02:45:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.081+0000 7f0732000640 1 -- 172.21.15.82:0/3915969642 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072c0b2480 con 0x55a8f53992f0 2024-06-06T02:45:17.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.081+0000 7f0732000640 1 -- 172.21.15.82:0/3915969642 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c0aeca0 con 0x55a8f53992f0 2024-06-06T02:45:17.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.082+0000 7f074f3ab740 1 -- 172.21.15.82:0/3915969642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 msgr2=0x55a8f5777870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.082+0000 7f074f3ab740 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f072c0e22a0 tx=0x7f072c00af70 comp rx=0 tx=0).stop 2024-06-06T02:45:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 -- 172.21.15.82:0/3915969642 shutdown_connections 2024-06-06T02:45:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53a14d0 0x55a8f5763d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5777870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 --2- 172.21.15.82:0/3915969642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53b6300 0x55a8f5762b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 -- 172.21.15.82:0/3915969642 >> 172.21.15.82:0/3915969642 conn(0x55a8f5770c80 msgr2=0x55a8f5763660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 -- 172.21.15.82:0/3915969642 shutdown_connections 2024-06-06T02:45:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.084+0000 7f074f3ab740 1 -- 172.21.15.82:0/3915969642 wait complete. 2024-06-06T02:45:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.085+0000 7f074f3ab740 1 -- start start 2024-06-06T02:45:17.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.085+0000 7f074f3ab740 1 Processor -- start 2024-06-06T02:45:17.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.086+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.086+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f5775060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f074f3ab740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 0x55a8f5775f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f074f3ab740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f07401aebb0 con 0x55a8f53b6300 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f0745a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f0745a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:47878/0 (socket says 172.21.15.82:47878) 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f0745a00640 1 -- 172.21.15.82:0/1584242446 learned_addr learned my addr 172.21.15.82:0/1584242446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f0746400640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 0x55a8f5775f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07401b0020 con 0x55a8f53a14d0 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.087+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f07401af280 con 0x55a8f53992f0 2024-06-06T02:45:17.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.088+0000 7f074f3ab740 10 client.0 _ll_register_callbacks cb 0x7f072c0a8d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.088+0000 7f0745000640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f5775060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0745a00640 1 -- 172.21.15.82:0/1584242446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 msgr2=0x55a8f5775060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0745a00640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f5775060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0745a00640 1 -- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 msgr2=0x55a8f5775f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0745a00640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 0x55a8f5775f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0745a00640 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8f5776580 con 0x55a8f53992f0 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.089+0000 7f0746400640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 0x55a8f5775f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.090+0000 7f0745a00640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a8f577e3d0 tx=0x7f073400bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d624d4a7bf7adcb6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:17.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.090+0000 7f0727400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:17.091 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.091+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07340117f0 con 0x55a8f53992f0 2024-06-06T02:45:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.091+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f0734011990 con 0x55a8f53992f0 2024-06-06T02:45:17.092 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.091+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f072c0b2480 con 0x55a8f53992f0 2024-06-06T02:45:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.092+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0734011bd0 con 0x55a8f53992f0 2024-06-06T02:45:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.092+0000 7f074f3ab740 10 client.26077 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.092+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a8f5777910 con 0x55a8f53992f0 2024-06-06T02:45:17.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.094+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f072c0b2480 con 0x55a8f53992f0 2024-06-06T02:45:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f073400f040 con 0x55a8f53992f0 2024-06-06T02:45:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 10 client.26077 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 10 client.26077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:17.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 20 client.26077 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f53c21b0 0x55a8f57e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 4 client.26077 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8f56d6e70 con 0x55a8f53c21b0 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.095+0000 7f0745000640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f53c21b0 0x55a8f57e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.098+0000 7f0745000640 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f53c21b0 0x55a8f57e8950 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db74af62258915c server_cookie=4c7ecf7000cf9b70 in_seq=0 out_seq=0 2024-06-06T02:45:17.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.098+0000 7f0727400640 10 client.26077 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.771+0000 7f0727400640 1 -- 172.21.15.82:0/1584242446 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8f56d6e70 con 0x55a8f53c21b0 2024-06-06T02:45:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.771+0000 7f0727400640 10 client.26077 handle_command_reply: tid=0 2024-06-06T02:45:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.771+0000 7f074f3ab740 1 client.26077 shutdown 2024-06-06T02:45:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.771+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 msgr2=0x55a8f5774b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.771+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x55a8f577e3d0 tx=0x7f073400bf90 comp rx=0 tx=0).stop 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 shutdown_connections 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a8f53c21b0 0x55a8f57e8950 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a8f53b6300 0x55a8f5775f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8f53a14d0 0x55a8f5775060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 --2- 172.21.15.82:0/1584242446 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a8f53992f0 0x55a8f5774b20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f0727400640 0 client.26077 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.772+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 >> 172.21.15.82:0/1584242446 conn(0x55a8f5770c80 msgr2=0x55a8f5763c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.773+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 shutdown_connections 2024-06-06T02:45:17.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.773+0000 7f074f3ab740 1 -- 172.21.15.82:0/1584242446 wait complete. 2024-06-06T02:45:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.773+0000 7f074f3ab740 20 client.26077 trim_cache size 0 max 16384 2024-06-06T02:45:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:45:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:45:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:45:17.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:45:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.774+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 msgr2=0x7f07280b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.774+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 0x7f07280b4d40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0738006010 tx=0x7f0738005dc0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.774+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 msgr2=0x7f074019fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.774+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c970 tx=0x7f072c00ce30 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 shutdown_connections 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f074010f010 0x7f07401a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f07280b2830 0x7f07280b4d40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0740076690 0x7f074019fbe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 --2- 172.21.15.82:0/2635520474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0740075090 0x7f074019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 >> 172.21.15.82:0/2635520474 conn(0x7f07400fe1d0 msgr2=0x7f0740102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:17.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 shutdown_connections 2024-06-06T02:45:17.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:17.775+0000 7f0746e00640 1 -- 172.21.15.82:0/2635520474 wait complete. 2024-06-06T02:45:18.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:18 smithi103 ceph-mon[36349]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 MiB/s wr, 10.89k op/s 2024-06-06T02:45:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:18 smithi082 ceph-mon[31579]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 MiB/s wr, 10.89k op/s 2024-06-06T02:45:18.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:18 smithi184 ceph-mon[36922]: pgmap v671: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 74 MiB/s wr, 10.89k op/s 2024-06-06T02:45:20.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:20 smithi103 ceph-mon[36349]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:20 smithi082 ceph-mon[31579]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:20.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:20 smithi184 ceph-mon[36922]: pgmap v672: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 74 MiB/s wr, 10.87k op/s 2024-06-06T02:45:22.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:22 smithi103 ceph-mon[36349]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 10.23k op/s 2024-06-06T02:45:22.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:22 smithi082 ceph-mon[31579]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 10.23k op/s 2024-06-06T02:45:22.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:22 smithi184 ceph-mon[36922]: pgmap v673: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 10.23k op/s 2024-06-06T02:45:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:24 smithi103 ceph-mon[36349]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 MiB/s wr, 11.19k op/s 2024-06-06T02:45:24.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:24 smithi082 ceph-mon[31579]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 MiB/s wr, 11.19k op/s 2024-06-06T02:45:24.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:24 smithi184 ceph-mon[36922]: pgmap v674: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 MiB/s wr, 11.19k op/s 2024-06-06T02:45:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:26 smithi103 ceph-mon[36349]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 11.13k op/s 2024-06-06T02:45:26.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:26 smithi082 ceph-mon[31579]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 11.13k op/s 2024-06-06T02:45:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:26 smithi184 ceph-mon[36922]: pgmap v675: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 71 MiB/s wr, 11.13k op/s 2024-06-06T02:45:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:28 smithi103 ceph-mon[36349]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 69 MiB/s wr, 10.99k op/s 2024-06-06T02:45:28.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:28 smithi082 ceph-mon[31579]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 69 MiB/s wr, 10.99k op/s 2024-06-06T02:45:28.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:28 smithi184 ceph-mon[36922]: pgmap v676: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 69 MiB/s wr, 10.99k op/s 2024-06-06T02:45:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:30 smithi103 ceph-mon[36349]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 72 MiB/s wr, 11.61k op/s 2024-06-06T02:45:30.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:30 smithi082 ceph-mon[31579]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 72 MiB/s wr, 11.61k op/s 2024-06-06T02:45:30.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:30 smithi184 ceph-mon[36922]: pgmap v677: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 72 MiB/s wr, 11.61k op/s 2024-06-06T02:45:31.017 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:45:32.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:32 smithi103 ceph-mon[36349]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 64 MiB/s wr, 10.42k op/s 2024-06-06T02:45:32.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:32 smithi082 ceph-mon[31579]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 64 MiB/s wr, 10.42k op/s 2024-06-06T02:45:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:32 smithi184 ceph-mon[36922]: pgmap v678: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 64 MiB/s wr, 10.42k op/s 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.994+0000 7f2c42a00640 1 -- 172.21.15.82:0/3600936003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a5430 msgr2=0x7f2c340ac620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.994+0000 7f2c42a00640 1 --2- 172.21.15.82:0/3600936003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a5430 0x7f2c340ac620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c28009860 tx=0x7f2c2802a340 comp rx=0 tx=0).stop 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 -- 172.21.15.82:0/3600936003 shutdown_connections 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 --2- 172.21.15.82:0/3600936003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 --2- 172.21.15.82:0/3600936003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a5430 0x7f2c340ac620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 --2- 172.21.15.82:0/3600936003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a4a50 0x7f2c340a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 -- 172.21.15.82:0/3600936003 >> 172.21.15.82:0/3600936003 conn(0x7f2c340a0480 msgr2=0x7f2c340a2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 -- 172.21.15.82:0/3600936003 shutdown_connections 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.996+0000 7f2c42a00640 1 -- 172.21.15.82:0/3600936003 wait complete. 2024-06-06T02:45:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.997+0000 7f2c42a00640 1 Processor -- start 2024-06-06T02:45:33.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.998+0000 7f2c42a00640 1 -- start start 2024-06-06T02:45:33.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.998+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.998+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.998+0000 7f2c42a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.999+0000 7f2c41600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:32.999+0000 7f2c41600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44558/0 (socket says 172.21.15.82:44558) 2024-06-06T02:45:33.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.001+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:55480/0 (socket says 172.21.15.82:55480) 2024-06-06T02:45:33.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c40c00640 1 -- 172.21.15.82:0/942426629 learned_addr learned my addr 172.21.15.82:0/942426629 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:33.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340b29a0 con 0x7f2c340acb60 2024-06-06T02:45:33.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340b2820 con 0x7f2c340a5430 2024-06-06T02:45:33.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340b2b20 con 0x7f2c340a4a50 2024-06-06T02:45:33.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.002+0000 7f2c42000640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.003+0000 7f2c42000640 1 -- 172.21.15.82:0/942426629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 msgr2=0x7f2c340a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.003+0000 7f2c42000640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.003+0000 7f2c42000640 1 -- 172.21.15.82:0/942426629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 msgr2=0x7f2c340a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.003+0000 7f2c42000640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.003+0000 7f2c42000640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c340a6f40 con 0x7f2c340acb60 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.004+0000 7f2c40c00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.004+0000 7f2c41600640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.004+0000 7f2c42000640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340a6930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c710 tx=0x7f2c3000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.004+0000 7f2c3a000640 1 -- 172.21.15.82:0/942426629 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30004220 con 0x7f2c340acb60 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.004+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c340a7230 con 0x7f2c340acb60 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.005+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c34010f00 con 0x7f2c340acb60 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.005+0000 7f2c3a000640 1 -- 172.21.15.82:0/942426629 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c3000ce20 con 0x7f2c340acb60 2024-06-06T02:45:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.005+0000 7f2c3a000640 1 -- 172.21.15.82:0/942426629 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30004220 con 0x7f2c340acb60 2024-06-06T02:45:33.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.012+0000 7f2c3a000640 1 -- 172.21.15.82:0/942426629 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2c30003c10 con 0x7f2c340acb60 2024-06-06T02:45:33.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.013+0000 7f2c4afe9740 1 Processor -- start 2024-06-06T02:45:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.017+0000 7f2c3a000640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 0x7f2c240b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.019 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 -- start start 2024-06-06T02:45:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9153c1b0 0x55da918e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da91853480 con 0x55da915132f0 2024-06-06T02:45:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da91842a20 con 0x55da9153c1b0 2024-06-06T02:45:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.019+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55da91846a60 con 0x55da9151b4d0 2024-06-06T02:45:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.020+0000 7f2c40c00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 0x7f2c240b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.020+0000 7f2c3a000640 1 -- 172.21.15.82:0/942426629 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2c30004020 con 0x7f2c340acb60 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.020+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.020+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44564/0 (socket says 172.21.15.82:44564) 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.020+0000 7f2c42000640 1 -- 172.21.15.82:0/1139289593 learned_addr learned my addr 172.21.15.82:0/1139289593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 -- 172.21.15.82:0/1139289593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9153c1b0 msgr2=0x55da918e0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9153c1b0 0x55da918e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 -- 172.21.15.82:0/1139289593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 msgr2=0x55da918e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 -- 172.21.15.82:0/1139289593 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9183f8d0 con 0x55da9151b4d0 2024-06-06T02:45:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.021+0000 7f2c42000640 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c300e0180 tx=0x7f2c300037d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a26939534ac2bec6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.026+0000 7f2c2e600640 1 -- 172.21.15.82:0/1139289593 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3001d040 con 0x55da9151b4d0 2024-06-06T02:45:33.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.026+0000 7f2c40c00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 0x7f2c240b50f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005e00 tx=0x7f2c2800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.026+0000 7f2c2e600640 1 -- 172.21.15.82:0/1139289593 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c300c0030 con 0x55da9151b4d0 2024-06-06T02:45:33.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.026+0000 7f2c2e600640 1 -- 172.21.15.82:0/1139289593 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300a59b0 con 0x55da9151b4d0 2024-06-06T02:45:33.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.028+0000 7f2c4afe9740 1 -- 172.21.15.82:0/1139289593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 msgr2=0x55da918e82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:33.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.028+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2c300e0180 tx=0x7f2c300037d0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.029+0000 7f2c4afe9740 1 -- 172.21.15.82:0/1139289593 shutdown_connections 2024-06-06T02:45:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.029+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9151b4d0 0x55da918e82f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.029+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918e1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.029+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/1139289593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9153c1b0 0x55da918e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.029+0000 7f2c4afe9740 1 -- 172.21.15.82:0/1139289593 >> 172.21.15.82:0/1139289593 conn(0x55da91530300 msgr2=0x55da918dc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.030+0000 7f2c4afe9740 1 -- 172.21.15.82:0/1139289593 shutdown_connections 2024-06-06T02:45:33.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.031+0000 7f2c4afe9740 1 -- 172.21.15.82:0/1139289593 wait complete. 2024-06-06T02:45:33.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.031+0000 7f2c4afe9740 1 -- start start 2024-06-06T02:45:33.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.032+0000 7f2c4afe9740 1 Processor -- start 2024-06-06T02:45:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.032+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918ea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55da9177dab0 con 0x55da9151b4d0 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55da917e0630 con 0x55da915132f0 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55da918e8cc0 con 0x55da9153c1b0 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c4afe9740 10 client.0 _ll_register_callbacks cb 0x55da917e6610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44566/0 (socket says 172.21.15.82:44566) 2024-06-06T02:45:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c42000640 1 -- 172.21.15.82:0/3084130236 learned_addr learned my addr 172.21.15.82:0/3084130236 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.033+0000 7f2c41600640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918ea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c40c00640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c42000640 1 -- 172.21.15.82:0/3084130236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 msgr2=0x55da918ea5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c42000640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918ea5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c42000640 1 -- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 msgr2=0x55da918eab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c42000640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918eab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.034+0000 7f2c42000640 1 -- 172.21.15.82:0/3084130236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9180d170 con 0x55da9153c1b0 2024-06-06T02:45:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.035+0000 7f2c42000640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005fd0 tx=0x7f2c30004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca299053b50dac6 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.035+0000 7f2c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.035+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300c8030 con 0x55da9153c1b0 2024-06-06T02:45:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.036+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2c300a63d0 con 0x55da9153c1b0 2024-06-06T02:45:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.036+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c300c0030 con 0x55da9153c1b0 2024-06-06T02:45:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.036+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c3001d040 con 0x55da9153c1b0 2024-06-06T02:45:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.037+0000 7f2c4afe9740 10 client.26089 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.037+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55da915a7790 con 0x55da9153c1b0 2024-06-06T02:45:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.038+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c300c0030 con 0x55da9153c1b0 2024-06-06T02:45:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f2c300af270 con 0x55da9153c1b0 2024-06-06T02:45:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 10 client.26089 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 10 client.26089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 20 client.26089 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914fad80 0x55da918f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 4 client.26089 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.040+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da918553d0 con 0x55da914fad80 2024-06-06T02:45:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.041+0000 7f2c41600640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914fad80 0x55da918f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.043+0000 7f2c22a00640 10 client.26089 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.043+0000 7f2c41600640 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914fad80 0x55da918f7f80 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57c267e7d98a36a server_cookie=4f294fce05c8d358 in_seq=0 out_seq=0 2024-06-06T02:45:33.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.046+0000 7f2c22a00640 1 -- 172.21.15.82:0/3084130236 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55da918553d0 con 0x55da914fad80 2024-06-06T02:45:33.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.046+0000 7f2c22a00640 10 client.26089 handle_command_reply: tid=0 2024-06-06T02:45:33.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.048+0000 7f2c4afe9740 1 client.26089 shutdown 2024-06-06T02:45:33.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.049+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 msgr2=0x55da918f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:33.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.049+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2c30005fd0 tx=0x7f2c30004220 comp rx=0 tx=0).stop 2024-06-06T02:45:33.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 shutdown_connections 2024-06-06T02:45:33.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f1a10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914fad80 0x55da918f7f80 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918eab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/3084130236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918ea5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c22a00640 0 client.26089 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:33.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.050+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 >> 172.21.15.82:0/3084130236 conn(0x55da91530300 msgr2=0x55da918dd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:33.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.051+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 shutdown_connections 2024-06-06T02:45:33.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.051+0000 7f2c4afe9740 1 -- 172.21.15.82:0/3084130236 wait complete. 2024-06-06T02:45:33.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.051+0000 7f2c4afe9740 20 client.26089 trim_cache size 0 max 16384 2024-06-06T02:45:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.100+0000 7f2c4afe9740 1 Processor -- start 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 -- start start 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918dd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918dde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c010b90 con 0x55da9151b4d0 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c00e460 con 0x55da915132f0 2024-06-06T02:45:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.105+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c00c360 con 0x55da9153c1b0 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44574/0 (socket says 172.21.15.82:44574) 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 -- 172.21.15.82:0/2331628985 learned_addr learned my addr 172.21.15.82:0/2331628985 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 -- 172.21.15.82:0/2331628985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 msgr2=0x55da918dd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918dd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.106+0000 7f2c42000640 1 -- 172.21.15.82:0/2331628985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 msgr2=0x55da918dde90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:45:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.107+0000 7f2c42000640 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.107+0000 7f2c42000640 1 -- 172.21.15.82:0/2331628985 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da91620620 con 0x55da9153c1b0 2024-06-06T02:45:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.108+0000 7f2c42000640 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2c300036a0 tx=0x7f2c300ae260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7743755c7e9004d1 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.109+0000 7f2c2dc00640 1 -- 172.21.15.82:0/2331628985 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c300b2b90 con 0x55da9153c1b0 2024-06-06T02:45:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.109+0000 7f2c2dc00640 1 -- 172.21.15.82:0/2331628985 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c300c0070 con 0x55da9153c1b0 2024-06-06T02:45:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.109+0000 7f2c2dc00640 1 -- 172.21.15.82:0/2331628985 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30007a60 con 0x55da9153c1b0 2024-06-06T02:45:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.110+0000 7f2c4afe9740 1 -- 172.21.15.82:0/2331628985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 msgr2=0x55da918f19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.110+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2c300036a0 tx=0x7f2c300ae260 comp rx=0 tx=0).stop 2024-06-06T02:45:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 -- 172.21.15.82:0/2331628985 shutdown_connections 2024-06-06T02:45:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918f19a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da9151b4d0 0x55da918dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/2331628985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da915132f0 0x55da918dd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 -- 172.21.15.82:0/2331628985 >> 172.21.15.82:0/2331628985 conn(0x55da91530300 msgr2=0x55da918dd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.111+0000 7f2c4afe9740 1 -- 172.21.15.82:0/2331628985 shutdown_connections 2024-06-06T02:45:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.112+0000 7f2c4afe9740 1 -- 172.21.15.82:0/2331628985 wait complete. 2024-06-06T02:45:33.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.112+0000 7f2c4afe9740 1 -- start start 2024-06-06T02:45:33.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 Processor -- start 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 0x55da918f2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c00c920 con 0x55da915132f0 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c00dd90 con 0x55da9151b4d0 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c00cff0 con 0x55da9153c1b0 2024-06-06T02:45:33.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.114+0000 7f2c4afe9740 10 client.0 _ll_register_callbacks cb 0x7f2c300a9420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.115+0000 7f2c40c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 0x55da918f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.115+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.115+0000 7f2c42000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918ee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44590/0 (socket says 172.21.15.82:44590) 2024-06-06T02:45:33.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.115+0000 7f2c42000640 1 -- 172.21.15.82:0/4163955021 learned_addr learned my addr 172.21.15.82:0/4163955021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.116+0000 7f2c40c00640 1 -- 172.21.15.82:0/4163955021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 msgr2=0x55da918ee670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.116+0000 7f2c40c00640 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918ee670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.116+0000 7f2c40c00640 1 -- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 msgr2=0x55da918f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.116+0000 7f2c40c00640 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.116+0000 7f2c40c00640 1 -- 172.21.15.82:0/4163955021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da918eed80 con 0x55da9151b4d0 2024-06-06T02:45:33.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.117+0000 7f2c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:45:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.117+0000 7f2c40c00640 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 0x55da918f2030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2c340a76f0 tx=0x7f2c2802c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db49d947ad8c183d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.118+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2804e020 con 0x55da9151b4d0 2024-06-06T02:45:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.118+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f2c28030980 con 0x55da9151b4d0 2024-06-06T02:45:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.119+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c300c0070 con 0x55da9151b4d0 2024-06-06T02:45:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.119+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c28044030 con 0x55da9151b4d0 2024-06-06T02:45:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.119+0000 7f2c4afe9740 10 client.26084 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.119+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55da9195f3a0 con 0x55da9151b4d0 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.120+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c300c0070 con 0x55da9151b4d0 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.120+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f2c2803e480 con 0x55da9151b4d0 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.120+0000 7f2c4afe9740 10 client.26084 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c4afe9740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c4afe9740 20 client.26084 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914d01c0 0x55da91961d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c4afe9740 4 client.26084 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:45:33.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da91850e70 con 0x55da914d01c0 2024-06-06T02:45:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.121+0000 7f2c41600640 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914d01c0 0x55da91961d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.122+0000 7f2c22a00640 10 client.26084 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:33.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:33.122+0000 7f2c41600640 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914d01c0 0x55da91961d90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0875c0ceb3e5716 server_cookie=a524fb1d293323f8 in_seq=0 out_seq=0 2024-06-06T02:45:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:45:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c22a00640 1 -- 172.21.15.82:0/4163955021 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da91850e70 con 0x55da914d01c0 2024-06-06T02:45:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c22a00640 10 client.26084 handle_command_reply: tid=0 2024-06-06T02:45:34.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 client.26084 shutdown 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 msgr2=0x55da918f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 0x55da918f2030 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2c340a76f0 tx=0x7f2c2802c040 comp rx=0 tx=0).stop 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 shutdown_connections 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55da9153c1b0 0x55da918ee670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55da9151b4d0 0x55da918f2030 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55da914d01c0 0x55da91961d90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c4afe9740 1 --2- 172.21.15.82:0/4163955021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55da915132f0 0x55da918f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.251+0000 7f2c22a00640 0 client.26084 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.252+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 >> 172.21.15.82:0/4163955021 conn(0x55da91530300 msgr2=0x55da918ddc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.252+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 shutdown_connections 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.252+0000 7f2c4afe9740 1 -- 172.21.15.82:0/4163955021 wait complete. 2024-06-06T02:45:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.252+0000 7f2c4afe9740 20 client.26084 trim_cache size 0 max 16384 2024-06-06T02:45:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:45:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:45:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:45:34.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 msgr2=0x7f2c240b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 0x7f2c240b50f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2c28005e00 tx=0x7f2c2800b040 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 msgr2=0x7f2c340a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340a6930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000c710 tx=0x7f2c3000cbd0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 shutdown_connections 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c340acb60 0x7f2c340a6930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c340a5430 0x7f2c340a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f2c240b2be0 0x7f2c240b50f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 --2- 172.21.15.82:0/942426629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c340a4a50 0x7f2c340a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 >> 172.21.15.82:0/942426629 conn(0x7f2c340a0480 msgr2=0x7f2c340a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.253+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 shutdown_connections 2024-06-06T02:45:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:34.254+0000 7f2c42a00640 1 -- 172.21.15.82:0/942426629 wait complete. 2024-06-06T02:45:34.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:34 smithi103 ceph-mon[36349]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 MiB/s wr, 9.76k op/s 2024-06-06T02:45:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:34 smithi082 ceph-mon[31579]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 MiB/s wr, 9.76k op/s 2024-06-06T02:45:34.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:34 smithi184 ceph-mon[36922]: pgmap v679: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 60 MiB/s wr, 9.76k op/s 2024-06-06T02:45:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:36 smithi103 ceph-mon[36349]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 65 MiB/s wr, 10.46k op/s 2024-06-06T02:45:36.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:36 smithi082 ceph-mon[31579]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 65 MiB/s wr, 10.46k op/s 2024-06-06T02:45:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:36 smithi184 ceph-mon[36922]: pgmap v680: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 65 MiB/s wr, 10.46k op/s 2024-06-06T02:45:38.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:38 smithi103 ceph-mon[36349]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 67 MiB/s wr, 10.94k op/s 2024-06-06T02:45:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:38 smithi082 ceph-mon[31579]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 67 MiB/s wr, 10.94k op/s 2024-06-06T02:45:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:38 smithi184 ceph-mon[36922]: pgmap v681: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 67 MiB/s wr, 10.94k op/s 2024-06-06T02:45:40.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:40 smithi103 ceph-mon[36349]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 70 MiB/s wr, 11.36k op/s 2024-06-06T02:45:40.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:40 smithi082 ceph-mon[31579]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 70 MiB/s wr, 11.36k op/s 2024-06-06T02:45:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:40 smithi184 ceph-mon[36922]: pgmap v682: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 70 MiB/s wr, 11.36k op/s 2024-06-06T02:45:41.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.791+0000 7fbe3a000640 1 -- 172.21.15.82:0/1871589229 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe340307c0 con 0x7fbe3c117ca0 2024-06-06T02:45:41.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.792+0000 7fbe42400640 1 -- 172.21.15.82:0/1871589229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c117ca0 msgr2=0x7fbe3c11a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.792+0000 7fbe42400640 1 --2- 172.21.15.82:0/1871589229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c11a170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009ca0 tx=0x7fbe3402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.793+0000 7fbe42400640 1 -- 172.21.15.82:0/1871589229 shutdown_connections 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.793+0000 7fbe42400640 1 --2- 172.21.15.82:0/1871589229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c11a170 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.793+0000 7fbe42400640 1 --2- 172.21.15.82:0/1871589229 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c10a280 0x7fbe3c117760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.793+0000 7fbe42400640 1 --2- 172.21.15.82:0/1871589229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c109930 0x7fbe3c109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.793+0000 7fbe42400640 1 -- 172.21.15.82:0/1871589229 >> 172.21.15.82:0/1871589229 conn(0x7fbe3c06df60 msgr2=0x7fbe3c06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.794+0000 7fbe42400640 1 -- 172.21.15.82:0/1871589229 shutdown_connections 2024-06-06T02:45:41.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.794+0000 7fbe42400640 1 -- 172.21.15.82:0/1871589229 wait complete. 2024-06-06T02:45:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.796+0000 7fbe42400640 1 Processor -- start 2024-06-06T02:45:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.797+0000 7fbe42400640 1 -- start start 2024-06-06T02:45:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.798+0000 7fbe42400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.798+0000 7fbe42400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.798+0000 7fbe42400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35444/0 (socket says 172.21.15.82:35444) 2024-06-06T02:45:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:44610/0 (socket says 172.21.15.82:44610) 2024-06-06T02:45:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.799+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:55508/0 (socket says 172.21.15.82:55508) 2024-06-06T02:45:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.800+0000 7fbe3aa00640 1 -- 172.21.15.82:0/609459614 learned_addr learned my addr 172.21.15.82:0/609459614 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.800+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c11d930 con 0x7fbe3c10a280 2024-06-06T02:45:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.800+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c11d7b0 con 0x7fbe3c109930 2024-06-06T02:45:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.800+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c11dab0 con 0x7fbe3c117ca0 2024-06-06T02:45:41.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.802+0000 7fbe3aa00640 1 -- 172.21.15.82:0/609459614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 msgr2=0x7fbe3c115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.802+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.803+0000 7fbe3aa00640 1 -- 172.21.15.82:0/609459614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 msgr2=0x7fbe3c1149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.804+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.804+0000 7fbe3aa00640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c1a9e10 con 0x7fbe3c10a280 2024-06-06T02:45:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.804+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800e9f0 tx=0x7fbe2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.805+0000 7fbe3b400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.805+0000 7fbe33e00640 1 -- 172.21.15.82:0/609459614 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800ccc0 con 0x7fbe3c10a280 2024-06-06T02:45:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.805+0000 7fbe33e00640 1 -- 172.21.15.82:0/609459614 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe280108e0 con 0x7fbe3c10a280 2024-06-06T02:45:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.805+0000 7fbe33e00640 1 -- 172.21.15.82:0/609459614 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28018880 con 0x7fbe3c10a280 2024-06-06T02:45:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.805+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c1aa100 con 0x7fbe3c10a280 2024-06-06T02:45:41.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.806+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c1aa5f0 con 0x7fbe3c10a280 2024-06-06T02:45:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.814+0000 7fbe33e00640 1 -- 172.21.15.82:0/609459614 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fbe28018a20 con 0x7fbe3c10a280 2024-06-06T02:45:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.816+0000 7fbe33e00640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 0x7fbe200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.817+0000 7fbe33e00640 1 -- 172.21.15.82:0/609459614 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbe280e3550 con 0x7fbe3c10a280 2024-06-06T02:45:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.818+0000 7fbe3b400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 0x7fbe200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.835+0000 7fbe3b400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 0x7fbe200b4ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c074590 tx=0x7fbe2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.839+0000 7fbe48a84740 1 Processor -- start 2024-06-06T02:45:41.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.839+0000 7fbe48a84740 1 -- start start 2024-06-06T02:45:41.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 0x559e19c6d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c6de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559e19be1e20 con 0x559e198c7070 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559e19bd13c0 con 0x559e1989e1b0 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.840+0000 7fbe48a84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559e19bd5400 con 0x559e198a6390 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.841+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.841+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56316/0 (socket says 172.21.15.82:56316) 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.841+0000 7fbe3b400640 1 -- 172.21.15.82:0/2502407895 learned_addr learned my addr 172.21.15.82:0/2502407895 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.842+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 0x559e19c6d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.842+0000 7fbe3be00640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c6de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.843+0000 7fbe3aa00640 1 -- 172.21.15.82:0/2502407895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 msgr2=0x559e19c6de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.843+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c6de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.843+0000 7fbe3aa00640 1 -- 172.21.15.82:0/2502407895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 msgr2=0x559e19c6d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.843+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.844+0000 7fbe3aa00640 1 -- 172.21.15.82:0/2502407895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e19932650 con 0x559e1989e1b0 2024-06-06T02:45:41.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.844+0000 7fbe3b400640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.844+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 0x559e19c6d8c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe280aa830 tx=0x7fbe2800ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a775d56bb44dcf3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.845+0000 7fbe30c00640 1 -- 172.21.15.82:0/2502407895 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280abe60 con 0x559e1989e1b0 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.845+0000 7fbe30c00640 1 -- 172.21.15.82:0/2502407895 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe280b32c0 con 0x559e1989e1b0 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.845+0000 7fbe30c00640 1 -- 172.21.15.82:0/2502407895 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe280e3110 con 0x559e1989e1b0 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 -- 172.21.15.82:0/2502407895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 msgr2=0x559e19c6d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 0x559e19c6d8c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe280aa830 tx=0x7fbe2800ce60 comp rx=0 tx=0).stop 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 -- 172.21.15.82:0/2502407895 shutdown_connections 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c6de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e1989e1b0 0x559e19c6d8c0 secure :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe280aa830 tx=0x7fbe2800ce60 comp rx=0 tx=0).stop 2024-06-06T02:45:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 --2- 172.21.15.82:0/2502407895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c6d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.846+0000 7fbe48a84740 1 -- 172.21.15.82:0/2502407895 >> 172.21.15.82:0/2502407895 conn(0x559e198bb460 msgr2=0x559e19c69bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.847+0000 7fbe48a84740 1 -- 172.21.15.82:0/2502407895 shutdown_connections 2024-06-06T02:45:41.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.848+0000 7fbe48a84740 1 -- 172.21.15.82:0/2502407895 wait complete. 2024-06-06T02:45:41.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.848+0000 7fbe48a84740 1 -- start start 2024-06-06T02:45:41.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.849+0000 7fbe48a84740 1 Processor -- start 2024-06-06T02:45:41.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198859f0 0x559e19c77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559e19a35700 con 0x559e198859f0 2024-06-06T02:45:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559e19b6e720 con 0x559e198c7070 2024-06-06T02:45:41.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x559e19c7a430 con 0x559e198a6390 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.850+0000 7fbe48a84740 10 client.0 _ll_register_callbacks cb 0x559e19b7ade0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.851+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.851+0000 7fbe3b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52880/0 (socket says 172.21.15.82:52880) 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.851+0000 7fbe3b400640 1 -- 172.21.15.82:0/1794037325 learned_addr learned my addr 172.21.15.82:0/1794037325 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.851+0000 7fbe3be00640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198859f0 0x559e19c77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3b400640 1 -- 172.21.15.82:0/1794037325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 msgr2=0x559e19c799b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3b400640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c799b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3b400640 1 -- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198859f0 msgr2=0x559e19c77950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3b400640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198859f0 0x559e19c77950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.852+0000 7fbe3b400640 1 -- 172.21.15.82:0/1794037325 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e19b99fd0 con 0x559e198a6390 2024-06-06T02:45:41.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.853+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:45:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.855+0000 7fbe3b400640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004410 tx=0x7fbe2c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d7d0c106353445a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.855+0000 7fbe25600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.855+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c016070 con 0x559e198a6390 2024-06-06T02:45:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.856+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbe2c010840 con 0x559e198a6390 2024-06-06T02:45:41.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.856+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe280b32c0 con 0x559e198a6390 2024-06-06T02:45:41.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.857+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe2c010a40 con 0x559e198a6390 2024-06-06T02:45:41.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.857+0000 7fbe48a84740 10 client.26107 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:41.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.857+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e19c866a0 con 0x559e198a6390 2024-06-06T02:45:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.857+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe280b32c0 con 0x559e198a6390 2024-06-06T02:45:41.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.858+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fbe2c025070 con 0x559e198a6390 2024-06-06T02:45:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 10 client.26107 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 10 client.26107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 20 client.26107 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:41.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e1985ada0 0x559e19c89b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 4 client.26107 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:45:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e19be3d70 con 0x559e1985ada0 2024-06-06T02:45:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.860+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e1985ada0 0x559e19c89b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.862+0000 7fbe25600640 10 client.26107 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:41.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.862+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e1985ada0 0x559e19c89b30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e3024257c6b5c9c server_cookie=f672c12bf60929a6 in_seq=0 out_seq=0 2024-06-06T02:45:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe25600640 1 -- 172.21.15.82:0/1794037325 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559e19be3d70 con 0x559e1985ada0 2024-06-06T02:45:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe25600640 10 client.26107 handle_command_reply: tid=0 2024-06-06T02:45:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 client.26107 shutdown 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 msgr2=0x559e19c79410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004410 tx=0x7fbe2c004730 comp rx=0 tx=0).stop 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 shutdown_connections 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e1985ada0 0x559e19c89b30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe25600640 0 client.26107 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198859f0 0x559e19c77950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c799b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 --2- 172.21.15.82:0/1794037325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198a6390 0x559e19c79410 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.864+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 >> 172.21.15.82:0/1794037325 conn(0x559e198bb460 msgr2=0x559e19c6d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.865+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 shutdown_connections 2024-06-06T02:45:41.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.865+0000 7fbe48a84740 1 -- 172.21.15.82:0/1794037325 wait complete. 2024-06-06T02:45:41.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.867+0000 7fbe48a84740 20 client.26107 trim_cache size 0 max 16384 2024-06-06T02:45:41.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.904+0000 7fbe48a84740 1 Processor -- start 2024-06-06T02:45:41.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.904+0000 7fbe48a84740 1 -- start start 2024-06-06T02:45:41.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 0x559e19c77e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c8f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 0x559e19c70f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c87a0 con 0x559e198c7070 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c6070 con 0x559e198859f0 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe48a84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c3ea0 con 0x559e19c8f870 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.905+0000 7fbe3be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 0x559e19c70f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.906+0000 7fbe3be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 0x559e19c70f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52894/0 (socket says 172.21.15.82:52894) 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.906+0000 7fbe3be00640 1 -- 172.21.15.82:0/3644931050 learned_addr learned my addr 172.21.15.82:0/3644931050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.906+0000 7fbe3b400640 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 0x559e19c77e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.906+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c8f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.907+0000 7fbe3b400640 1 -- 172.21.15.82:0/3644931050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 msgr2=0x559e19c70f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.907+0000 7fbe3b400640 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 0x559e19c70f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.907+0000 7fbe3b400640 1 -- 172.21.15.82:0/3644931050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 msgr2=0x559e19c8f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.907+0000 7fbe3b400640 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c8f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.907+0000 7fbe3b400640 1 -- 172.21.15.82:0/3644931050 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e19c75ea0 con 0x559e198859f0 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.908+0000 7fbe3b400640 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 0x559e19c77e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c018000 tx=0x7fbe2c00acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55fb061c4ed9781 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.908+0000 7fbe27e00640 1 -- 172.21.15.82:0/3644931050 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c010640 con 0x559e198859f0 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.908+0000 7fbe27e00640 1 -- 172.21.15.82:0/3644931050 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe2c036020 con 0x559e198859f0 2024-06-06T02:45:41.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.908+0000 7fbe27e00640 1 -- 172.21.15.82:0/3644931050 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c027440 con 0x559e198859f0 2024-06-06T02:45:41.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.911+0000 7fbe48a84740 1 -- 172.21.15.82:0/3644931050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 msgr2=0x559e19c77e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.911+0000 7fbe48a84740 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 0x559e19c77e80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c018000 tx=0x7fbe2c00acf0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 -- 172.21.15.82:0/3644931050 shutdown_connections 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e19c8f870 0x559e19c70f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e198c7070 0x559e19c8f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 --2- 172.21.15.82:0/3644931050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198859f0 0x559e19c77e80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 -- 172.21.15.82:0/3644931050 >> 172.21.15.82:0/3644931050 conn(0x559e198bb460 msgr2=0x559e19c77770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.912+0000 7fbe48a84740 1 -- 172.21.15.82:0/3644931050 shutdown_connections 2024-06-06T02:45:41.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.913+0000 7fbe48a84740 1 -- 172.21.15.82:0/3644931050 wait complete. 2024-06-06T02:45:41.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.915+0000 7fbe48a84740 1 -- start start 2024-06-06T02:45:41.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.916+0000 7fbe48a84740 1 Processor -- start 2024-06-06T02:45:41.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 0x559e19c7f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e19c8f870 0x559e19c7dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c4530 con 0x559e19c8f870 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c59a0 con 0x559e198c7070 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c1c4c00 con 0x559e198859f0 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe48a84740 10 client.0 _ll_register_callbacks cb 0x7fbe2c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe3aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:43040/0 (socket says 172.21.15.82:43040) 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe3aa00640 1 -- 172.21.15.82:0/840760212 learned_addr learned my addr 172.21.15.82:0/840760212 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe3b400640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 0x559e19c7f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.917+0000 7fbe3be00640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e19c8f870 0x559e19c7dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.918+0000 7fbe3b400640 1 -- 172.21.15.82:0/840760212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 msgr2=0x559e19c7fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.918+0000 7fbe3b400640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.918+0000 7fbe3b400640 1 -- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e19c8f870 msgr2=0x559e19c7dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.919+0000 7fbe3b400640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e19c8f870 0x559e19c7dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.919+0000 7fbe3b400640 1 -- 172.21.15.82:0/840760212 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e19c7e370 con 0x559e198859f0 2024-06-06T02:45:41.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.919+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:41.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.922+0000 7fbe3b400640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 0x559e19c7f8d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c018000 tx=0x7fbe2c010870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a282ad13d99c0f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:41.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.922+0000 7fbe25600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.923+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c03f070 con 0x559e198859f0 2024-06-06T02:45:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.923+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe2c036020 con 0x559e198859f0 2024-06-06T02:45:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.923+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fbe2c031680 con 0x559e198859f0 2024-06-06T02:45:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.924+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe2c016040 con 0x559e198859f0 2024-06-06T02:45:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.924+0000 7fbe48a84740 10 client.26113 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:41.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.924+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e19cf2d00 con 0x559e198859f0 2024-06-06T02:45:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe2c036020 con 0x559e198859f0 2024-06-06T02:45:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fbe2c042030 con 0x559e198859f0 2024-06-06T02:45:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 10 client.26113 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:41.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 10 client.26113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 20 client.26113 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e19cf3320 0x559e19cf5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 4 client.26113 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:45:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.927+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e19bdf810 con 0x559e19cf3320 2024-06-06T02:45:41.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.928+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e19cf3320 0x559e19cf5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:41.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.929+0000 7fbe25600640 10 client.26113 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:41.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.933+0000 7fbe3aa00640 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e19cf3320 0x559e19cf5740 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a576bdbb976c819d server_cookie=5226ad8409fa0f05 in_seq=0 out_seq=0 2024-06-06T02:45:41.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.934+0000 7fbe25600640 1 -- 172.21.15.82:0/840760212 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x559e19bdf810 con 0x559e19cf3320 2024-06-06T02:45:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.934+0000 7fbe25600640 10 client.26113 handle_command_reply: tid=0 2024-06-06T02:45:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.934+0000 7fbe48a84740 1 client.26113 shutdown 2024-06-06T02:45:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.935+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 msgr2=0x559e19c7f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.935+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 0x559e19c7f8d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c018000 tx=0x7fbe2c010870 comp rx=0 tx=0).stop 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.935+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 shutdown_connections 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.935+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x559e19cf3320 0x559e19cf5740 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e19c8f870 0x559e19c7dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe25600640 0 client.26113 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559e198c7070 0x559e19c7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 --2- 172.21.15.82:0/840760212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559e198859f0 0x559e19c7f8d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 >> 172.21.15.82:0/840760212 conn(0x559e198bb460 msgr2=0x559e19c70f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 shutdown_connections 2024-06-06T02:45:41.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.936+0000 7fbe48a84740 1 -- 172.21.15.82:0/840760212 wait complete. 2024-06-06T02:45:41.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.940+0000 7fbe48a84740 20 client.26113 trim_cache size 0 max 16384 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (43 inodes in the stack)", 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "72912f9e-c74e-4d3e-8f13-163c4d2f6c40": { 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "72912f9e-c74e-4d3e-8f13-163c4d2f6c40", 2024-06-06T02:45:41.941 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-06-06T02:45:41.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:45:41.942 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:45:41.942 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:45:41.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 msgr2=0x7fbe200b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 0x7fbe200b4ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c074590 tx=0x7fbe2c005f90 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 msgr2=0x7fbe3c114ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800e9f0 tx=0x7fbe2800eeb0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 shutdown_connections 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fbe200b29c0 0x7fbe200b4ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe3c117ca0 0x7fbe3c115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe3c10a280 0x7fbe3c114ef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 --2- 172.21.15.82:0/609459614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe3c109930 0x7fbe3c1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:41.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.942+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 >> 172.21.15.82:0/609459614 conn(0x7fbe3c06df60 msgr2=0x7fbe3c1180b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:41.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.943+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 shutdown_connections 2024-06-06T02:45:41.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:45:41.943+0000 7fbe42400640 1 -- 172.21.15.82:0/609459614 wait complete. 2024-06-06T02:45:42.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:42 smithi103 ceph-mon[36349]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 73 MiB/s wr, 11.78k op/s 2024-06-06T02:45:42.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:42 smithi082 ceph-mon[31579]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 73 MiB/s wr, 11.78k op/s 2024-06-06T02:45:42.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:42 smithi184 ceph-mon[36922]: pgmap v683: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 73 MiB/s wr, 11.78k op/s 2024-06-06T02:45:44.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:44 smithi103 ceph-mon[36349]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 77 MiB/s wr, 12.60k op/s 2024-06-06T02:45:44.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:44 smithi082 ceph-mon[31579]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 77 MiB/s wr, 12.60k op/s 2024-06-06T02:45:44.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:44 smithi184 ceph-mon[36922]: pgmap v684: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 77 MiB/s wr, 12.60k op/s 2024-06-06T02:45:46.085 INFO:tasks.cephfs.filesystem:scrub status for tag:72912f9e-c74e-4d3e-8f13-163c4d2f6c40 - {'path': '/', 'tag': '72912f9e-c74e-4d3e-8f13-163c4d2f6c40', 'options': 'recursive,force'} 2024-06-06T02:45:46.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:46 smithi103 ceph-mon[36349]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 81 MiB/s wr, 13.43k op/s 2024-06-06T02:45:46.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:46 smithi082 ceph-mon[31579]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 81 MiB/s wr, 13.43k op/s 2024-06-06T02:45:46.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:46 smithi184 ceph-mon[36922]: pgmap v685: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 81 MiB/s wr, 13.43k op/s 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.952+0000 7f3675600640 1 -- 172.21.15.82:0/3752098292 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640309b0 con 0x7f367810a920 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.952+0000 7f3677e00640 1 -- 172.21.15.82:0/3752098292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f367810a920 msgr2=0x7f367810ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.952+0000 7f3677e00640 1 --2- 172.21.15.82:0/3752098292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f367810a920 0x7f367810ad30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f366400aa10 tx=0x7f366402b720 comp rx=0 tx=0).stop 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.953+0000 7f3677e00640 1 -- 172.21.15.82:0/3752098292 shutdown_connections 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.953+0000 7f3677e00640 1 --2- 172.21.15.82:0/3752098292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f3678111c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.953+0000 7f3677e00640 1 --2- 172.21.15.82:0/3752098292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f367810a920 0x7f367810ad30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.953+0000 7f3677e00640 1 --2- 172.21.15.82:0/3752098292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3678109b30 0x7f3678109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.953+0000 7f3677e00640 1 -- 172.21.15.82:0/3752098292 >> 172.21.15.82:0/3752098292 conn(0x7f367806fe10 msgr2=0x7f36780722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.955+0000 7f3677e00640 1 -- 172.21.15.82:0/3752098292 shutdown_connections 2024-06-06T02:45:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.955+0000 7f3677e00640 1 -- 172.21.15.82:0/3752098292 wait complete. 2024-06-06T02:45:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.955+0000 7f3677e00640 1 Processor -- start 2024-06-06T02:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.955+0000 7f3677e00640 1 -- start start 2024-06-06T02:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.956+0000 7f3677e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.956+0000 7f3677e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f367810a920 0x7f367819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.956+0000 7f3676a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3676a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52936/0 (socket says 172.21.15.82:52936) 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3677e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f367819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3677e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3678114ba0 con 0x7f367810a920 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3677e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3678114a20 con 0x7f367810b270 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3677e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3678114d20 con 0x7f3678109b30 2024-06-06T02:45:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3676a00640 1 -- 172.21.15.82:0/3221255605 learned_addr learned my addr 172.21.15.82:0/3221255605 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.957+0000 7f3677400640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f367819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676000640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f367810a920 0x7f367819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 -- 172.21.15.82:0/3221255605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 msgr2=0x7f367819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f367819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 -- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f367810a920 msgr2=0x7f367819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f367810a920 0x7f367819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 -- 172.21.15.82:0/3221255605 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36781a00b0 con 0x7f3678109b30 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3677400640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f367819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.958+0000 7f3676a00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f367000cce0 tx=0x7f367000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.960+0000 7f366f400640 1 -- 172.21.15.82:0/3221255605 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367000f450 con 0x7f3678109b30 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.960+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36781aba00 con 0x7f3678109b30 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.960+0000 7f366f400640 1 -- 172.21.15.82:0/3221255605 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f367000faa0 con 0x7f3678109b30 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.960+0000 7f366f400640 1 -- 172.21.15.82:0/3221255605 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670018ae0 con 0x7f3678109b30 2024-06-06T02:45:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.960+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36781abe00 con 0x7f3678109b30 2024-06-06T02:45:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 Processor -- start 2024-06-06T02:45:47.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 -- start start 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 0x55a55dd14f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9472f0 0x55a55dd15480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a55dc87480 con 0x55a55d9472f0 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a55dc76a20 con 0x55a55d94f4d0 2024-06-06T02:45:47.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.969+0000 7f3684a3d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a55dc7aa60 con 0x55a55d9701b0 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.970+0000 7f3677400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 0x55a55dd14f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.970+0000 7f3677400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 0x55a55dd14f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52948/0 (socket says 172.21.15.82:52948) 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.970+0000 7f3677400640 1 -- 172.21.15.82:0/1182610067 learned_addr learned my addr 172.21.15.82:0/1182610067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.970+0000 7f366f400640 1 -- 172.21.15.82:0/3221255605 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f367000f5f0 con 0x7f3678109b30 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.970+0000 7f3676000640 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676a00640 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9472f0 0x55a55dd15480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676000640 1 -- 172.21.15.82:0/1182610067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 msgr2=0x55a55dd14f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676000640 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 0x55a55dd14f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676000640 1 -- 172.21.15.82:0/1182610067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9472f0 msgr2=0x55a55dd15480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676000640 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9472f0 0x55a55dd15480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.972+0000 7f3676000640 1 -- 172.21.15.82:0/1182610067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55dc738d0 con 0x55a55d94f4d0 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f366f400640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 0x7f365c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f3676000640 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1c340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3664006010 tx=0x7f3664030d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad598234e99eb01 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f366f400640 1 -- 172.21.15.82:0/3221255605 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f36700e2620 con 0x7f3678109b30 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f3677400640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 0x7f365c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f3663e00640 1 -- 172.21.15.82:0/1182610067 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664040070 con 0x55a55d94f4d0 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.976+0000 7f3663e00640 1 -- 172.21.15.82:0/1182610067 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36640308b0 con 0x55a55d94f4d0 2024-06-06T02:45:47.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.978+0000 7f3663e00640 1 -- 172.21.15.82:0/1182610067 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3664036040 con 0x55a55d94f4d0 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- 172.21.15.82:0/1182610067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 msgr2=0x55a55dd1c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1c340 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3664006010 tx=0x7f3664030d90 comp rx=0 tx=0).stop 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3677400640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 0x7f365c0b4df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3668004230 tx=0x7f366800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- 172.21.15.82:0/1182610067 shutdown_connections 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1c340 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9472f0 0x55a55dd15480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.980 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 --2- 172.21.15.82:0/1182610067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9701b0 0x55a55dd14f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- 172.21.15.82:0/1182610067 >> 172.21.15.82:0/1182610067 conn(0x55a55d964300 msgr2=0x55a55dd108f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- 172.21.15.82:0/1182610067 shutdown_connections 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- 172.21.15.82:0/1182610067 wait complete. 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.979+0000 7f3684a3d740 1 -- start start 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.980+0000 7f3684a3d740 1 Processor -- start 2024-06-06T02:45:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.982+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9701b0 0x55a55dd25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a55dbb1ab0 con 0x55a55d9701b0 2024-06-06T02:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a55dc14630 con 0x55a55d94f4d0 2024-06-06T02:45:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55a55dd1cd00 con 0x55a55d9472f0 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3684a3d740 10 client.0 _ll_register_callbacks cb 0x55a55dc1a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.983+0000 7f3676a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52950/0 (socket says 172.21.15.82:52950) 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676a00640 1 -- 172.21.15.82:0/2470833719 learned_addr learned my addr 172.21.15.82:0/2470833719 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676000640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3677400640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9701b0 0x55a55dd25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676a00640 1 -- 172.21.15.82:0/2470833719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 msgr2=0x55a55dd1eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676a00640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.984+0000 7f3676a00640 1 -- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9701b0 msgr2=0x55a55dd25a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.985+0000 7f3676a00640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9701b0 0x55a55dd25a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.985+0000 7f3676a00640 1 -- 172.21.15.82:0/2470833719 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55dc41170 con 0x55a55d9472f0 2024-06-06T02:45:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3676a00640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f367000ffb0 tx=0x7f36700a9a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65856aca9e382e6a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3660c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670091070 con 0x55a55d9472f0 2024-06-06T02:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3670018c80 con 0x55a55d9472f0 2024-06-06T02:45:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36640308b0 con 0x55a55d9472f0 2024-06-06T02:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f367000f8e0 con 0x55a55d9472f0 2024-06-06T02:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3684a3d740 10 client.26125 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.986+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a55d9db790 con 0x55a55d9472f0 2024-06-06T02:45:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.988+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36640308b0 con 0x55a55d9472f0 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.989+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f36700b25d0 con 0x55a55d9472f0 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.989+0000 7f3684a3d740 10 client.26125 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.989+0000 7f3684a3d740 10 client.26125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.989+0000 7f3684a3d740 20 client.26125 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.990+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d92ed80 0x55a55dd2bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.990+0000 7f3684a3d740 4 client.26125 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:45:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.990+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a55dc893d0 con 0x55a55d92ed80 2024-06-06T02:45:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.990+0000 7f3676000640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d92ed80 0x55a55dd2bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.992+0000 7f3676000640 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d92ed80 0x55a55dd2bd60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e3886edc9637d82 server_cookie=683c02f356dce667 in_seq=0 out_seq=0 2024-06-06T02:45:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.992+0000 7f3660c00640 10 client.26125 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.993+0000 7f3660c00640 1 -- 172.21.15.82:0/2470833719 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a55dc893d0 con 0x55a55d92ed80 2024-06-06T02:45:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.993+0000 7f3660c00640 10 client.26125 handle_command_reply: tid=0 2024-06-06T02:45:47.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.993+0000 7f3684a3d740 1 client.26125 shutdown 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 msgr2=0x55a55dd1e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f367000ffb0 tx=0x7f36700a9a90 comp rx=0 tx=0).stop 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 shutdown_connections 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d92ed80 0x55a55dd2bd60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d9701b0 0x55a55dd25a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d94f4d0 0x55a55dd1eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 --2- 172.21.15.82:0/2470833719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd1e5e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 >> 172.21.15.82:0/2470833719 conn(0x55a55d964300 msgr2=0x55a55dd117f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:47.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.994+0000 7f3660c00640 0 client.26125 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.995+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 shutdown_connections 2024-06-06T02:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.995+0000 7f3684a3d740 1 -- 172.21.15.82:0/2470833719 wait complete. 2024-06-06T02:45:47.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:47.997+0000 7f3684a3d740 20 client.26125 trim_cache size 0 max 16384 2024-06-06T02:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.032+0000 7f3684a3d740 1 Processor -- start 2024-06-06T02:45:48.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.032+0000 7f3684a3d740 1 -- start start 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 0x55a55dd1ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d94f4d0 0x55a55dd116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b73a0 con 0x55a55d94f4d0 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b4c70 con 0x55a55d964300 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3684a3d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b2aa0 con 0x55a55d9472f0 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3676000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3676a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 0x55a55dd1ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3676000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:52956/0 (socket says 172.21.15.82:52956) 2024-06-06T02:45:48.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3676000640 1 -- 172.21.15.82:0/3917303409 learned_addr learned my addr 172.21.15.82:0/3917303409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.033+0000 7f3677400640 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d94f4d0 0x55a55dd116b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 -- 172.21.15.82:0/3917303409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 msgr2=0x55a55dd259a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 -- 172.21.15.82:0/3917303409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d94f4d0 msgr2=0x55a55dd116b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d94f4d0 0x55a55dd116b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 -- 172.21.15.82:0/3917303409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55dd1d9a0 con 0x55a55d964300 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676000640 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:45:48.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.034+0000 7f3676a00640 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 0x55a55dd1ea60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36700a9b90 tx=0x7f3670000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3036a14a645473ca server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.035+0000 7f3663400640 1 -- 172.21.15.82:0/3917303409 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670091070 con 0x55a55d964300 2024-06-06T02:45:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.035+0000 7f3663400640 1 -- 172.21.15.82:0/3917303409 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36700a9710 con 0x55a55d964300 2024-06-06T02:45:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.035+0000 7f3663400640 1 -- 172.21.15.82:0/3917303409 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670018c80 con 0x55a55d964300 2024-06-06T02:45:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.036+0000 7f3684a3d740 1 -- 172.21.15.82:0/3917303409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 msgr2=0x55a55dd1ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:48.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.036+0000 7f3684a3d740 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 0x55a55dd1ea60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36700a9b90 tx=0x7f3670000f40 comp rx=0 tx=0).stop 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.037+0000 7f3684a3d740 1 -- 172.21.15.82:0/3917303409 shutdown_connections 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.037+0000 7f3684a3d740 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d94f4d0 0x55a55dd116b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.037+0000 7f3684a3d740 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d9472f0 0x55a55dd259a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.037+0000 7f3684a3d740 1 --2- 172.21.15.82:0/3917303409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d964300 0x55a55dd1ea60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.037+0000 7f3684a3d740 1 -- 172.21.15.82:0/3917303409 >> 172.21.15.82:0/3917303409 conn(0x55a55dd1df10 msgr2=0x55a55dd1e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.038+0000 7f3684a3d740 1 -- 172.21.15.82:0/3917303409 shutdown_connections 2024-06-06T02:45:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.038+0000 7f3684a3d740 1 -- 172.21.15.82:0/3917303409 wait complete. 2024-06-06T02:45:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.038+0000 7f3684a3d740 1 -- start start 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.039+0000 7f3684a3d740 1 Processor -- start 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 0x55a55dd22c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d94f4d0 0x55a55dd231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b3130 con 0x55a55d964300 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b45a0 con 0x55a55d9472f0 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f36781b3800 con 0x55a55d94f4d0 2024-06-06T02:45:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.041+0000 7f3684a3d740 10 client.0 _ll_register_callbacks cb 0x7f36700a5ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:45:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.042+0000 7f3677400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.042+0000 7f3677400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56392/0 (socket says 172.21.15.82:56392) 2024-06-06T02:45:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.042+0000 7f3677400640 1 -- 172.21.15.82:0/486042258 learned_addr learned my addr 172.21.15.82:0/486042258 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:45:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.042+0000 7f3676a00640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 0x55a55dd22c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.042+0000 7f3676000640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d94f4d0 0x55a55dd231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3677400640 1 -- 172.21.15.82:0/486042258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d94f4d0 msgr2=0x55a55dd231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3677400640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d94f4d0 0x55a55dd231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3677400640 1 -- 172.21.15.82:0/486042258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 msgr2=0x55a55dd22c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3677400640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 0x55a55dd22c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3677400640 1 -- 172.21.15.82:0/486042258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a55da54620 con 0x55a55d964300 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.043+0000 7f3676a00640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 0x55a55dd22c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:45:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.044+0000 7f3677400640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3668012780 tx=0x7f36680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19046585fb39460c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:45:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.044+0000 7f3660c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:45:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.045+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366802c060 con 0x55a55d964300 2024-06-06T02:45:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.045+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36700a9710 con 0x55a55d964300 2024-06-06T02:45:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.046+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f3668010be0 con 0x55a55d964300 2024-06-06T02:45:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.046+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3668010de0 con 0x55a55d964300 2024-06-06T02:45:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.046+0000 7f3684a3d740 10 client.15768 fetch_fsmap learned FSMap version 29 2024-06-06T02:45:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.046+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a55dd25830 con 0x55a55d964300 2024-06-06T02:45:48.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.050+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36700a9710 con 0x55a55d964300 2024-06-06T02:45:48.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.051+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7f3668031070 con 0x55a55d964300 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.051+0000 7f3684a3d740 10 client.15768 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.051+0000 7f3684a3d740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.051+0000 7f3684a3d740 20 client.15768 populate_metadata read hostname 'smithi082' 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.051+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d9701b0 0x55a55dd9f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.052+0000 7f3684a3d740 4 client.15768 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.052+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a55dc84e70 con 0x55a55d9701b0 2024-06-06T02:45:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.053+0000 7f3676a00640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d9701b0 0x55a55dd9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.054+0000 7f3676a00640 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d9701b0 0x55a55dd9f080 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=445bd63a412ce77b server_cookie=691c88dc7c4a194d in_seq=0 out_seq=0 2024-06-06T02:45:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:48.054+0000 7f3660c00640 10 client.15768 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:48.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:48 smithi103 ceph-mon[36349]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 82 MiB/s wr, 13.85k op/s 2024-06-06T02:45:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:48 smithi082 ceph-mon[31579]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 82 MiB/s wr, 13.85k op/s 2024-06-06T02:45:48.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:48 smithi184 ceph-mon[36922]: pgmap v686: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 82 MiB/s wr, 13.85k op/s 2024-06-06T02:45:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.252+0000 7f3660c00640 1 -- 172.21.15.82:0/486042258 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a55dc84e70 con 0x55a55d9701b0 2024-06-06T02:45:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.252+0000 7f3660c00640 10 client.15768 handle_command_reply: tid=0 2024-06-06T02:45:49.252 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.252+0000 7f3684a3d740 1 client.15768 shutdown 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 msgr2=0x55a55dd24060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3668012780 tx=0x7f36680046c0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 shutdown_connections 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55a55d9701b0 0x55a55dd9f080 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a55d964300 0x55a55dd24060 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a55d94f4d0 0x55a55dd231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 --2- 172.21.15.82:0/486042258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a55d9472f0 0x55a55dd22c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 >> 172.21.15.82:0/486042258 conn(0x55a55dd1df10 msgr2=0x55a55dd11650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:49.253 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.253+0000 7f3660c00640 0 client.15768 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.254+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 shutdown_connections 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.254+0000 7f3684a3d740 1 -- 172.21.15.82:0/486042258 wait complete. 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.255+0000 7f3684a3d740 20 client.15768 trim_cache size 0 max 16384 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:45:49.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:45:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:45:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.255+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 msgr2=0x7f365c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:49.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.255+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 0x7f365c0b4df0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3668004230 tx=0x7f366800b2e0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 msgr2=0x7f36781a0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f367000cce0 tx=0x7f367000a620 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 shutdown_connections 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f367810b270 0x7f367819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f367810a920 0x7f367819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f365c0b28e0 0x7f365c0b4df0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 --2- 172.21.15.82:0/3221255605 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3678109b30 0x7f36781a0e30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 >> 172.21.15.82:0/3221255605 conn(0x7f367806fe10 msgr2=0x7f367810dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 shutdown_connections 2024-06-06T02:45:49.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:45:49.256+0000 7f3677e00640 1 -- 172.21.15.82:0/3221255605 wait complete. 2024-06-06T02:45:50.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:50 smithi103 ceph-mon[36349]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 13.41k op/s 2024-06-06T02:45:50.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:50 smithi082 ceph-mon[31579]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 13.41k op/s 2024-06-06T02:45:50.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:50 smithi184 ceph-mon[36922]: pgmap v687: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 78 MiB/s wr, 13.41k op/s 2024-06-06T02:45:52.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:52 smithi103 ceph-mon[36349]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 81 MiB/s wr, 14.21k op/s 2024-06-06T02:45:52.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:52 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:45:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:52 smithi082 ceph-mon[31579]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 81 MiB/s wr, 14.21k op/s 2024-06-06T02:45:52.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:52 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:45:52.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:52 smithi184 ceph-mon[36922]: pgmap v688: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 81 MiB/s wr, 14.21k op/s 2024-06-06T02:45:52.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:52 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:45:54.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:54 smithi103 ceph-mon[36349]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 75 MiB/s wr, 13.69k op/s 2024-06-06T02:45:54.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:54 smithi082 ceph-mon[31579]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 75 MiB/s wr, 13.69k op/s 2024-06-06T02:45:54.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:54 smithi184 ceph-mon[36922]: pgmap v689: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 75 MiB/s wr, 13.69k op/s 2024-06-06T02:45:56.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:56 smithi103 ceph-mon[36349]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 72 MiB/s wr, 13.40k op/s 2024-06-06T02:45:56.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:45:56.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:45:56.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:45:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:56 smithi082 ceph-mon[31579]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 72 MiB/s wr, 13.40k op/s 2024-06-06T02:45:56.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:45:56.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:45:56.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:45:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:56 smithi184 ceph-mon[36922]: pgmap v690: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 72 MiB/s wr, 13.40k op/s 2024-06-06T02:45:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:45:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:45:56.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:45:58.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:45:58 smithi103 ceph-mon[36349]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 76 MiB/s wr, 14.41k op/s 2024-06-06T02:45:58.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:45:58 smithi082 ceph-mon[31579]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 76 MiB/s wr, 14.41k op/s 2024-06-06T02:45:58.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:45:58 smithi184 ceph-mon[36922]: pgmap v691: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 76 MiB/s wr, 14.41k op/s 2024-06-06T02:46:00.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:00 smithi103 ceph-mon[36349]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 67 MiB/s wr, 12.78k op/s 2024-06-06T02:46:00.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:00 smithi082 ceph-mon[31579]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 67 MiB/s wr, 12.78k op/s 2024-06-06T02:46:00.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:00 smithi184 ceph-mon[36922]: pgmap v692: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 67 MiB/s wr, 12.78k op/s 2024-06-06T02:46:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.591+0000 7fb183600640 1 -- 172.21.15.82:0/1244293041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c108960 msgr2=0x7fb17c10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.591+0000 7fb183600640 1 --2- 172.21.15.82:0/1244293041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c108960 0x7fb17c10ad80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb164009900 tx=0x7fb16402a420 comp rx=0 tx=0).stop 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 -- 172.21.15.82:0/1244293041 shutdown_connections 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 --2- 172.21.15.82:0/1244293041 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c108960 0x7fb17c10ad80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 --2- 172.21.15.82:0/1244293041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c106000 0x7fb17c108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 --2- 172.21.15.82:0/1244293041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c1036a0 0x7fb17c105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 -- 172.21.15.82:0/1244293041 >> 172.21.15.82:0/1244293041 conn(0x7fb17c0fd2d0 msgr2=0x7fb17c0ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 -- 172.21.15.82:0/1244293041 shutdown_connections 2024-06-06T02:46:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.593+0000 7fb183600640 1 -- 172.21.15.82:0/1244293041 wait complete. 2024-06-06T02:46:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.595+0000 7fb183600640 1 Processor -- start 2024-06-06T02:46:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.595+0000 7fb183600640 1 -- start start 2024-06-06T02:46:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c1036a0 0x7fb17c197600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 0x7fb17c194150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb17be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb17be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:36398/0 (socket says 172.21.15.82:36398) 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb17be00640 1 -- 172.21.15.82:0/3840030590 learned_addr learned my addr 172.21.15.82:0/3840030590 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c10e6f0 con 0x7fb17c108960 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c10e570 con 0x7fb17c106000 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.596+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c10e870 con 0x7fb17c1036a0 2024-06-06T02:46:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb181600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 0x7fb17c194150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb180c00640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c1036a0 0x7fb17c197600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb17be00640 1 -- 172.21.15.82:0/3840030590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c1036a0 msgr2=0x7fb17c197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb17be00640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c1036a0 0x7fb17c197600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb17be00640 1 -- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 msgr2=0x7fb17c194150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb17be00640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 0x7fb17c194150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb17be00640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c194970 con 0x7fb17c106000 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.597+0000 7fb181600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 0x7fb17c194150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:46:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.598+0000 7fb17be00640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e9f0 tx=0x7fb16c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.604+0000 7fb179600640 1 -- 172.21.15.82:0/3840030590 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00cd80 con 0x7fb17c106000 2024-06-06T02:46:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.604+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17c194c60 con 0x7fb17c106000 2024-06-06T02:46:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.604+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c1a7a60 con 0x7fb17c106000 2024-06-06T02:46:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.604+0000 7fb179600640 1 -- 172.21.15.82:0/3840030590 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb16c0108e0 con 0x7fb17c106000 2024-06-06T02:46:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.604+0000 7fb179600640 1 -- 172.21.15.82:0/3840030590 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c018920 con 0x7fb17c106000 2024-06-06T02:46:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.610+0000 7fb18a590740 1 Processor -- start 2024-06-06T02:46:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.610+0000 7fb18a590740 1 -- start start 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb179600640 1 -- 172.21.15.82:0/3840030590 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb16c010430 con 0x7fb17c106000 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14ba9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 0x560d14baa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560d14b0b480 con 0x560d147cb2f0 2024-06-06T02:46:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560d14afaa20 con 0x560d147d34d0 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.611+0000 7fb18a590740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560d14afea60 con 0x560d147f41b0 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.612+0000 7fb181600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14ba9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.612+0000 7fb181600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14ba9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:59882/0 (socket says 172.21.15.82:59882) 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.612+0000 7fb181600640 1 -- 172.21.15.82:0/1354786170 learned_addr learned my addr 172.21.15.82:0/1354786170 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.613+0000 7fb180c00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 0x560d14baa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.613+0000 7fb180c00640 1 -- 172.21.15.82:0/1354786170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 msgr2=0x560d14ba9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.615+0000 7fb17be00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.615+0000 7fb180c00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14ba9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.615+0000 7fb180c00640 1 -- 172.21.15.82:0/1354786170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 msgr2=0x560d14bb1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.615+0000 7fb180c00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.615+0000 7fb180c00640 1 -- 172.21.15.82:0/1354786170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d14af78d0 con 0x560d147cb2f0 2024-06-06T02:46:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.617+0000 7fb179600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 0x7fb1600b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.617+0000 7fb17be00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:46:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.617+0000 7fb180c00640 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 0x560d14baa250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb174005fd0 tx=0x7fb174010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64727c539eb859ea server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.618+0000 7fb171c00640 1 -- 172.21.15.82:0/1354786170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174003b70 con 0x560d147cb2f0 2024-06-06T02:46:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.618+0000 7fb171c00640 1 -- 172.21.15.82:0/1354786170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb174015070 con 0x560d147cb2f0 2024-06-06T02:46:02.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.618+0000 7fb171c00640 1 -- 172.21.15.82:0/1354786170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb174011870 con 0x560d147cb2f0 2024-06-06T02:46:02.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.619+0000 7fb179600640 1 -- 172.21.15.82:0/3840030590 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb16c0e2610 con 0x7fb17c106000 2024-06-06T02:46:02.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.619+0000 7fb181600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 0x7fb1600b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 -- 172.21.15.82:0/1354786170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 msgr2=0x560d14baa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 0x560d14baa250 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb174005fd0 tx=0x7fb174010860 comp rx=0 tx=0).stop 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 -- 172.21.15.82:0/1354786170 shutdown_connections 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147cb2f0 0x560d14baa250 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 --2- 172.21.15.82:0/1354786170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14ba9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.621+0000 7fb18a590740 1 -- 172.21.15.82:0/1354786170 >> 172.21.15.82:0/1354786170 conn(0x560d147e8300 msgr2=0x560d14b946b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.622+0000 7fb18a590740 1 -- 172.21.15.82:0/1354786170 shutdown_connections 2024-06-06T02:46:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.622+0000 7fb18a590740 1 -- 172.21.15.82:0/1354786170 wait complete. 2024-06-06T02:46:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.623+0000 7fb18a590740 1 -- start start 2024-06-06T02:46:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.623+0000 7fb18a590740 1 Processor -- start 2024-06-06T02:46:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.627+0000 7fb181600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 0x7fb1600b4d70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb164009230 tx=0x7fb16400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.627+0000 7fb18a590740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14bb3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.627+0000 7fb18a590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.628+0000 7fb18a590740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb180c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14bb3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb17be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb17be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56228/0 (socket says 172.21.15.82:56228) 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb18a590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560d14a35ab0 con 0x560d147d34d0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb18a590740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560d14a98630 con 0x560d147cb2f0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb18a590740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x560d14bb1ae0 con 0x560d147f41b0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb181600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb181600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:59886/0 (socket says 172.21.15.82:59886) 2024-06-06T02:46:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb181600640 1 -- 172.21.15.82:0/4245606140 learned_addr learned my addr 172.21.15.82:0/4245606140 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.629+0000 7fb18a590740 10 client.0 _ll_register_callbacks cb 0x560d14a9e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.630+0000 7fb181600640 1 -- 172.21.15.82:0/4245606140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 msgr2=0x560d14bb3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.630+0000 7fb181600640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14bb3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.630+0000 7fb181600640 1 -- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 msgr2=0x560d14bb39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.631+0000 7fb181600640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.631+0000 7fb181600640 1 -- 172.21.15.82:0/4245606140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d14ac5170 con 0x560d147f41b0 2024-06-06T02:46:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.631+0000 7fb180c00640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14bb3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:46:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.631+0000 7fb17be00640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:46:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.632+0000 7fb181600640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb164004510 tx=0x7fb164005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e7485276e0e169 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.632+0000 7fb16a000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:46:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.632+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16404e070 con 0x560d147f41b0 2024-06-06T02:46:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.633+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb1640035f0 con 0x560d147f41b0 2024-06-06T02:46:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.633+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb174015070 con 0x560d147f41b0 2024-06-06T02:46:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.634+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb164058050 con 0x560d147f41b0 2024-06-06T02:46:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.634+0000 7fb18a590740 10 client.26143 fetch_fsmap learned FSMap version 29 2024-06-06T02:46:02.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.634+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d1485f790 con 0x560d147f41b0 2024-06-06T02:46:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.635+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb174015070 con 0x560d147f41b0 2024-06-06T02:46:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.635+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fb16404a900 con 0x560d147f41b0 2024-06-06T02:46:02.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.635+0000 7fb18a590740 10 client.26143 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.635+0000 7fb18a590740 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.636+0000 7fb18a590740 20 client.26143 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.636+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147b2d80 0x560d14bc0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.636+0000 7fb18a590740 4 client.26143 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.636+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d14b0d3d0 con 0x560d147b2d80 2024-06-06T02:46:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.636+0000 7fb180c00640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147b2d80 0x560d14bc0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.637+0000 7fb180c00640 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147b2d80 0x560d14bc0d00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdf52d735f240ded server_cookie=4bfb14687206b43e in_seq=0 out_seq=0 2024-06-06T02:46:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.637+0000 7fb16a000640 10 client.26143 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.639+0000 7fb16a000640 1 -- 172.21.15.82:0/4245606140 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560d14b0d3d0 con 0x560d147b2d80 2024-06-06T02:46:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.639+0000 7fb16a000640 10 client.26143 handle_command_reply: tid=0 2024-06-06T02:46:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.640+0000 7fb18a590740 1 client.26143 shutdown 2024-06-06T02:46:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 msgr2=0x560d14bba8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb164004510 tx=0x7fb164005fd0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 shutdown_connections 2024-06-06T02:46:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bba8b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147b2d80 0x560d14bc0d00 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bb39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 --2- 172.21.15.82:0/4245606140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14bb3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 >> 172.21.15.82:0/4245606140 conn(0x560d147e8300 msgr2=0x560d14b955b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb16a000640 0 client.26143 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.641+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 shutdown_connections 2024-06-06T02:46:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.642+0000 7fb18a590740 1 -- 172.21.15.82:0/4245606140 wait complete. 2024-06-06T02:46:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.642+0000 7fb18a590740 20 client.26143 trim_cache size 0 max 16384 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.659+0000 7fb18a590740 1 Processor -- start 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 -- start start 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14b95b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bbad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb158010e20 con 0x560d147d34d0 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb15800e6f0 con 0x560d147cb2f0 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb18a590740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb15800c520 con 0x560d147f41b0 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb17be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb17be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56238/0 (socket says 172.21.15.82:56238) 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb17be00640 1 -- 172.21.15.82:0/4281720586 learned_addr learned my addr 172.21.15.82:0/4281720586 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb180c00640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14b95b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.660+0000 7fb181600640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bbad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 -- 172.21.15.82:0/4281720586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 msgr2=0x560d14bbad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bbad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 -- 172.21.15.82:0/4281720586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 msgr2=0x560d14b95b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14b95b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 -- 172.21.15.82:0/4281720586 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d148d8620 con 0x560d147d34d0 2024-06-06T02:46:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb181600640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bbad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-06T02:46:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb17be00640 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0a5cb0 tx=0x7fb16c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b681ef4b3f8611 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb171200640 1 -- 172.21.15.82:0/4281720586 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0aa330 con 0x560d147d34d0 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb171200640 1 -- 172.21.15.82:0/4281720586 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb16c0a9c30 con 0x560d147d34d0 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.661+0000 7fb171200640 1 -- 172.21.15.82:0/4281720586 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0b2860 con 0x560d147d34d0 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 -- 172.21.15.82:0/4281720586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 msgr2=0x560d14bba840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0a5cb0 tx=0x7fb16c000bc0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 -- 172.21.15.82:0/4281720586 shutdown_connections 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147f41b0 0x560d14bbad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147d34d0 0x560d14bba840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 --2- 172.21.15.82:0/4281720586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147cb2f0 0x560d14b95b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 -- 172.21.15.82:0/4281720586 >> 172.21.15.82:0/4281720586 conn(0x560d147e8300 msgr2=0x560d14b95470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 -- 172.21.15.82:0/4281720586 shutdown_connections 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.662+0000 7fb18a590740 1 -- 172.21.15.82:0/4281720586 wait complete. 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 -- start start 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 Processor -- start 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147cb2f0 0x560d14bb7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb15800cbb0 con 0x560d147f41b0 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb15800e020 con 0x560d147d34d0 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.663+0000 7fb18a590740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb15800d280 con 0x560d147cb2f0 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb18a590740 10 client.0 _ll_register_callbacks cb 0x7fb164009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb180c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147cb2f0 0x560d14bb7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56242/0 (socket says 172.21.15.82:56242) 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 -- 172.21.15.82:0/3435021744 learned_addr learned my addr 172.21.15.82:0/3435021744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb17be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 -- 172.21.15.82:0/3435021744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147cb2f0 msgr2=0x560d14bb7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147cb2f0 0x560d14bb7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 -- 172.21.15.82:0/3435021744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 msgr2=0x560d14bb8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 -- 172.21.15.82:0/3435021744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d14bbb340 con 0x560d147f41b0 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb17be00640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb181600640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b010 tx=0x7fb16404a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75929332fdb36696 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.664+0000 7fb16a000640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16404e040 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb16c0a9c30 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb1640035f0 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb1640037f0 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 10 client.15786 fetch_fsmap learned FSMap version 29 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d14c39a80 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb164003e40 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8338+0+0 (secure 0 0 0) 0x7fb164064030 con 0x560d147f41b0 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 10 client.15786 fetch_fsmap finished waiting for FSMap version 29 2024-06-06T02:46:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 20 client.15786 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147881c0 0x560d14c3c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 4 client.15786 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.665+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fb16c0a9c30 con 0x560d147881c0 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.666+0000 7fb180c00640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147881c0 0x560d14c3c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.666+0000 7fb180c00640 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147881c0 0x560d14c3c470 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8fbf6e5082febd8 server_cookie=db16b321723d5d67 in_seq=0 out_seq=0 2024-06-06T02:46:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.666+0000 7fb16a000640 10 client.15786 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:02.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:02 smithi103 ceph-mon[36349]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 63 MiB/s wr, 12.27k op/s 2024-06-06T02:46:02.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:02 smithi082 ceph-mon[31579]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 63 MiB/s wr, 12.27k op/s 2024-06-06T02:46:02.897 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:02 smithi184 ceph-mon[36922]: pgmap v693: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 63 MiB/s wr, 12.27k op/s 2024-06-06T02:46:02.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.966+0000 7fb16a000640 1 -- 172.21.15.82:0/3435021744 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb16c0a9c30 con 0x560d147881c0 2024-06-06T02:46:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.966+0000 7fb16a000640 10 client.15786 handle_command_reply: tid=0 2024-06-06T02:46:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.967+0000 7fb18a590740 1 client.15786 shutdown 2024-06-06T02:46:02.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.967+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 msgr2=0x560d14c27480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.967+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb16400b010 tx=0x7fb16404a680 comp rx=0 tx=0).stop 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 shutdown_connections 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x560d147881c0 0x560d14c3c470 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560d147f41b0 0x560d14c27480 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560d147d34d0 0x560d14bb8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 --2- 172.21.15.82:0/3435021744 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d147cb2f0 0x560d14bb7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 >> 172.21.15.82:0/3435021744 conn(0x560d147e8300 msgr2=0x560d14b95c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb16a000640 0 client.15786 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 shutdown_connections 2024-06-06T02:46:02.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.968+0000 7fb18a590740 1 -- 172.21.15.82:0/3435021744 wait complete. 2024-06-06T02:46:02.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.969+0000 7fb18a590740 20 client.15786 trim_cache size 0 max 16384 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 msgr2=0x7fb1600b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 0x7fb1600b4d70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb164009230 tx=0x7fb16400b040 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 msgr2=0x7fb17c197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00e9f0 tx=0x7fb16c00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 shutdown_connections 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb17c108960 0x7fb17c194150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb17c106000 0x7fb17c197b40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.970+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb1600b2860 0x7fb1600b4d70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.971+0000 7fb183600640 1 --2- 172.21.15.82:0/3840030590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17c1036a0 0x7fb17c197600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.971+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 >> 172.21.15.82:0/3840030590 conn(0x7fb17c0fd2d0 msgr2=0x7fb17c101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.971+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 shutdown_connections 2024-06-06T02:46:02.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:02.971+0000 7fb183600640 1 -- 172.21.15.82:0/3840030590 wait complete. 2024-06-06T02:46:04.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:04 smithi103 ceph-mon[36349]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 60 MiB/s wr, 11.63k op/s 2024-06-06T02:46:04.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:04 smithi082 ceph-mon[31579]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 60 MiB/s wr, 11.63k op/s 2024-06-06T02:46:04.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:04 smithi184 ceph-mon[36922]: pgmap v694: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 60 MiB/s wr, 11.63k op/s 2024-06-06T02:46:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:06 smithi103 ceph-mon[36349]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 49 MiB/s wr, 9.49k op/s 2024-06-06T02:46:06.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:06 smithi082 ceph-mon[31579]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 49 MiB/s wr, 9.49k op/s 2024-06-06T02:46:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:06 smithi184 ceph-mon[36922]: pgmap v695: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 49 MiB/s wr, 9.49k op/s 2024-06-06T02:46:08.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:08 smithi103 ceph-mon[36349]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 9.74k op/s 2024-06-06T02:46:08.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:08 smithi082 ceph-mon[31579]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 9.74k op/s 2024-06-06T02:46:08.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:08 smithi184 ceph-mon[36922]: pgmap v696: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 50 MiB/s wr, 9.74k op/s 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:Syncing()...38 sec 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:FFSB benchmark finished at: Thu Jun 6 02:46:10 2024 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:Results: 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:Benchmark took 342.07 sec 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:Total Results 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout:=============== 2024-06-06T02:46:10.204 INFO:tasks.workunit.client.0.smithi082.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout: ======= ============ ========= ======= =========== ========== 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout: write : 10302720 30118.90 100.000% 100.000% 118MB/sec 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout:- 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout:30118.90 Transactions per Second 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout:Throughput Results 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout:=================== 2024-06-06T02:46:10.205 INFO:tasks.workunit.client.0.smithi082.stdout:Write Throughput: 118MB/sec 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout:System Call Latency statistics in millisecs 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout:===== 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout: Min Avg Max Total Calls 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout: ======== ======== ======== ============ 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout:[ open] 0.018000 0.241023 35.611000 8049 2024-06-06T02:46:10.354 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[7] 20.000000 - 50.000000 : 11 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[8] 10.000000 - 20.000000 : 26 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[9] 5.000000 - 10.000000 : 46 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[10] 2.000000 - 5.000000 : 120 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[11] 1.000000 - 2.000000 : 69 2024-06-06T02:46:10.355 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[12] 0.500000 - 1.000000 : 51 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[13] 0.200000 - 0.500000 : 79 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[14] 0.100000 - 0.200000 : 713 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[15] 0.050000 - 0.100000 : 596 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[16] 0.020000 - 0.050000 : 6332 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[17] 0.010000 - 0.020000 : 6 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.357 INFO:tasks.workunit.client.0.smithi082.stdout:[ write] 0.003000 0.935376 17300.751953 10302720 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[0] 5000.000000 - 10000.000000 : 520 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[1] 2000.000000 - 5000.000000 : 824 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[2] 1000.000000 - 2000.000000 : 432 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[3] 500.000000 - 1000.000000 : 349 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[4] 200.000000 - 500.000000 : 564 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[5] 100.000000 - 200.000000 : 454 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[6] 50.000000 - 100.000000 : 451 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[7] 20.000000 - 50.000000 : 1622 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[8] 10.000000 - 20.000000 : 2987 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[9] 5.000000 - 10.000000 : 3605 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[10] 2.000000 - 5.000000 : 6650 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[11] 1.000000 - 2.000000 : 3672 2024-06-06T02:46:10.358 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[12] 0.500000 - 1.000000 : 3183 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[13] 0.200000 - 0.500000 : 6409 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[14] 0.100000 - 0.200000 : 12989 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[15] 0.050000 - 0.100000 : 41368 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[16] 0.020000 - 0.050000 : 299024 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[17] 0.010000 - 0.020000 : 4050676 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[18] 0.000000 - 0.010000 : 5866790 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout:[ lseek] 0.000000 0.002022 66.554001 10302720 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-06-06T02:46:10.359 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[6] 50.000000 - 100.000000 : 3 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[7] 20.000000 - 50.000000 : 66 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[8] 10.000000 - 20.000000 : 218 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[9] 5.000000 - 10.000000 : 274 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[10] 2.000000 - 5.000000 : 576 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[11] 1.000000 - 2.000000 : 299 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[12] 0.500000 - 1.000000 : 277 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[13] 0.200000 - 0.500000 : 402 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[14] 0.100000 - 0.200000 : 523 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[15] 0.050000 - 0.100000 : 1695 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[16] 0.020000 - 0.050000 : 7821 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[17] 0.010000 - 0.020000 : 7191 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[18] 0.000000 - 0.010000 : 10283375 2024-06-06T02:46:10.360 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout:[ close] 0.003000 0.012656 9.855000 8049 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[11] 1.000000 - 2.000000 : 1 2024-06-06T02:46:10.361 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[12] 0.500000 - 1.000000 : 5 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[15] 0.050000 - 0.100000 : 13 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[16] 0.020000 - 0.050000 : 75 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[17] 0.010000 - 0.020000 : 4543 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: msec_range[18] 0.000000 - 0.010000 : 3403 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout:2.0% User Time 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout:34.5% System Time 2024-06-06T02:46:10.362 INFO:tasks.workunit.client.0.smithi082.stdout:36.5% CPU Utilization 2024-06-06T02:46:10.373 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd .. 2024-06-06T02:46:10.374 INFO:tasks.workunit.client.0.smithi082.stderr:+ rm -r tmp ffsb 2024-06-06T02:46:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:10 smithi103 ceph-mon[36349]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 43 MiB/s wr, 8.28k op/s 2024-06-06T02:46:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:10 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:10 smithi082 ceph-mon[31579]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 43 MiB/s wr, 8.28k op/s 2024-06-06T02:46:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:10 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:10.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:10 smithi184 ceph-mon[36922]: pgmap v697: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 43 MiB/s wr, 8.28k op/s 2024-06-06T02:46:10.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:10 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:11 smithi082 ceph-mon[31579]: scrub summary: active paths [/] 2024-06-06T02:46:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:11 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:11.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:11 smithi082 ceph-mon[31579]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:11.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:11 smithi184 ceph-mon[36922]: scrub summary: active paths [/] 2024-06-06T02:46:11.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:11 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:11.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:11 smithi184 ceph-mon[36922]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:12.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:11 smithi103 ceph-mon[36349]: scrub summary: active paths [/] 2024-06-06T02:46:12.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:11 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:12.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:11 smithi103 ceph-mon[36349]: scrub summary: idle+waiting paths [/] 2024-06-06T02:46:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:12 smithi184 ceph-mon[36922]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 MiB/s wr, 7.15k op/s 2024-06-06T02:46:13.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:12 smithi103 ceph-mon[36349]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 MiB/s wr, 7.15k op/s 2024-06-06T02:46:13.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:12 smithi082 ceph-mon[31579]: pgmap v698: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 37 MiB/s wr, 7.15k op/s 2024-06-06T02:46:14.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:14 smithi184 ceph-mon[36922]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 7.24k op/s 2024-06-06T02:46:14.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:14 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:14 smithi103 ceph-mon[36349]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 7.24k op/s 2024-06-06T02:46:15.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:14 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:14 smithi082 ceph-mon[31579]: pgmap v699: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 MiB/s wr, 7.24k op/s 2024-06-06T02:46:15.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:14 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:15.474 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-06-06T02:46:15.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-06-06T02:46:15.598 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-06-06T02:46:15.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-06-06T02:46:16.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-06-06T02:46:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.298+0000 7f1676e00640 1 -- 172.21.15.82:0/2583218853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 msgr2=0x7f1670119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.298+0000 7f1676e00640 1 --2- 172.21.15.82:0/2583218853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f1670119f30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1660009860 tx=0x7f166002a3d0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.298+0000 7f1676e00640 1 -- 172.21.15.82:0/2583218853 shutdown_connections 2024-06-06T02:46:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.298+0000 7f1676e00640 1 --2- 172.21.15.82:0/2583218853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f1670119f30 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.298+0000 7f1676e00640 1 --2- 172.21.15.82:0/2583218853 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f167010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.299+0000 7f1676e00640 1 --2- 172.21.15.82:0/2583218853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f167010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.299+0000 7f1676e00640 1 -- 172.21.15.82:0/2583218853 >> 172.21.15.82:0/2583218853 conn(0x7f167006fbe0 msgr2=0x7f1670072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.302+0000 7f1676e00640 1 -- 172.21.15.82:0/2583218853 shutdown_connections 2024-06-06T02:46:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.303+0000 7f1676e00640 1 -- 172.21.15.82:0/2583218853 wait complete. 2024-06-06T02:46:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.304+0000 7f1676e00640 1 Processor -- start 2024-06-06T02:46:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.305+0000 7f1676e00640 1 -- start start 2024-06-06T02:46:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.305+0000 7f1676e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.305+0000 7f1676e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f1670117170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.305+0000 7f1676e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f16701180d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f166f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f1670117170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:35164/0 (socket says 172.21.15.82:35164) 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f166f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f1670117170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39478/0 (socket says 172.21.15.82:39478) 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f166fe00640 1 -- 172.21.15.82:0/403119717 learned_addr learned my addr 172.21.15.82:0/403119717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f1674e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f16701180d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f167011d4a0 con 0x7f167010ee40 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f167011d320 con 0x7f1670109940 2024-06-06T02:46:16.307 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.306+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f167011d620 con 0x7f167010c2a0 2024-06-06T02:46:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 -- 172.21.15.82:0/403119717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 msgr2=0x7f1670117170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f1670117170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 -- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 msgr2=0x7f16701180d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f16701180d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1670118740 con 0x7f1670109940 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.307+0000 7f166fe00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9f0 tx=0x7f165c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.309+0000 7f166cc00640 1 -- 172.21.15.82:0/403119717 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00ccc0 con 0x7f1670109940 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.309+0000 7f166cc00640 1 -- 172.21.15.82:0/403119717 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f165c0035f0 con 0x7f1670109940 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.309+0000 7f166cc00640 1 -- 172.21.15.82:0/403119717 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00ce60 con 0x7f1670109940 2024-06-06T02:46:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.309+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1670118a30 con 0x7f1670109940 2024-06-06T02:46:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.309+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1670118f80 con 0x7f1670109940 2024-06-06T02:46:16.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.317+0000 7f167de73740 1 Processor -- start 2024-06-06T02:46:16.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.317+0000 7f167de73740 1 -- start start 2024-06-06T02:46:16.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.318+0000 7f167de73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f21d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.318+0000 7f167de73740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f22240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.318+0000 7f167de73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.318+0000 7f167de73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c643e94480 con 0x55c643b5c4d0 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.319+0000 7f167de73740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c643e83a20 con 0x55c643b542f0 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.319+0000 7f167de73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c643e87a60 con 0x55c643b7d1b0 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.319+0000 7f166cc00640 1 -- 172.21.15.82:0/403119717 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f165c010690 con 0x7f1670109940 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.320+0000 7f166f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.320+0000 7f166f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41206/0 (socket says 172.21.15.82:41206) 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.320+0000 7f166f400640 1 -- 172.21.15.82:0/2718319085 learned_addr learned my addr 172.21.15.82:0/2718319085 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.320+0000 7f166f400640 1 -- 172.21.15.82:0/2718319085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 msgr2=0x55c643f21d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.321+0000 7f166f400640 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f21d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.321+0000 7f166f400640 1 -- 172.21.15.82:0/2718319085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 msgr2=0x55c643f22240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.321+0000 7f166f400640 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f22240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.321+0000 7f166f400640 1 -- 172.21.15.82:0/2718319085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643e808d0 con 0x55c643b5c4d0 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.321+0000 7f166cc00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 0x7f16540b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.322+0000 7f166f400640 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fd0 tx=0x7f1668003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d18d5d1dece1bf server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.322+0000 7f166cc00640 1 -- 172.21.15.82:0/403119717 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f165c0e2460 con 0x7f1670109940 2024-06-06T02:46:16.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.322+0000 7f1665600640 1 -- 172.21.15.82:0/2718319085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1668012450 con 0x55c643b5c4d0 2024-06-06T02:46:16.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.323+0000 7f1665600640 1 -- 172.21.15.82:0/2718319085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1668012aa0 con 0x55c643b5c4d0 2024-06-06T02:46:16.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.323+0000 7f1665600640 1 -- 172.21.15.82:0/2718319085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166801ab40 con 0x55c643b5c4d0 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 -- 172.21.15.82:0/2718319085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 msgr2=0x55c643f29100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fd0 tx=0x7f1668003e80 comp rx=0 tx=0).stop 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f1674e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 0x7f16540b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 -- 172.21.15.82:0/2718319085 shutdown_connections 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f29100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f22240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.324+0000 7f167de73740 1 --2- 172.21.15.82:0/2718319085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f21d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.325+0000 7f167de73740 1 -- 172.21.15.82:0/2718319085 >> 172.21.15.82:0/2718319085 conn(0x55c643b71300 msgr2=0x55c643f1d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.325+0000 7f167de73740 1 -- 172.21.15.82:0/2718319085 shutdown_connections 2024-06-06T02:46:16.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.326+0000 7f167de73740 1 -- 172.21.15.82:0/2718319085 wait complete. 2024-06-06T02:46:16.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.326+0000 7f1674e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 0x7f16540b4f00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16600309e0 tx=0x7f1660009490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.327+0000 7f167de73740 1 -- start start 2024-06-06T02:46:16.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.328+0000 7f167de73740 1 Processor -- start 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f2b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c643dbeab0 con 0x55c643b5c4d0 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c643e21630 con 0x55c643b542f0 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55c643f29ad0 con 0x55c643b7d1b0 2024-06-06T02:46:16.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.329+0000 7f167de73740 10 client.0 _ll_register_callbacks cb 0x55c643e27610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:16.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.330+0000 7f1674e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.330+0000 7f166f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.330+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f2b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.330+0000 7f1674e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39506/0 (socket says 172.21.15.82:39506) 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.330+0000 7f1674e00640 1 -- 172.21.15.82:0/4210459003 learned_addr learned my addr 172.21.15.82:0/4210459003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f1674e00640 1 -- 172.21.15.82:0/4210459003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 msgr2=0x55c643f2b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f1674e00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f2b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f1674e00640 1 -- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 msgr2=0x55c643f2ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f1674e00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f2ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f1674e00640 1 -- 172.21.15.82:0/4210459003 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c643e4e170 con 0x55c643b7d1b0 2024-06-06T02:46:16.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.331+0000 7f166fe00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f2b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.332+0000 7f1674e00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1660034000 tx=0x7f166002a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b33eb6626777e506 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.332+0000 7f165a000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:46:16.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.333+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166004c030 con 0x55c643b7d1b0 2024-06-06T02:46:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.333+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f16600048d0 con 0x55c643b7d1b0 2024-06-06T02:46:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.333+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1668012aa0 con 0x55c643b7d1b0 2024-06-06T02:46:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.334+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1660004ad0 con 0x55c643b7d1b0 2024-06-06T02:46:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.334+0000 7f167de73740 10 client.26158 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.334+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c643be8790 con 0x55c643b7d1b0 2024-06-06T02:46:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.336+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1668012aa0 con 0x55c643b7d1b0 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f1660048bf0 con 0x55c643b7d1b0 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 10 client.26158 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 20 client.26158 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b3bd80 0x55c643f38cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 4 client.26158 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c643e963d0 con 0x55c643b3bd80 2024-06-06T02:46:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.337+0000 7f166fe00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b3bd80 0x55c643f38cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.338+0000 7f166fe00640 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b3bd80 0x55c643f38cf0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264fca25678249f0 server_cookie=dcaca247a0f533a9 in_seq=0 out_seq=0 2024-06-06T02:46:16.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.338+0000 7f165a000640 10 client.26158 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.343+0000 7f165a000640 1 -- 172.21.15.82:0/4210459003 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c643e963d0 con 0x55c643b3bd80 2024-06-06T02:46:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.343+0000 7f165a000640 10 client.26158 handle_command_reply: tid=0 2024-06-06T02:46:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.343+0000 7f167de73740 1 client.26158 shutdown 2024-06-06T02:46:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.345+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 msgr2=0x55c643f32900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.345+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1660034000 tx=0x7f166002a3d0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 shutdown_connections 2024-06-06T02:46:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f32900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b3bd80 0x55c643f38cf0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 --2- 172.21.15.82:0/4210459003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f2b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 >> 172.21.15.82:0/4210459003 conn(0x55c643b71300 msgr2=0x55c643f1e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.346+0000 7f165a000640 0 client.26158 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.348+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 shutdown_connections 2024-06-06T02:46:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.348+0000 7f167de73740 1 -- 172.21.15.82:0/4210459003 wait complete. 2024-06-06T02:46:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.349+0000 7f167de73740 20 client.26158 trim_cache size 0 max 16384 2024-06-06T02:46:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.382+0000 7f167de73740 1 Processor -- start 2024-06-06T02:46:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.382+0000 7f167de73740 1 -- start start 2024-06-06T02:46:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.382+0000 7f167de73740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f167de73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b5c4d0 0x55c643f32820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f167de73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b7d1b0 0x55c643f32d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f167de73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16701c42a0 con 0x55c643b7d1b0 2024-06-06T02:46:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f167de73740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16701c1b10 con 0x55c643b542f0 2024-06-06T02:46:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f167de73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f16701bf940 con 0x55c643b5c4d0 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b5c4d0 0x55c643f32820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:35186/0 (socket says 172.21.15.82:35186) 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 -- 172.21.15.82:0/1134670412 learned_addr learned my addr 172.21.15.82:0/1134670412 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f1674e00640 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b7d1b0 0x55c643f32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 -- 172.21.15.82:0/1134670412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b5c4d0 msgr2=0x55c643f32820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b5c4d0 0x55c643f32820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 -- 172.21.15.82:0/1134670412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b7d1b0 msgr2=0x55c643f32d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.383+0000 7f166fe00640 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b7d1b0 0x55c643f32d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.384+0000 7f166fe00640 1 -- 172.21.15.82:0/1134670412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c643c61620 con 0x55c643b542f0 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.384+0000 7f166fe00640 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f165c0aa950 tx=0x7f165c003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb8963af63f650f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.384+0000 7f1664c00640 1 -- 172.21.15.82:0/1134670412 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0ab0c0 con 0x55c643b542f0 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.384+0000 7f1664c00640 1 -- 172.21.15.82:0/1134670412 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f165c0aa9c0 con 0x55c643b542f0 2024-06-06T02:46:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.384+0000 7f1664c00640 1 -- 172.21.15.82:0/1134670412 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0a6cb0 con 0x55c643b542f0 2024-06-06T02:46:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 -- 172.21.15.82:0/1134670412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 msgr2=0x55c643f1eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f165c0aa950 tx=0x7f165c003e70 comp rx=0 tx=0).stop 2024-06-06T02:46:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 -- 172.21.15.82:0/1134670412 shutdown_connections 2024-06-06T02:46:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b7d1b0 0x55c643f32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b5c4d0 0x55c643f32820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 --2- 172.21.15.82:0/1134670412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f1eb80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 -- 172.21.15.82:0/1134670412 >> 172.21.15.82:0/1134670412 conn(0x55c643b71300 msgr2=0x55c643f1e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 -- 172.21.15.82:0/1134670412 shutdown_connections 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.386+0000 7f167de73740 1 -- 172.21.15.82:0/1134670412 wait complete. 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.387+0000 7f167de73740 1 -- start start 2024-06-06T02:46:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.387+0000 7f167de73740 1 Processor -- start 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16701bffd0 con 0x55c643b5c4d0 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16701c1440 con 0x55c643b542f0 2024-06-06T02:46:16.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f16701c06a0 con 0x55c643b7d1b0 2024-06-06T02:46:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f167de73740 10 client.0 _ll_register_callbacks cb 0x7f1660030e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f166f400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f166fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:35196/0 (socket says 172.21.15.82:35196) 2024-06-06T02:46:16.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.388+0000 7f166fe00640 1 -- 172.21.15.82:0/1049745370 learned_addr learned my addr 172.21.15.82:0/1049745370 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166fe00640 1 -- 172.21.15.82:0/1049745370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 msgr2=0x55c643f316e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166fe00640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f316e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166fe00640 1 -- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 msgr2=0x55c643f307b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166fe00640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f307b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166fe00640 1 -- 172.21.15.82:0/1049745370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c643f31cd0 con 0x55c643b542f0 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.389+0000 7f166f400640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:16.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.390+0000 7f166fe00640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f165c0cc010 tx=0x7f165c0a6e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f078ed3966406d server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.390+0000 7f165a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.390+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c003cb0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.390+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f165c0cc0b0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.390+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f165c0aa9c0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f165c0ab0c0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 10 client.26144 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c643f32fd0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f165c0aa9c0 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f165c0a9690 con 0x55c643b542f0 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 10 client.26144 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 10 client.26144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 20 client.26144 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b111c0 0x55c643fa3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 4 client.26144 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-06-06T02:46:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.391+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c643e91e70 con 0x55c643b111c0 2024-06-06T02:46:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.392+0000 7f166f400640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b111c0 0x55c643fa3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.393+0000 7f166f400640 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b111c0 0x55c643fa3780 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8e73993c570feb server_cookie=b1fde2c35e705ac7 in_seq=0 out_seq=0 2024-06-06T02:46:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.393+0000 7f165a000640 10 client.26144 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.576+0000 7f165a000640 1 -- 172.21.15.82:0/1049745370 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c643e91e70 con 0x55c643b111c0 2024-06-06T02:46:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.576+0000 7f165a000640 10 client.26144 handle_command_reply: tid=0 2024-06-06T02:46:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 client.26144 shutdown 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 msgr2=0x55c643f30270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f165c0cc010 tx=0x7f165c0a6e80 comp rx=0 tx=0).stop 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 shutdown_connections 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c643b7d1b0 0x55c643f316e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55c643b111c0 0x55c643fa3780 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c643b5c4d0 0x55c643f307b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 --2- 172.21.15.82:0/1049745370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c643b542f0 0x55c643f30270 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.577+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 >> 172.21.15.82:0/1049745370 conn(0x55c643b71300 msgr2=0x55c643f1bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.578+0000 7f165a000640 0 client.26144 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.578+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 shutdown_connections 2024-06-06T02:46:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.578+0000 7f167de73740 1 -- 172.21.15.82:0/1049745370 wait complete. 2024-06-06T02:46:16.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.578+0000 7f167de73740 20 client.26144 trim_cache size 0 max 16384 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.580+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 msgr2=0x7f16540b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.580+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 0x7f16540b4f00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f16600309e0 tx=0x7f1660009490 comp rx=0 tx=0).stop 2024-06-06T02:46:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.580+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 msgr2=0x7f1670116c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.580+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f165c00e9f0 tx=0x7f165c00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 shutdown_connections 2024-06-06T02:46:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f167010ee40 0x7f16701180d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f16540b29f0 0x7f16540b4f00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f167010c2a0 0x7f1670117170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 --2- 172.21.15.82:0/403119717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1670109940 0x7f1670116c30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 >> 172.21.15.82:0/403119717 conn(0x7f167006fbe0 msgr2=0x7f167010a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 shutdown_connections 2024-06-06T02:46:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-06-06T02:46:16.582+0000 7f1676e00640 1 -- 172.21.15.82:0/403119717 wait complete. 2024-06-06T02:46:16.751 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:16.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:16 smithi082 ceph-mon[31579]: pgmap v700: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 5.29k op/s 2024-06-06T02:46:16.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:16 smithi082 ceph-mon[31579]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:16 smithi103 ceph-mon[36349]: pgmap v700: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 5.29k op/s 2024-06-06T02:46:17.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:16 smithi103 ceph-mon[36349]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:17.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:16 smithi184 ceph-mon[36922]: pgmap v700: 97 pgs: 97 active+clean; 12 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 26 MiB/s wr, 5.29k op/s 2024-06-06T02:46:17.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:16 smithi184 ceph-mon[36922]: fsmap cephfs:3 {0=g=up:active,1=i=up:active,2=b=up:active} 3 up:standby-replay 6 up:standby 2024-06-06T02:46:18.563 DEBUG:teuthology.parallel:result is None 2024-06-06T02:46:18.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-06-06T02:46:18.719 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-06-06T02:46:18.720 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-06-06T02:46:18.751 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:46:18.770 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-06-06T02:46:18.790 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-06-06T02:46:19.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:18 smithi103 ceph-mon[36349]: pgmap v701: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 5.03k op/s 2024-06-06T02:46:19.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:18 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:46:19.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:18 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:46:19.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:18 smithi103 ceph-mon[36349]: scrub summary: idle 2024-06-06T02:46:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:18 smithi082 ceph-mon[31579]: pgmap v701: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 5.03k op/s 2024-06-06T02:46:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:18 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:46:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:18 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:46:19.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:18 smithi082 ceph-mon[31579]: scrub summary: idle 2024-06-06T02:46:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:18 smithi184 ceph-mon[36922]: pgmap v701: 97 pgs: 97 active+clean; 11 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 5.03k op/s 2024-06-06T02:46:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:18 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:46:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:18 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:46:19.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:18 smithi184 ceph-mon[36922]: scrub summary: idle 2024-06-06T02:46:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 -- 172.21.15.82:0/1830747852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c107bd0 msgr2=0x7ff90c115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 --2- 172.21.15.82:0/1830747852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c107bd0 0x7ff90c115db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff904009ca0 tx=0x7ff90402a8c0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 -- 172.21.15.82:0/1830747852 shutdown_connections 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 --2- 172.21.15.82:0/1830747852 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c107bd0 0x7ff90c115db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 --2- 172.21.15.82:0/1830747852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff90c102350 0x7ff90c113860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 --2- 172.21.15.82:0/1830747852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c101a00 0x7ff90c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.973+0000 7ff912800640 1 -- 172.21.15.82:0/1830747852 >> 172.21.15.82:0/1830747852 conn(0x7ff90c078a80 msgr2=0x7ff90c078ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.974+0000 7ff912800640 1 -- 172.21.15.82:0/1830747852 shutdown_connections 2024-06-06T02:46:20.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:20 smithi082 ceph-mon[31579]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 14 MiB/s wr, 2.94k op/s 2024-06-06T02:46:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.974+0000 7ff912800640 1 -- 172.21.15.82:0/1830747852 wait complete. 2024-06-06T02:46:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.975+0000 7ff912800640 1 Processor -- start 2024-06-06T02:46:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.976+0000 7ff912800640 1 -- start start 2024-06-06T02:46:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c101a00 0x7ff90c0743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff90c107bd0 0x7ff90c06db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1194b0 con 0x7ff90c102350 2024-06-06T02:46:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c119330 con 0x7ff90c107bd0 2024-06-06T02:46:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.977+0000 7ff912800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c119630 con 0x7ff90c101a00 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41234/0 (socket says 172.21.15.82:41234) 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 -- 172.21.15.82:0/387900971 learned_addr learned my addr 172.21.15.82:0/387900971 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 -- 172.21.15.82:0/387900971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c101a00 msgr2=0x7ff90c0743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c101a00 0x7ff90c0743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 -- 172.21.15.82:0/387900971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff90c107bd0 msgr2=0x7ff90c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff90c107bd0 0x7ff90c06db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.978+0000 7ff90aa00640 1 -- 172.21.15.82:0/387900971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c071ed0 con 0x7ff90c102350 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff90aa00640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e970 tx=0x7ff8f800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff903e00640 1 -- 172.21.15.82:0/387900971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800cd80 con 0x7ff90c102350 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff903e00640 1 -- 172.21.15.82:0/387900971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f80035f0 con 0x7ff90c102350 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff903e00640 1 -- 172.21.15.82:0/387900971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8010690 con 0x7ff90c102350 2024-06-06T02:46:20.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c0721c0 con 0x7ff90c102350 2024-06-06T02:46:20.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.979+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c072700 con 0x7ff90c102350 2024-06-06T02:46:20.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.988+0000 7ff903e00640 1 -- 172.21.15.82:0/387900971 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff8f8003aa0 con 0x7ff90c102350 2024-06-06T02:46:20.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.990+0000 7ff903e00640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 0x7ff8f00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:20.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.991+0000 7ff903e00640 1 -- 172.21.15.82:0/387900971 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff8f80e2540 con 0x7ff90c102350 2024-06-06T02:46:21.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:20.991+0000 7ff90b400640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 0x7ff8f00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 Processor -- start 2024-06-06T02:46:21.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff90b400640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 0x7ff8f00b4e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff90c06ed20 tx=0x7ff8fc006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:21.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 -- start start 2024-06-06T02:46:21.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dce070 0x55d3b4174360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dad390 0x55d3b4174de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3b40e8e00 con 0x55d3b3dce070 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d3b40d83a0 con 0x55d3b3dad390 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.002+0000 7ff918e24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3b40dc3e0 con 0x55d3b3da51b0 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.003+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.003+0000 7ff90aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:39532/0 (socket says 172.21.15.82:39532) 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.003+0000 7ff90aa00640 1 -- 172.21.15.82:0/1402759802 learned_addr learned my addr 172.21.15.82:0/1402759802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:21.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.003+0000 7ff90be00640 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dad390 0x55d3b4174de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 -- 172.21.15.82:0/1402759802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dad390 msgr2=0x55d3b4174de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dad390 0x55d3b4174de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 -- 172.21.15.82:0/1402759802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dce070 msgr2=0x55d3b4174360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dce070 0x55d3b4174360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 -- 172.21.15.82:0/1402759802 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b3e39650 con 0x55d3b3da51b0 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff90aa00640 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80a9af0 tx=0x7ff8f80a93d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=120b2c10eec7c413 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff900c00640 1 -- 172.21.15.82:0/1402759802 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80b2310 con 0x55d3b3da51b0 2024-06-06T02:46:21.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff900c00640 1 -- 172.21.15.82:0/1402759802 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f80a9b60 con 0x55d3b3da51b0 2024-06-06T02:46:21.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.004+0000 7ff900c00640 1 -- 172.21.15.82:0/1402759802 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80e22e0 con 0x55d3b3da51b0 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.005+0000 7ff918e24740 1 -- 172.21.15.82:0/1402759802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 msgr2=0x55d3b41748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.005+0000 7ff918e24740 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff8f80a9af0 tx=0x7ff8f80a93d0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.006+0000 7ff918e24740 1 -- 172.21.15.82:0/1402759802 shutdown_connections 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.006+0000 7ff918e24740 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dad390 0x55d3b4174de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.006+0000 7ff918e24740 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3da51b0 0x55d3b41748a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.006+0000 7ff918e24740 1 --2- 172.21.15.82:0/1402759802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dce070 0x55d3b4174360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.006+0000 7ff918e24740 1 -- 172.21.15.82:0/1402759802 >> 172.21.15.82:0/1402759802 conn(0x55d3b3dc2460 msgr2=0x55d3b4170bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.007+0000 7ff918e24740 1 -- 172.21.15.82:0/1402759802 shutdown_connections 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.007+0000 7ff918e24740 1 -- 172.21.15.82:0/1402759802 wait complete. 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.007+0000 7ff918e24740 1 -- start start 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.008+0000 7ff918e24740 1 Processor -- start 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.008+0000 7ff918e24740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.008+0000 7ff918e24740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 0x55d3b4180a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff918e24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 0x55d3b417e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff918e24740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d3b3f3c700 con 0x55d3b3dad390 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff918e24740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d3b4075700 con 0x55d3b3da51b0 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff918e24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x55d3b4181470 con 0x55d3b3dce070 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff918e24740 10 client.0 _ll_register_callbacks cb 0x55d3b4081dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:21.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff90b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff90b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:35224/0 (socket says 172.21.15.82:35224) 2024-06-06T02:46:21.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.009+0000 7ff90b400640 1 -- 172.21.15.82:0/4001221095 learned_addr learned my addr 172.21.15.82:0/4001221095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:21.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.010+0000 7ff90be00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 0x55d3b417e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90aa00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 0x55d3b4180a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90be00640 1 -- 172.21.15.82:0/4001221095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 msgr2=0x55d3b4180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90be00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90be00640 1 -- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 msgr2=0x55d3b4180a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90be00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 0x55d3b4180a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.011+0000 7ff90be00640 1 -- 172.21.15.82:0/4001221095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b40a0fb0 con 0x55d3b3dce070 2024-06-06T02:46:21.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.012+0000 7ff90b400640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:21.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.013+0000 7ff90aa00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 0x55d3b4180a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-06T02:46:21.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.013+0000 7ff90be00640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 0x55d3b417e910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff90402ae30 tx=0x7ff904009420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29595b02ad6743ef server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:21.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.013+0000 7ff8f5600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:46:21.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.013+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003970 con 0x55d3b3dce070 2024-06-06T02:46:21.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.013+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff904003b10 con 0x55d3b3dce070 2024-06-06T02:46:21.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.015+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f80a9b60 con 0x55d3b3dce070 2024-06-06T02:46:21.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.015+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff904003d10 con 0x55d3b3dce070 2024-06-06T02:46:21.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.015+0000 7ff918e24740 10 client.26170 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:21.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.015+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d3b418d660 con 0x55d3b3dce070 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.016+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8f80a9b60 con 0x55d3b3dce070 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.016+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7ff904043070 con 0x55d3b3dce070 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.016+0000 7ff918e24740 10 client.26170 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.016+0000 7ff918e24740 10 client.26170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.017+0000 7ff918e24740 20 client.26170 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.017+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d8c9f0 0x55d3b4190ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.017+0000 7ff918e24740 4 client.26170 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:21.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.017+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3b40ead50 con 0x55d3b3d8c9f0 2024-06-06T02:46:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.020+0000 7ff90b400640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d8c9f0 0x55d3b4190ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.021+0000 7ff90b400640 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d8c9f0 0x55d3b4190ad0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34bb8e1ab7ef9e32 server_cookie=254722812d38a5d3 in_seq=0 out_seq=0 2024-06-06T02:46:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.021+0000 7ff8f5600640 10 client.26170 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.023+0000 7ff8f5600640 1 -- 172.21.15.82:0/4001221095 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55d3b40ead50 con 0x55d3b3d8c9f0 2024-06-06T02:46:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.023+0000 7ff8f5600640 10 client.26170 handle_command_reply: tid=0 2024-06-06T02:46:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.023+0000 7ff918e24740 1 client.26170 shutdown 2024-06-06T02:46:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.024+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 msgr2=0x55d3b417e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.024+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 0x55d3b417e910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff90402ae30 tx=0x7ff904009420 comp rx=0 tx=0).stop 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 shutdown_connections 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dce070 0x55d3b417e910 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d8c9f0 0x55d3b4190ad0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3dad390 0x55d3b4180a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 --2- 172.21.15.82:0/4001221095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3da51b0 0x55d3b4180540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 >> 172.21.15.82:0/4001221095 conn(0x55d3b3dc2460 msgr2=0x55d3b41760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff8f5600640 0 client.26170 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 shutdown_connections 2024-06-06T02:46:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.025+0000 7ff918e24740 1 -- 172.21.15.82:0/4001221095 wait complete. 2024-06-06T02:46:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.026+0000 7ff918e24740 20 client.26170 trim_cache size 0 max 16384 2024-06-06T02:46:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.063+0000 7ff918e24740 1 Processor -- start 2024-06-06T02:46:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.063+0000 7ff918e24740 1 -- start start 2024-06-06T02:46:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4179b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4170590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1c0110 con 0x55d3b3da51b0 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1bd980 con 0x55d3b3dce070 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff918e24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1bb770 con 0x55d3b3dad390 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff90be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.064+0000 7ff90be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:35226/0 (socket says 172.21.15.82:35226) 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 -- 172.21.15.82:0/2849622373 learned_addr learned my addr 172.21.15.82:0/2849622373 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90aa00640 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4170590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 -- 172.21.15.82:0/2849622373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 msgr2=0x55d3b4170590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4170590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 -- 172.21.15.82:0/2849622373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 msgr2=0x55d3b4179b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4179b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.065+0000 7ff90be00640 1 -- 172.21.15.82:0/2849622373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3b418b7c0 con 0x55d3b3dce070 2024-06-06T02:46:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.066+0000 7ff90aa00640 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4170590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.068+0000 7ff90be00640 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff904004af0 tx=0x7ff904005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0ef333d6c7501c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.069+0000 7ff8f7e00640 1 -- 172.21.15.82:0/2849622373 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904055070 con 0x55d3b3dce070 2024-06-06T02:46:21.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.069+0000 7ff8f7e00640 1 -- 172.21.15.82:0/2849622373 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff904036040 con 0x55d3b3dce070 2024-06-06T02:46:21.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.069+0000 7ff8f7e00640 1 -- 172.21.15.82:0/2849622373 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904003d10 con 0x55d3b3dce070 2024-06-06T02:46:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.071+0000 7ff918e24740 1 -- 172.21.15.82:0/2849622373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 msgr2=0x55d3b4170ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.071+0000 7ff918e24740 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff904004af0 tx=0x7ff904005c50 comp rx=0 tx=0).stop 2024-06-06T02:46:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.071+0000 7ff918e24740 1 -- 172.21.15.82:0/2849622373 shutdown_connections 2024-06-06T02:46:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.072+0000 7ff918e24740 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4170ad0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.072+0000 7ff918e24740 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4170590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.072+0000 7ff918e24740 1 --2- 172.21.15.82:0/2849622373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4179b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.072+0000 7ff918e24740 1 -- 172.21.15.82:0/2849622373 >> 172.21.15.82:0/2849622373 conn(0x55d3b3dc2460 msgr2=0x55d3b417d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.073+0000 7ff918e24740 1 -- 172.21.15.82:0/2849622373 shutdown_connections 2024-06-06T02:46:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.073+0000 7ff918e24740 1 -- 172.21.15.82:0/2849622373 wait complete. 2024-06-06T02:46:21.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.073+0000 7ff918e24740 1 -- start start 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.074+0000 7ff918e24740 1 Processor -- start 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4186c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4183fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4184500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1bbe40 con 0x55d3b3da51b0 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1bd2b0 con 0x55d3b3dce070 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1bc510 con 0x55d3b3dad390 2024-06-06T02:46:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff918e24740 10 client.0 _ll_register_callbacks cb 0x7ff904009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff90b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4186c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff90b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4186c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41280/0 (socket says 172.21.15.82:41280) 2024-06-06T02:46:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.075+0000 7ff90b400640 1 -- 172.21.15.82:0/3439730584 learned_addr learned my addr 172.21.15.82:0/3439730584 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:21.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4183fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90be00640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4184500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 -- 172.21.15.82:0/3439730584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 msgr2=0x55d3b4184500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4184500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 -- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 msgr2=0x55d3b4186c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4186c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.076+0000 7ff90aa00640 1 -- 172.21.15.82:0/3439730584 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3b4184a40 con 0x55d3b3dad390 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.077+0000 7ff90aa00640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4183fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55d3b4171ac0 tx=0x7ff8f80a8ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b904b076e1f0f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.077+0000 7ff8f5600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.077+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80c9060 con 0x55d3b3dad390 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.077+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff8f80e22f0 con 0x55d3b3dad390 2024-06-06T02:46:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.077+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff904036040 con 0x55d3b3dad390 2024-06-06T02:46:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.078+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff8f80adf10 con 0x55d3b3dad390 2024-06-06T02:46:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.079+0000 7ff918e24740 10 client.26176 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.079+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d3b41f8f70 con 0x55d3b3dad390 2024-06-06T02:46:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff904036040 con 0x55d3b3dad390 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7ff8f80af0a0 con 0x55d3b3dad390 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 10 client.26176 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 10 client.26176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 20 client.26176 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d61da0 0x55d3b41fb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 4 client.26176 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-06-06T02:46:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.082+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3b40e67f0 con 0x55d3b3d61da0 2024-06-06T02:46:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.083+0000 7ff90b400640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d61da0 0x55d3b41fb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.085+0000 7ff8f5600640 10 client.26176 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.086+0000 7ff90b400640 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d61da0 0x55d3b41fb630 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9dc1e977d4bbdd7 server_cookie=be88b9000a338c47 in_seq=0 out_seq=0 2024-06-06T02:46:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.086+0000 7ff8f5600640 1 -- 172.21.15.82:0/3439730584 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d3b40e67f0 con 0x55d3b3d61da0 2024-06-06T02:46:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.086+0000 7ff8f5600640 10 client.26176 handle_command_reply: tid=0 2024-06-06T02:46:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.086+0000 7ff918e24740 1 client.26176 shutdown 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 msgr2=0x55d3b4183fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4183fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55d3b4171ac0 tx=0x7ff8f80a8ff0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 shutdown_connections 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d3b3dce070 0x55d3b4184500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d3b3dad390 0x55d3b4183fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x55d3b3d61da0 0x55d3b41fb630 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 --2- 172.21.15.82:0/3439730584 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d3b3da51b0 0x55d3b4186c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 >> 172.21.15.82:0/3439730584 conn(0x55d3b3dc2460 msgr2=0x55d3b4170590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.087+0000 7ff8f5600640 0 client.26176 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.088+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 shutdown_connections 2024-06-06T02:46:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.088+0000 7ff918e24740 1 -- 172.21.15.82:0/3439730584 wait complete. 2024-06-06T02:46:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.088+0000 7ff918e24740 20 client.26176 trim_cache size 0 max 16384 2024-06-06T02:46:21.090 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:46:21.090 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-06-06T02:46:21.091 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-06-06T02:46:21.091 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.092+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 msgr2=0x7ff8f00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.092+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 0x7ff8f00b4e90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff90c06ed20 tx=0x7ff8fc006c90 comp rx=0 tx=0).stop 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.092+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 msgr2=0x7ff90c06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.092+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e970 tx=0x7ff8f800ee30 comp rx=0 tx=0).stop 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 shutdown_connections 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff90c107bd0 0x7ff90c06db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c102350 0x7ff90c06d520 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff8f00b2980 0x7ff8f00b4e90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 --2- 172.21.15.82:0/387900971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff90c101a00 0x7ff90c0743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:21.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.093+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 >> 172.21.15.82:0/387900971 conn(0x7ff90c078a80 msgr2=0x7ff90c1147b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:21.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.094+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 shutdown_connections 2024-06-06T02:46:21.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:21.094+0000 7ff912800640 1 -- 172.21.15.82:0/387900971 wait complete. 2024-06-06T02:46:21.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:20 smithi103 ceph-mon[36349]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 14 MiB/s wr, 2.94k op/s 2024-06-06T02:46:21.147 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:20 smithi184 ceph-mon[36922]: pgmap v702: 97 pgs: 97 active+clean; 10 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 14 MiB/s wr, 2.94k op/s 2024-06-06T02:46:23.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:22 smithi103 ceph-mon[36349]: pgmap v703: 97 pgs: 97 active+clean; 8.6 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.8 MiB/s wr, 1.99k op/s 2024-06-06T02:46:23.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:22 smithi082 ceph-mon[31579]: pgmap v703: 97 pgs: 97 active+clean; 8.6 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.8 MiB/s wr, 1.99k op/s 2024-06-06T02:46:23.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:22 smithi184 ceph-mon[36922]: pgmap v703: 97 pgs: 97 active+clean; 8.6 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 8.8 MiB/s wr, 1.99k op/s 2024-06-06T02:46:25.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:24 smithi103 ceph-mon[36349]: pgmap v704: 97 pgs: 97 active+clean; 6.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 7.1 MiB/s wr, 1.66k op/s 2024-06-06T02:46:25.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:24 smithi082 ceph-mon[31579]: pgmap v704: 97 pgs: 97 active+clean; 6.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 7.1 MiB/s wr, 1.66k op/s 2024-06-06T02:46:25.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:24 smithi184 ceph-mon[36922]: pgmap v704: 97 pgs: 97 active+clean; 6.5 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 7.1 MiB/s wr, 1.66k op/s 2024-06-06T02:46:26.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:26 smithi082 ceph-mon[31579]: pgmap v705: 97 pgs: 97 active+clean; 5.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 171 KiB/s wr, 218 op/s 2024-06-06T02:46:27.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:26 smithi103 ceph-mon[36349]: pgmap v705: 97 pgs: 97 active+clean; 5.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 171 KiB/s wr, 218 op/s 2024-06-06T02:46:27.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:26 smithi184 ceph-mon[36922]: pgmap v705: 97 pgs: 97 active+clean; 5.6 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 171 KiB/s wr, 218 op/s 2024-06-06T02:46:28.950 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:28 smithi184 ceph-mon[36922]: pgmap v706: 97 pgs: 97 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 248 op/s 2024-06-06T02:46:29.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:28 smithi103 ceph-mon[36349]: pgmap v706: 97 pgs: 97 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 248 op/s 2024-06-06T02:46:29.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:28 smithi082 ceph-mon[31579]: pgmap v706: 97 pgs: 97 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 72 KiB/s wr, 248 op/s 2024-06-06T02:46:31.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:30 smithi103 ceph-mon[36349]: pgmap v707: 97 pgs: 97 active+clean; 2.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 226 op/s 2024-06-06T02:46:31.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:30 smithi082 ceph-mon[31579]: pgmap v707: 97 pgs: 97 active+clean; 2.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 226 op/s 2024-06-06T02:46:31.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:30 smithi184 ceph-mon[36922]: pgmap v707: 97 pgs: 97 active+clean; 2.5 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 KiB/s wr, 226 op/s 2024-06-06T02:46:32.825 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:32 smithi082 ceph-mon[31579]: pgmap v708: 97 pgs: 97 active+clean; 1.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 KiB/s wr, 217 op/s 2024-06-06T02:46:33.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:32 smithi103 ceph-mon[36349]: pgmap v708: 97 pgs: 97 active+clean; 1.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 KiB/s wr, 217 op/s 2024-06-06T02:46:33.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:32 smithi184 ceph-mon[36922]: pgmap v708: 97 pgs: 97 active+clean; 1.2 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 KiB/s wr, 217 op/s 2024-06-06T02:46:33.165 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-06-06T02:46:33.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:46:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:34.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:34 smithi082 ceph-mon[31579]: pgmap v709: 97 pgs: 97 active+clean; 253 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 192 op/s 2024-06-06T02:46:35.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:34 smithi103 ceph-mon[36349]: pgmap v709: 97 pgs: 97 active+clean; 253 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 192 op/s 2024-06-06T02:46:35.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:34 smithi184 ceph-mon[36922]: pgmap v709: 97 pgs: 97 active+clean; 253 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 192 op/s 2024-06-06T02:46:37.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:36 smithi103 ceph-mon[36349]: pgmap v710: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.4 KiB/s wr, 145 op/s 2024-06-06T02:46:37.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:36 smithi082 ceph-mon[31579]: pgmap v710: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.4 KiB/s wr, 145 op/s 2024-06-06T02:46:37.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:36 smithi184 ceph-mon[36922]: pgmap v710: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.4 KiB/s wr, 145 op/s 2024-06-06T02:46:38.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:38 smithi082 ceph-mon[31579]: pgmap v711: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 126 op/s 2024-06-06T02:46:39.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:38 smithi103 ceph-mon[36349]: pgmap v711: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 126 op/s 2024-06-06T02:46:39.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:38 smithi184 ceph-mon[36922]: pgmap v711: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 126 op/s 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 -- 172.21.15.82:0/1007456156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c109a30 msgr2=0x7f276c109e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 --2- 172.21.15.82:0/1007456156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c109a30 0x7f276c109e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2758009960 tx=0x7f275802a460 comp rx=0 tx=0).stop 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 -- 172.21.15.82:0/1007456156 shutdown_connections 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 --2- 172.21.15.82:0/1007456156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c10a380 0x7f276c111ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 --2- 172.21.15.82:0/1007456156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c109a30 0x7f276c109e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 --2- 172.21.15.82:0/1007456156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c105100 0x7f276c105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 -- 172.21.15.82:0/1007456156 >> 172.21.15.82:0/1007456156 conn(0x7f276c100b60 msgr2=0x7f276c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 -- 172.21.15.82:0/1007456156 shutdown_connections 2024-06-06T02:46:40.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.780+0000 7f2771400640 1 -- 172.21.15.82:0/1007456156 wait complete. 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.781+0000 7f2771400640 1 Processor -- start 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.781+0000 7f2771400640 1 -- start start 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c109a30 0x7f276c1a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c10a380 0x7f276c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f276c1150c0 con 0x7f276c105100 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f276c114f40 con 0x7f276c109a30 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2771400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f276c115240 con 0x7f276c10a380 2024-06-06T02:46:40.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f276a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f276a800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53658/0 (socket says 172.21.15.82:53658) 2024-06-06T02:46:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f276a800640 1 -- 172.21.15.82:0/3379544511 learned_addr learned my addr 172.21.15.82:0/3379544511 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f2769e00640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c109a30 0x7f276c1a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:40.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:46:40.531 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:46:15.533437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.782+0000 7f276b200640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c10a380 0x7f276c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 -- 172.21.15.82:0/3379544511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c10a380 msgr2=0x7f276c19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c10a380 0x7f276c19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 -- 172.21.15.82:0/3379544511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c109a30 msgr2=0x7f276c1a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c109a30 0x7f276c1a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 -- 172.21.15.82:0/3379544511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c19c040 con 0x7f276c105100 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f276a800640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d770 tx=0x7f275c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:40.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c017070 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f275c0054d0 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c19c330 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c004c30 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.783+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c19c7f0 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.785+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c105510 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.787+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f275c004dd0 con 0x7f276c105100 2024-06-06T02:46:40.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.789+0000 7f2763400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 0x7f27500b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.789+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f275c0e2040 con 0x7f276c105100 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.789+0000 7f2769e00640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 0x7f27500b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.790+0000 7f2769e00640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 0x7f27500b4d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f275802aa50 tx=0x7f2758005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:39.790+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f275c0a9710 con 0x7f276c105100 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.065+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f276c10d3a0 con 0x7f276c105100 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.067+0000 7f2763400640 1 -- 172.21.15.82:0/3379544511 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11871 (secure 0 0 0) 0x7f275c0ada10 con 0x7f276c105100 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 msgr2=0x7f27500b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 0x7f27500b4d00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f275802aa50 tx=0x7f2758005d50 comp rx=0 tx=0).stop 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 msgr2=0x7f276c1a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f275c00d770 tx=0x7f275c00dc30 comp rx=0 tx=0).stop 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 shutdown_connections 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f27500b27f0 0x7f27500b4d00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.069+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f276c10a380 0x7f276c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.070+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f276c109a30 0x7f276c1a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.070+0000 7f2771400640 1 --2- 172.21.15.82:0/3379544511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f276c105100 0x7f276c1a17b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.070+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 >> 172.21.15.82:0/3379544511 conn(0x7f276c100b60 msgr2=0x7f276c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.070+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 shutdown_connections 2024-06-06T02:46:40.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:40.070+0000 7f2771400640 1 -- 172.21.15.82:0/3379544511 wait complete. 2024-06-06T02:46:41.054 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:40 smithi082 ceph-mon[31579]: pgmap v712: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 80 op/s 2024-06-06T02:46:41.054 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:40 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3379544511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:46:41.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:40 smithi103 ceph-mon[36349]: pgmap v712: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 80 op/s 2024-06-06T02:46:41.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:40 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3379544511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:46:41.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:40 smithi184 ceph-mon[36922]: pgmap v712: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 80 op/s 2024-06-06T02:46:41.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:40 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3379544511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:46:41.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-06-06T02:46:41.967 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:43.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:42 smithi103 ceph-mon[36349]: pgmap v713: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 59 op/s 2024-06-06T02:46:43.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:42 smithi082 ceph-mon[31579]: pgmap v713: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 59 op/s 2024-06-06T02:46:43.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:42 smithi184 ceph-mon[36922]: pgmap v713: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 59 op/s 2024-06-06T02:46:44.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 -- 172.21.15.82:0/204970524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 msgr2=0x7fb494109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 --2- 172.21.15.82:0/204970524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb494109720 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb484009960 tx=0x7fb48402a460 comp rx=0 tx=0).stop 2024-06-06T02:46:44.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 -- 172.21.15.82:0/204970524 shutdown_connections 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 --2- 172.21.15.82:0/204970524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410e590 0x7fb494115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 --2- 172.21.15.82:0/204970524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410dc40 0x7fb49410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 --2- 172.21.15.82:0/204970524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb494109720 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 -- 172.21.15.82:0/204970524 >> 172.21.15.82:0/204970524 conn(0x7fb494078a80 msgr2=0x7fb494107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.392+0000 7fb493e00640 1 -- 172.21.15.82:0/204970524 shutdown_connections 2024-06-06T02:46:44.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.393+0000 7fb493e00640 1 -- 172.21.15.82:0/204970524 wait complete. 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 Processor -- start 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 -- start start 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410e590 0x7fb4941a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941192b0 con 0x7fb494109310 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb494119130 con 0x7fb49410e590 2024-06-06T02:46:44.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.394+0000 7fb493e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb494119430 con 0x7fb49410dc40 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb492a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45654/0 (socket says 172.21.15.82:45654) 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb492a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42604/0 (socket says 172.21.15.82:42604) 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 -- 172.21.15.82:0/2682272104 learned_addr learned my addr 172.21.15.82:0/2682272104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb493400640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410e590 0x7fb4941a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 -- 172.21.15.82:0/2682272104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410e590 msgr2=0x7fb4941a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410e590 0x7fb4941a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 -- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 msgr2=0x7fb49419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb48a000640 1 -- 172.21.15.82:0/2682272104 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4941a4c00 con 0x7fb49410dc40 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.395+0000 7fb492a00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb48a000640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e9a0 tx=0x7fb47c00eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb48be00640 1 -- 172.21.15.82:0/2682272104 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00cd80 con 0x7fb49410dc40 2024-06-06T02:46:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb48be00640 1 -- 172.21.15.82:0/2682272104 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb47c0035f0 con 0x7fb49410dc40 2024-06-06T02:46:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4941a4ef0 con 0x7fb49410dc40 2024-06-06T02:46:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb48be00640 1 -- 172.21.15.82:0/2682272104 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c010690 con 0x7fb49410dc40 2024-06-06T02:46:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.396+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4941ac870 con 0x7fb49410dc40 2024-06-06T02:46:44.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 Processor -- start 2024-06-06T02:46:44.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 -- start start 2024-06-06T02:46:44.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb48be00640 1 -- 172.21.15.82:0/2682272104 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb47c003aa0 con 0x7fb49410dc40 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e6c070 0x5555c3212520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c3212fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.400+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555c3186de0 con 0x5555c2e4b390 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555c3176380 con 0x5555c2e431b0 2024-06-06T02:46:44.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5555c317a3c0 con 0x5555c2e6c070 2024-06-06T02:46:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42612/0 (socket says 172.21.15.82:42612) 2024-06-06T02:46:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 -- 172.21.15.82:0/1615681291 learned_addr learned my addr 172.21.15.82:0/1615681291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb493400640 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e6c070 0x5555c3212520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb48a000640 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c3212fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 -- 172.21.15.82:0/1615681291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e6c070 msgr2=0x5555c3212520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e6c070 0x5555c3212520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 -- 172.21.15.82:0/1615681291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 msgr2=0x5555c3212fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c3212fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.401+0000 7fb492a00640 1 -- 172.21.15.82:0/1615681291 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c2ed7650 con 0x5555c2e431b0 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb492a00640 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb484009960 tx=0x7fb484005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f73c693d61791f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb48be00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 0x7fb4780b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb483e00640 1 -- 172.21.15.82:0/1615681291 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484040070 con 0x5555c2e431b0 2024-06-06T02:46:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb483e00640 1 -- 172.21.15.82:0/1615681291 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb484005560 con 0x5555c2e431b0 2024-06-06T02:46:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb483e00640 1 -- 172.21.15.82:0/1615681291 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484035040 con 0x5555c2e431b0 2024-06-06T02:46:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb48be00640 1 -- 172.21.15.82:0/2682272104 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb47c0e24d0 con 0x7fb49410dc40 2024-06-06T02:46:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.402+0000 7fb493400640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 0x7fb4780b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 -- 172.21.15.82:0/1615681291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 msgr2=0x5555c3212a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb484009960 tx=0x7fb484005d50 comp rx=0 tx=0).stop 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 -- 172.21.15.82:0/1615681291 shutdown_connections 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c3212fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3212a60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/1615681291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e6c070 0x5555c3212520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 -- 172.21.15.82:0/1615681291 >> 172.21.15.82:0/1615681291 conn(0x5555c2e60460 msgr2=0x5555c320ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb493400640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 0x7fb4780b4d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5555c320f740 tx=0x7fb48c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 -- 172.21.15.82:0/1615681291 shutdown_connections 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.403+0000 7fb49ff1d740 1 -- 172.21.15.82:0/1615681291 wait complete. 2024-06-06T02:46:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.404+0000 7fb49ff1d740 1 -- start start 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.404+0000 7fb49ff1d740 1 Processor -- start 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c321eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c321ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555c2fda700 con 0x5555c2e6c070 2024-06-06T02:46:44.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5555c31136e0 con 0x5555c2e431b0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x5555c321f630 con 0x5555c2e4b390 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb49ff1d740 10 client.0 _ll_register_callbacks cb 0x5555c311fda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb493400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c321ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb48a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c321eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42628/0 (socket says 172.21.15.82:42628) 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 -- 172.21.15.82:0/2609678844 learned_addr learned my addr 172.21.15.82:0/2609678844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb493400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c321ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42618/0 (socket says 172.21.15.82:42618) 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 -- 172.21.15.82:0/2609678844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 msgr2=0x5555c321eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c321eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 -- 172.21.15.82:0/2609678844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 msgr2=0x5555c321ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c321ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb492a00640 1 -- 172.21.15.82:0/2609678844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c313ef90 con 0x5555c2e431b0 2024-06-06T02:46:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.405+0000 7fb48a000640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c321eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.406+0000 7fb492a00640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb484005ab0 tx=0x7fb48402a460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bd9ef8a1294825a server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.406+0000 7fb480c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.406+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484035070 con 0x5555c2e431b0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.406+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb484005560 con 0x5555c2e431b0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.406+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb484003a50 con 0x5555c2e431b0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb484040040 con 0x5555c2e431b0 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 10 client.26177 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5555c322b7a0 con 0x5555c2e431b0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb484005560 con 0x5555c2e431b0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb48403cbd0 con 0x5555c2e431b0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 10 client.26177 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 10 client.26177 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 20 client.26177 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.407+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2e2a9f0 0x5555c322eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.408+0000 7fb49ff1d740 4 client.26177 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.408+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555c3188d30 con 0x5555c2e2a9f0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.408+0000 7fb48a000640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2e2a9f0 0x5555c322eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.408+0000 7fb48a000640 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2e2a9f0 0x5555c322eb00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb49606b0f906369 server_cookie=467c2254e57478d2 in_seq=0 out_seq=0 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.408+0000 7fb480c00640 10 client.26177 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:46:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.409+0000 7fb480c00640 1 -- 172.21.15.82:0/2609678844 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5555c3188d30 con 0x5555c2e2a9f0 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.409+0000 7fb480c00640 10 client.26177 handle_command_reply: tid=0 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.409+0000 7fb49ff1d740 1 client.26177 shutdown 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.409+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 msgr2=0x5555c321e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.409+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb484005ab0 tx=0x7fb48402a460 comp rx=0 tx=0).stop 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 shutdown_connections 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2e2a9f0 0x5555c322eb00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c321ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c321eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2609678844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c321e5b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb480c00640 0 client.26177 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 >> 172.21.15.82:0/2609678844 conn(0x5555c2e60460 msgr2=0x5555c3212300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 shutdown_connections 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2609678844 wait complete. 2024-06-06T02:46:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.410+0000 7fb49ff1d740 20 client.26177 trim_cache size 0 max 16384 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 Processor -- start 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 -- start start 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c32129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c3231b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b7620 con 0x5555c2e6c070 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b4e90 con 0x5555c2e431b0 2024-06-06T02:46:44.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.425+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b2cc0 con 0x5555c2e4b390 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb48a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c32129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42642/0 (socket says 172.21.15.82:42642) 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 -- 172.21.15.82:0/556960124 learned_addr learned my addr 172.21.15.82:0/556960124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb493400640 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c3231b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 -- 172.21.15.82:0/556960124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 msgr2=0x5555c32129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c32129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 -- 172.21.15.82:0/556960124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 msgr2=0x5555c3231b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c3231b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.426+0000 7fb492a00640 1 -- 172.21.15.82:0/556960124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c32090e0 con 0x5555c2e431b0 2024-06-06T02:46:44.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.427+0000 7fb492a00640 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb484033000 tx=0x7fb484005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a8625fa103fa15 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.427+0000 7fb483400640 1 -- 172.21.15.82:0/556960124 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484035040 con 0x5555c2e431b0 2024-06-06T02:46:44.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.427+0000 7fb483400640 1 -- 172.21.15.82:0/556960124 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48404c070 con 0x5555c2e431b0 2024-06-06T02:46:44.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.427+0000 7fb483400640 1 -- 172.21.15.82:0/556960124 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484050a00 con 0x5555c2e431b0 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- 172.21.15.82:0/556960124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 msgr2=0x5555c3218260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb484033000 tx=0x7fb484005d50 comp rx=0 tx=0).stop 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- 172.21.15.82:0/556960124 shutdown_connections 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e6c070 0x5555c3231b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e4b390 0x5555c32129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/556960124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e431b0 0x5555c3218260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- 172.21.15.82:0/556960124 >> 172.21.15.82:0/556960124 conn(0x5555c2e60460 msgr2=0x5555c32122c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- 172.21.15.82:0/556960124 shutdown_connections 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- 172.21.15.82:0/556960124 wait complete. 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.428+0000 7fb49ff1d740 1 -- start start 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 Processor -- start 2024-06-06T02:46:44.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 0x5555c328e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e6c070 0x5555c32315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b3350 con 0x5555c2e4b390 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b47c0 con 0x5555c2e6c070 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b3a20 con 0x5555c2e431b0 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb49ff1d740 10 client.0 _ll_register_callbacks cb 0x7fb48c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb492a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 0x5555c328e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.429+0000 7fb48a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42638/0 (socket says 172.21.15.82:42638) 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 -- 172.21.15.82:0/2934173807 learned_addr learned my addr 172.21.15.82:0/2934173807 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb493400640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e6c070 0x5555c32315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 -- 172.21.15.82:0/2934173807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 msgr2=0x5555c328e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 0x5555c328e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 -- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e6c070 msgr2=0x5555c32315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e6c070 0x5555c32315c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 -- 172.21.15.82:0/2934173807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c3231c00 con 0x5555c2e4b390 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb492a00640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 0x5555c328e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb48a000640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0dff90 tx=0x7fb47c003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13aaecd426c72e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:44.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.430+0000 7fb480c00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0aa1b0 con 0x5555c2e4b390 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fb47c0a60a0 con 0x5555c2e4b390 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb48404c070 con 0x5555c2e4b390 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb47c0a9ab0 con 0x5555c2e4b390 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb49ff1d740 10 client.15834 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:44.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5555c3296f50 con 0x5555c2e4b390 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.431+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb48404c070 con 0x5555c2e4b390 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fb47c0a9d10 con 0x5555c2e4b390 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 10 client.15834 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 10 client.15834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.b 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 20 client.15834 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2dffda0 0x5555c32996f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 4 client.15834 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 --> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555c31847d0 con 0x5555c2dffda0 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.432+0000 7fb492a00640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2dffda0 0x5555c32996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb492a00640 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2dffda0 0x5555c32996f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4444fd9409b55568 server_cookie=9762f7b667606515 in_seq=0 out_seq=0 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb480c00640 10 client.15834 ms_handle_connect on v2:172.21.15.103:6838/426995210 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb480c00640 1 -- 172.21.15.82:0/2934173807 <== mds.2 v2:172.21.15.103:6838/426995210 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555c31847d0 con 0x5555c2dffda0 2024-06-06T02:46:44.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb480c00640 10 client.15834 handle_command_reply: tid=0 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 client.15834 shutdown 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 msgr2=0x5555c328ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0dff90 tx=0x7fb47c003a10 comp rx=0 tx=0).stop 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 shutdown_connections 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:6838/426995210,v1:172.21.15.103:6839/426995210] conn(0x5555c2dffda0 0x5555c32996f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5555c2e6c070 0x5555c32315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555c2e4b390 0x5555c328ecd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 --2- 172.21.15.82:0/2934173807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5555c2e431b0 0x5555c328e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 >> 172.21.15.82:0/2934173807 conn(0x5555c2e60460 msgr2=0x5555c3216760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.433+0000 7fb480c00640 0 client.15834 ms_handle_reset on v2:172.21.15.103:6838/426995210 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 shutdown_connections 2024-06-06T02:46:44.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb49ff1d740 1 -- 172.21.15.82:0/2934173807 wait complete. 2024-06-06T02:46:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb49ff1d740 20 client.15834 trim_cache size 0 max 16384 2024-06-06T02:46:44.437 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:46:44.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 msgr2=0x7fb4780b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 0x7fb4780b4d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x5555c320f740 tx=0x7fb48c009500 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 msgr2=0x7fb4941a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.434+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e9a0 tx=0x7fb47c00eda0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 shutdown_connections 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb49410e590 0x7fb4941a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fb4780b27f0 0x7fb4780b4d00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb49410dc40 0x7fb4941a02f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 --2- 172.21.15.82:0/2682272104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb494109310 0x7fb49419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 >> 172.21.15.82:0/2682272104 conn(0x7fb494078a80 msgr2=0x7fb4940791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 shutdown_connections 2024-06-06T02:46:44.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:44.435+0000 7fb493e00640 1 -- 172.21.15.82:0/2682272104 wait complete. 2024-06-06T02:46:45.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:44 smithi103 ceph-mon[36349]: pgmap v714: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-06T02:46:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:44 smithi082 ceph-mon[31579]: pgmap v714: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-06T02:46:45.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:44 smithi184 ceph-mon[36922]: pgmap v714: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 31 op/s 2024-06-06T02:46:45.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-06-06T02:46:45.689 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:47.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:46 smithi103 ceph-mon[36349]: pgmap v715: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-06T02:46:47.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:46 smithi082 ceph-mon[31579]: pgmap v715: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-06T02:46:47.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:46 smithi184 ceph-mon[36922]: pgmap v715: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-06-06T02:46:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 -- 172.21.15.82:0/3248269250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc104730 msgr2=0x7f71fc10cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 --2- 172.21.15.82:0/3248269250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc104730 0x7f71fc10cc80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009900 tx=0x7f71e402a480 comp rx=0 tx=0).stop 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 -- 172.21.15.82:0/3248269250 shutdown_connections 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 --2- 172.21.15.82:0/3248269250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc10d210 0x7f71fc10f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 --2- 172.21.15.82:0/3248269250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc104730 0x7f71fc10cc80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 --2- 172.21.15.82:0/3248269250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc103de0 0x7f71fc1041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 -- 172.21.15.82:0/3248269250 >> 172.21.15.82:0/3248269250 conn(0x7f71fc078a90 msgr2=0x7f71fc078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 -- 172.21.15.82:0/3248269250 shutdown_connections 2024-06-06T02:46:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.646+0000 7f7200e00640 1 -- 172.21.15.82:0/3248269250 wait complete. 2024-06-06T02:46:48.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.647+0000 7f7200e00640 1 Processor -- start 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 -- start start 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 0x7f71fc1a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 0x7f71fc1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 0x7f71fc19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc112e70 con 0x7f71fc103de0 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc112cf0 con 0x7f71fc10d210 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.648+0000 7f7200e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc112ff0 con 0x7f71fc104730 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 0x7f71fc1a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 0x7f71fc1a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42658/0 (socket says 172.21.15.82:42658) 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71f9e00640 1 -- 172.21.15.82:0/333300348 learned_addr learned my addr 172.21.15.82:0/333300348 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71f3e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 0x7f71fc1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 0x7f71fc19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 -- 172.21.15.82:0/333300348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 msgr2=0x7f71fc1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 0x7f71fc1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 -- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 msgr2=0x7f71fc1a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 0x7f71fc1a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71fa800640 1 -- 172.21.15.82:0/333300348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc19bf70 con 0x7f71fc10d210 2024-06-06T02:46:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.649+0000 7f71f3e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 0x7f71fc1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 0x7f71fc19b900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71f4009fd0 tx=0x7f71f400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f71f2a00640 1 -- 172.21.15.82:0/333300348 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f400ce20 con 0x7f71fc10d210 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc19c260 con 0x7f71fc10d210 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f71f2a00640 1 -- 172.21.15.82:0/333300348 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71f4005020 con 0x7f71fc10d210 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f71f2a00640 1 -- 172.21.15.82:0/333300348 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f4010690 con 0x7f71fc10d210 2024-06-06T02:46:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.650+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1a8570 con 0x7f71fc10d210 2024-06-06T02:46:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.654+0000 7f7207488740 1 Processor -- start 2024-06-06T02:46:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.654+0000 7f71f2a00640 1 -- 172.21.15.82:0/333300348 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f71f40054d0 con 0x7f71fc10d210 2024-06-06T02:46:48.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.654+0000 7f7207488740 1 -- start start 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c45c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c45cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56277c3d0de0 con 0x56277c0b6070 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56277c3c0380 con 0x56277c095390 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f7207488740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56277c3c43c0 con 0x56277c08d1b0 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42668/0 (socket says 172.21.15.82:42668) 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f71f3e00640 1 -- 172.21.15.82:0/2178893444 learned_addr learned my addr 172.21.15.82:0/2178893444 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:48.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f71f3e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c45cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.655+0000 7f71f9e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c45c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 -- 172.21.15.82:0/2178893444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 msgr2=0x56277c45c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c45c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f2a00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 0x7f71e00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 -- 172.21.15.82:0/2178893444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 msgr2=0x56277c45cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c45cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 -- 172.21.15.82:0/2178893444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56277c121650 con 0x56277c0b6070 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f9e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c45c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f2a00640 1 -- 172.21.15.82:0/333300348 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f71f40e2880 con 0x7f71fc10d210 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 0x7f71e00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.656+0000 7f71f3e00640 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005e00 tx=0x7f71e4005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7256b1db6ce388 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.657+0000 7f71eb400640 1 -- 172.21.15.82:0/2178893444 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4035030 con 0x56277c0b6070 2024-06-06T02:46:48.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.657+0000 7f71eb400640 1 -- 172.21.15.82:0/2178893444 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e4004c20 con 0x56277c0b6070 2024-06-06T02:46:48.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.657+0000 7f71eb400640 1 -- 172.21.15.82:0/2178893444 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4003b50 con 0x56277c0b6070 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 -- 172.21.15.82:0/2178893444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 msgr2=0x56277c45c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f71fa800640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 0x7f71e00b4d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f71f40a9df0 tx=0x7f71f4016fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005e00 tx=0x7f71e4005d70 comp rx=0 tx=0).stop 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 -- 172.21.15.82:0/2178893444 shutdown_connections 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c45cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c45c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 --2- 172.21.15.82:0/2178893444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c45c340 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 -- 172.21.15.82:0/2178893444 >> 172.21.15.82:0/2178893444 conn(0x56277c0aa460 msgr2=0x56277c458bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 -- 172.21.15.82:0/2178893444 shutdown_connections 2024-06-06T02:46:48.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.658+0000 7f7207488740 1 -- 172.21.15.82:0/2178893444 wait complete. 2024-06-06T02:46:48.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.659+0000 7f7207488740 1 -- start start 2024-06-06T02:46:48.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.659+0000 7f7207488740 1 Processor -- start 2024-06-06T02:46:48.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c466a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c46c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56277c224700 con 0x56277c0b6070 2024-06-06T02:46:48.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56277c35d6e0 con 0x56277c095390 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56277c469450 con 0x56277c08d1b0 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f7207488740 10 client.0 _ll_register_callbacks cb 0x56277c369da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c466a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c466a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:45730/0 (socket says 172.21.15.82:45730) 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42698/0 (socket says 172.21.15.82:42698) 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f3e00640 1 -- 172.21.15.82:0/582086072 learned_addr learned my addr 172.21.15.82:0/582086072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f3e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c46c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f9e00640 1 -- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 msgr2=0x56277c466a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f9e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c466a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.660+0000 7f71f9e00640 1 -- 172.21.15.82:0/582086072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 msgr2=0x56277c46c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71f9e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c46c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71f9e00640 1 -- 172.21.15.82:0/582086072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56277c388f90 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71f9e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56277c459e50 tx=0x7f71ec012ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4ab267fce5247c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00f8f0 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f71ec00fa90 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.661+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e4004c20 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71ec00fc90 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 10 client.26195 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56277c4755b0 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e4004c20 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f71ec005380 con 0x56277c095390 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 10 client.26195 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:48.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 10 client.26195 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:46:48.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 20 client.26195 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:48.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c0749f0 0x56277c478b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 4 client.26195 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:48.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.662+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56277c3d2d30 con 0x56277c0749f0 2024-06-06T02:46:48.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.663+0000 7f71f3e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c0749f0 0x56277c478b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.663+0000 7f71f3e00640 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c0749f0 0x56277c478b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7be8ea1c01228c7 server_cookie=452f6cd34468458 in_seq=0 out_seq=0 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.663+0000 7f71dfe00640 10 client.26195 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.664+0000 7f71dfe00640 1 -- 172.21.15.82:0/582086072 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56277c3d2d30 con 0x56277c0749f0 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.664+0000 7f71dfe00640 10 client.26195 handle_command_reply: tid=0 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.664+0000 7f7207488740 1 client.26195 shutdown 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 msgr2=0x56277c466fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x56277c459e50 tx=0x7f71ec012ca0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 shutdown_connections 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c0749f0 0x56277c478b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c0b6070 0x56277c46c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c095390 0x56277c466fb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 --2- 172.21.15.82:0/582086072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c08d1b0 0x56277c466a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f71dfe00640 0 client.26195 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 >> 172.21.15.82:0/582086072 conn(0x56277c0aa460 msgr2=0x56277c45e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 shutdown_connections 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 1 -- 172.21.15.82:0/582086072 wait complete. 2024-06-06T02:46:48.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.665+0000 7f7207488740 20 client.26195 trim_cache size 0 max 16384 2024-06-06T02:46:48.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.680+0000 7f7207488740 1 Processor -- start 2024-06-06T02:46:48.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.680+0000 7f7207488740 1 -- start start 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c4734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c465850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1b3320 con 0x56277c095390 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1b0b90 con 0x56277c08d1b0 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f7207488740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1ae9c0 con 0x56277c0b6070 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:42714/0 (socket says 172.21.15.82:42714) 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c4734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 -- 172.21.15.82:0/334861685 learned_addr learned my addr 172.21.15.82:0/334861685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c465850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 -- 172.21.15.82:0/334861685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 msgr2=0x56277c465850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c465850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 -- 172.21.15.82:0/334861685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 msgr2=0x56277c4734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c4734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.681+0000 7f71f3e00640 1 -- 172.21.15.82:0/334861685 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56277c459c80 con 0x56277c08d1b0 2024-06-06T02:46:48.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.682+0000 7f71f3e00640 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009650 tx=0x7f71e40095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b930c5a17d7016 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.682+0000 7f71eaa00640 1 -- 172.21.15.82:0/334861685 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4035040 con 0x56277c08d1b0 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.682+0000 7f71eaa00640 1 -- 172.21.15.82:0/334861685 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e4004c20 con 0x56277c08d1b0 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.682+0000 7f71eaa00640 1 -- 172.21.15.82:0/334861685 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e4003d50 con 0x56277c08d1b0 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 -- 172.21.15.82:0/334861685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 msgr2=0x56277c46c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009650 tx=0x7f71e40095e0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 -- 172.21.15.82:0/334861685 shutdown_connections 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c465850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c4734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 --2- 172.21.15.82:0/334861685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c46c6c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 -- 172.21.15.82:0/334861685 >> 172.21.15.82:0/334861685 conn(0x56277c0aa460 msgr2=0x56277c465140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 -- 172.21.15.82:0/334861685 shutdown_connections 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.683+0000 7f7207488740 1 -- 172.21.15.82:0/334861685 wait complete. 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.684+0000 7f7207488740 1 -- start start 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.684+0000 7f7207488740 1 Processor -- start 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.684+0000 7f7207488740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c473240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c46eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1af050 con 0x56277c095390 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1b04c0 con 0x56277c08d1b0 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc1af720 con 0x56277c0b6070 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f7207488740 10 client.0 _ll_register_callbacks cb 0x7f71ec009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:48.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c473240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42690/0 (socket says 172.21.15.82:42690) 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 -- 172.21.15.82:0/1828721468 learned_addr learned my addr 172.21.15.82:0/1828721468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f3e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c46eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 -- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 msgr2=0x56277c46eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c46eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 -- 172.21.15.82:0/1828721468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 msgr2=0x56277c473240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c473240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f9e00640 1 -- 172.21.15.82:0/1828721468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56277c46f120 con 0x56277c095390 2024-06-06T02:46:48.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.685+0000 7f71f3e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c473240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f71f9e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0059f0 tx=0x7f71ec00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f531c5f8d8b5729f server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f71dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-06-06T02:46:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec0123a0 con 0x56277c095390 2024-06-06T02:46:48.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f71ec01cb70 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71e4004c20 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71ec01cd70 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f7207488740 10 client.15852 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.686+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56277c4e9910 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e4004c20 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7f71ec003970 con 0x56277c095390 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 10 client.15852 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 10 client.15852 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 20 client.15852 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c049da0 0x56277c4ec130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 4 client.15852 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.687+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 --> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56277c3ce7d0 con 0x56277c049da0 2024-06-06T02:46:48.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f71f3e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c049da0 0x56277c4ec130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f71f3e00640 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c049da0 0x56277c4ec130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bbe3facdf965a4e server_cookie=285033be31a9db92 in_seq=0 out_seq=0 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f71dfe00640 10 client.15852 ms_handle_connect on v2:172.21.15.184:6838/1945283306 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f71dfe00640 1 -- 172.21.15.82:0/1828721468 <== mds.1 v2:172.21.15.184:6838/1945283306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56277c3ce7d0 con 0x56277c049da0 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f71dfe00640 10 client.15852 handle_command_reply: tid=0 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.688+0000 7f7207488740 1 client.15852 shutdown 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 msgr2=0x56277c46e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0059f0 tx=0x7f71ec00fc00 comp rx=0 tx=0).stop 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 shutdown_connections 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:6838/1945283306,v1:172.21.15.184:6839/1945283306] conn(0x56277c049da0 0x56277c4ec130 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56277c0b6070 0x56277c46eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56277c095390 0x56277c46e5a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 --2- 172.21.15.82:0/1828721468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56277c08d1b0 0x56277c473240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f71dfe00640 0 client.15852 ms_handle_reset on v2:172.21.15.184:6838/1945283306 2024-06-06T02:46:48.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 >> 172.21.15.82:0/1828721468 conn(0x56277c0aa460 msgr2=0x56277c4571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 shutdown_connections 2024-06-06T02:46:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 1 -- 172.21.15.82:0/1828721468 wait complete. 2024-06-06T02:46:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.689+0000 7f7207488740 20 client.15852 trim_cache size 0 max 16384 2024-06-06T02:46:48.692 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 msgr2=0x7f71e00b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 0x7f71e00b4d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f71f40a9df0 tx=0x7f71f4016fa0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 msgr2=0x7f71fc19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 0x7f71fc19b900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71f4009fd0 tx=0x7f71f400ef10 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 shutdown_connections 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71fc10d210 0x7f71fc19b900 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f71e00b2870 0x7f71e00b4d80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71fc104730 0x7f71fc1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 --2- 172.21.15.82:0/333300348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71fc103de0 0x7f71fc1a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 >> 172.21.15.82:0/333300348 conn(0x7f71fc078a90 msgr2=0x7f71fc1091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.690+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 shutdown_connections 2024-06-06T02:46:48.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:48.691+0000 7f7200e00640 1 -- 172.21.15.82:0/333300348 wait complete. 2024-06-06T02:46:48.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:48 smithi082 ceph-mon[31579]: pgmap v716: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:46:49.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:48 smithi103 ceph-mon[36349]: pgmap v716: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:46:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:48 smithi184 ceph-mon[36922]: pgmap v716: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:46:49.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-06-06T02:46:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:50.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:50 smithi082 ceph-mon[31579]: pgmap v717: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:51.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:50 smithi103 ceph-mon[36349]: pgmap v717: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:51.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:50 smithi184 ceph-mon[36922]: pgmap v717: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.298+0000 7fcf01000640 1 -- 172.21.15.82:0/1650236766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc106dc0 msgr2=0x7fcefc1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.298+0000 7fcf01000640 1 --2- 172.21.15.82:0/1650236766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc106dc0 0x7fcefc1072a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009930 tx=0x7fcef402a420 comp rx=0 tx=0).stop 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.298+0000 7fcf01000640 1 -- 172.21.15.82:0/1650236766 shutdown_connections 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.298+0000 7fcf01000640 1 --2- 172.21.15.82:0/1650236766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc106dc0 0x7fcefc1072a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.299+0000 7fcf01000640 1 --2- 172.21.15.82:0/1650236766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc1022d0 0x7fcefc106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.299+0000 7fcf01000640 1 --2- 172.21.15.82:0/1650236766 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc101980 0x7fcefc101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.299+0000 7fcf01000640 1 -- 172.21.15.82:0/1650236766 >> 172.21.15.82:0/1650236766 conn(0x7fcefc0fd6f0 msgr2=0x7fcefc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.299+0000 7fcf01000640 1 -- 172.21.15.82:0/1650236766 shutdown_connections 2024-06-06T02:46:52.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.299+0000 7fcf01000640 1 -- 172.21.15.82:0/1650236766 wait complete. 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.300+0000 7fcf01000640 1 Processor -- start 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.300+0000 7fcf01000640 1 -- start start 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc101980 0x7fcefc1a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc106dc0 0x7fcefc19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1192b0 con 0x7fcefc1022d0 2024-06-06T02:46:52.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc119130 con 0x7fcefc101980 2024-06-06T02:46:52.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcf01000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc119430 con 0x7fcefc106dc0 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcefaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcefb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc101980 0x7fcefc1a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcefaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53860/0 (socket says 172.21.15.82:53860) 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcefaa00640 1 -- 172.21.15.82:0/1632751171 learned_addr learned my addr 172.21.15.82:0/1632751171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.301+0000 7fcefbe00640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc106dc0 0x7fcefc19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 -- 172.21.15.82:0/1632751171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc106dc0 msgr2=0x7fcefc19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc106dc0 0x7fcefc19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 -- 172.21.15.82:0/1632751171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc101980 msgr2=0x7fcefc1a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc101980 0x7fcefc1a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 -- 172.21.15.82:0/1632751171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc1a01a0 con 0x7fcefc1022d0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcefaa00640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fceec00eb90 tx=0x7fceec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcef3e00640 1 -- 172.21.15.82:0/1632751171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec010630 con 0x7fcefc1022d0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcef3e00640 1 -- 172.21.15.82:0/1632751171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceec00ee90 con 0x7fcefc1022d0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcefc1a0490 con 0x7fcefc1022d0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcef3e00640 1 -- 172.21.15.82:0/1632751171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec018ac0 con 0x7fcefc1022d0 2024-06-06T02:46:52.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.302+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcefc1ac770 con 0x7fcefc1022d0 2024-06-06T02:46:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 Processor -- start 2024-06-06T02:46:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 -- start start 2024-06-06T02:46:52.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d914fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56233d888e10 con 0x56233d56e070 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56233d8783b0 con 0x56233d54d390 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.306+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56233d87c3f0 con 0x56233d5451b0 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53876/0 (socket says 172.21.15.82:53876) 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 -- 172.21.15.82:0/3600699838 learned_addr learned my addr 172.21.15.82:0/3600699838 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefb400640 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 -- 172.21.15.82:0/3600699838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 msgr2=0x56233d914a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 -- 172.21.15.82:0/3600699838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 msgr2=0x56233d914fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-06-06T02:46:52.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d914fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcefbe00640 1 -- 172.21.15.82:0/3600699838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56233d5d9650 con 0x56233d56e070 2024-06-06T02:46:52.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.307+0000 7fcef3e00640 1 -- 172.21.15.82:0/1632751171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fceec018c60 con 0x7fcefc1022d0 2024-06-06T02:46:52.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.308+0000 7fcefbe00640 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009930 tx=0x7fcef4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e7ad54ceae036c server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.308+0000 7fcef0c00640 1 -- 172.21.15.82:0/3600699838 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4040070 con 0x56233d56e070 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.308+0000 7fcef0c00640 1 -- 172.21.15.82:0/3600699838 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef40044c0 con 0x56233d56e070 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.308+0000 7fcef0c00640 1 -- 172.21.15.82:0/3600699838 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4035040 con 0x56233d56e070 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 -- 172.21.15.82:0/3600699838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 msgr2=0x56233d914550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009930 tx=0x7fcef4005f10 comp rx=0 tx=0).stop 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 -- 172.21.15.82:0/3600699838 shutdown_connections 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d914fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/3600699838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d914550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.309+0000 7fcf08b6e740 1 -- 172.21.15.82:0/3600699838 >> 172.21.15.82:0/3600699838 conn(0x56233d562460 msgr2=0x56233d910dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcf08b6e740 1 -- 172.21.15.82:0/3600699838 shutdown_connections 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcef3e00640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 0x7fcee00b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcf08b6e740 1 -- 172.21.15.82:0/3600699838 wait complete. 2024-06-06T02:46:52.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcef3e00640 1 -- 172.21.15.82:0/1632751171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fceec0e2780 con 0x7fcefc1022d0 2024-06-06T02:46:52.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcefb400640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 0x7fcee00b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.310+0000 7fcf08b6e740 1 -- start start 2024-06-06T02:46:52.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 Processor -- start 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcefb400640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 0x7fcee00b4c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56233d911cb0 tx=0x7fcee4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d54d390 0x56233d920c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56233d6dc700 con 0x56233d54d390 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56233d815710 con 0x56233d56e070 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x56233d921660 con 0x56233d5451b0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.311+0000 7fcf08b6e740 10 client.0 _ll_register_callbacks cb 0x56233d821dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d54d390 0x56233d920c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:55090/0 (socket says 172.21.15.82:55090) 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 -- 172.21.15.82:0/2392367397 learned_addr learned my addr 172.21.15.82:0/2392367397 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefb400640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 -- 172.21.15.82:0/2392367397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 msgr2=0x56233d9206a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9206a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 -- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d54d390 msgr2=0x56233d920c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d54d390 0x56233d920c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 -- 172.21.15.82:0/2392367397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233d840fc0 con 0x56233d56e070 2024-06-06T02:46:52.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcefbe00640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009900 tx=0x7fcef4009230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4252feca24604f05 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.312+0000 7fcee9600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4040070 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56233d88ad60 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mon.2 v2:172.21.15.103:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcef4005200 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcef4035040 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcf08b6e740 10 client.26210 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56233d92d830 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.313+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mon.2 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56233d88ad60 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mon.2 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fcef40314a0 con 0x56233d56e070 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 10 client.26210 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 10 client.26210 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 20 client.26210 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d52c9f0 0x56233d930b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 4 client.26210 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-06T02:46:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56233d886800 con 0x56233d52c9f0 2024-06-06T02:46:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.314+0000 7fcefb400640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d52c9f0 0x56233d930b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.315+0000 7fcefb400640 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d52c9f0 0x56233d930b90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f958d33c07c8953f server_cookie=a0634e532dcbceb3 in_seq=0 out_seq=0 2024-06-06T02:46:52.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.315+0000 7fcee9600640 10 client.26210 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.315+0000 7fcee9600640 1 -- 172.21.15.82:0/2392367397 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56233d886800 con 0x56233d52c9f0 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.315+0000 7fcee9600640 10 client.26210 handle_command_reply: tid=0 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 client.26210 shutdown 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 msgr2=0x56233d91eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009900 tx=0x7fcef4009230 comp rx=0 tx=0).stop 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 shutdown_connections 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d56e070 0x56233d91eae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d52c9f0 0x56233d930b90 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d54d390 0x56233d920c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcee9600640 0 client.26210 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2392367397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9206a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 >> 172.21.15.82:0/2392367397 conn(0x56233d562460 msgr2=0x56233d9162d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 shutdown_connections 2024-06-06T02:46:52.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2392367397 wait complete. 2024-06-06T02:46:52.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.316+0000 7fcf08b6e740 20 client.26210 trim_cache size 0 max 16384 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 Processor -- start 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 -- start start 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d918340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b7660 con 0x56233d56e070 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b4ed0 con 0x56233d54d390 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.331+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b2d00 con 0x56233d5451b0 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53894/0 (socket says 172.21.15.82:53894) 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 -- 172.21.15.82:0/1214333308 learned_addr learned my addr 172.21.15.82:0/1214333308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefb400640 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefaa00640 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d918340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 -- 172.21.15.82:0/1214333308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 msgr2=0x56233d914c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 -- 172.21.15.82:0/1214333308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 msgr2=0x56233d918340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d918340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.332+0000 7fcefbe00640 1 -- 172.21.15.82:0/1214333308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56233d918dc0 con 0x56233d56e070 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.333+0000 7fcefbe00640 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcef402a940 tx=0x7fcef4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951e7c58b473e13b server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.333+0000 7fceebe00640 1 -- 172.21.15.82:0/1214333308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4040070 con 0x56233d56e070 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.333+0000 7fceebe00640 1 -- 172.21.15.82:0/1214333308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef404d070 con 0x56233d56e070 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.333+0000 7fceebe00640 1 -- 172.21.15.82:0/1214333308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40035f0 con 0x56233d56e070 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- 172.21.15.82:0/1214333308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 msgr2=0x56233d918880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcef402a940 tx=0x7fcef4000bc0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- 172.21.15.82:0/1214333308 shutdown_connections 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d918880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d918340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/1214333308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d914c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- 172.21.15.82:0/1214333308 >> 172.21.15.82:0/1214333308 conn(0x56233d562460 msgr2=0x56233d914510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- 172.21.15.82:0/1214333308 shutdown_connections 2024-06-06T02:46:52.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- 172.21.15.82:0/1214333308 wait complete. 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 -- start start 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.334+0000 7fcf08b6e740 1 Processor -- start 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d9315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b3390 con 0x56233d56e070 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b4800 con 0x56233d54d390 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc1b3a60 con 0x56233d5451b0 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcf08b6e740 10 client.0 _ll_register_callbacks cb 0x7fcee40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcefbe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53898/0 (socket says 172.21.15.82:53898) 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcefbe00640 1 -- 172.21.15.82:0/2382462798 learned_addr learned my addr 172.21.15.82:0/2382462798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcefb400640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.335+0000 7fcefaa00640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d9315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 -- 172.21.15.82:0/2382462798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 msgr2=0x56233d9315f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d9315f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 -- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 msgr2=0x56233d9970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 -- 172.21.15.82:0/2382462798 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56233d997610 con 0x56233d5451b0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefbe00640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefaa00640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d9315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcefb400640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9310b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56233d921720 tx=0x7fcee40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aed5846bcc93d64 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcee9600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee40044d0 con 0x56233d5451b0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mon.1 v2:172.21.15.184:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcee402b380 con 0x56233d5451b0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.336+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcef404d070 con 0x56233d5451b0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcee402b580 con 0x56233d5451b0 2024-06-06T02:46:52.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 10 client.26236 fetch_fsmap learned FSMap version 31 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56233d998850 con 0x56233d5451b0 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mon.1 v2:172.21.15.184:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef404d070 con 0x56233d5451b0 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mon.1 v2:172.21.15.184:3300/0 5 ==== fsmap(e 31) ==== 8346+0+0 (secure 0 0 0) 0x7fcee40348d0 con 0x56233d5451b0 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 10 client.26236 fetch_fsmap finished waiting for FSMap version 31 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 10 client.26236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.g 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 20 client.26236 populate_metadata read hostname 'smithi082' 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d501da0 0x56233d99af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 4 client.26236 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.337+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 --> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56233d883f40 con 0x56233d501da0 2024-06-06T02:46:52.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcefaa00640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d501da0 0x56233d99af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:52.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcefaa00640 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d501da0 0x56233d99af30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d380be3a04b88b8 server_cookie=9f8806bcb8c718d1 in_seq=0 out_seq=0 2024-06-06T02:46:52.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcee9600640 10 client.26236 ms_handle_connect on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcee9600640 1 -- 172.21.15.82:0/2382462798 <== mds.0 v2:172.21.15.82:6838/3528791947 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56233d883f40 con 0x56233d501da0 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcee9600640 10 client.26236 handle_command_reply: tid=0 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.338+0000 7fcf08b6e740 1 client.26236 shutdown 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 msgr2=0x56233d9310b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9310b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x56233d921720 tx=0x7fcee40046c0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 shutdown_connections 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:6838/3528791947,v1:172.21.15.82:6839/3528791947] conn(0x56233d501da0 0x56233d99af30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56233d56e070 0x56233d9970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56233d54d390 0x56233d9315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 --2- 172.21.15.82:0/2382462798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56233d5451b0 0x56233d9310b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcee9600640 0 client.26236 ms_handle_reset on v2:172.21.15.82:6838/3528791947 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 >> 172.21.15.82:0/2382462798 conn(0x56233d562460 msgr2=0x56233d9144c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 shutdown_connections 2024-06-06T02:46:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 1 -- 172.21.15.82:0/2382462798 wait complete. 2024-06-06T02:46:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.339+0000 7fcf08b6e740 20 client.26236 trim_cache size 0 max 16384 2024-06-06T02:46:52.343 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-06-06T02:46:52.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 msgr2=0x7fcee00b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 0x7fcee00b4c10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x56233d911cb0 tx=0x7fcee4005f90 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 msgr2=0x7fcefc1a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fceec00eb90 tx=0x7fceec00c6a0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 shutdown_connections 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcee00b2700 0x7fcee00b4c10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcefc106dc0 0x7fcefc19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcefc1022d0 0x7fcefc1a5e00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 --2- 172.21.15.82:0/1632751171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcefc101980 0x7fcefc1a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 >> 172.21.15.82:0/1632751171 conn(0x7fcefc0fd6f0 msgr2=0x7fcefc1047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 shutdown_connections 2024-06-06T02:46:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:52.340+0000 7fcf01000640 1 -- 172.21.15.82:0/1632751171 wait complete. 2024-06-06T02:46:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:52 smithi103 ceph-mon[36349]: pgmap v718: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:46:53.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:52 smithi082 ceph-mon[31579]: pgmap v718: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:46:53.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:52 smithi184 ceph-mon[36922]: pgmap v718: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:46:53.242 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-06-06T02:46:53.244 INFO:tasks.fwd_scrub:done joining 2024-06-06T02:46:53.244 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-06T02:46:53.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 -- 172.21.15.82:0/2053082219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 msgr2=0x7fe6a410a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 --2- 172.21.15.82:0/2053082219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a410a500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe694009900 tx=0x7fe69402a3f0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 -- 172.21.15.82:0/2053082219 shutdown_connections 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 --2- 172.21.15.82:0/2053082219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a410aa40 0x7fe6a4111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 --2- 172.21.15.82:0/2053082219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a410a500 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 --2- 172.21.15.82:0/2053082219 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a4108fd0 0x7fe6a41093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 -- 172.21.15.82:0/2053082219 >> 172.21.15.82:0/2053082219 conn(0x7fe6a4078200 msgr2=0x7fe6a407a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:53.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 -- 172.21.15.82:0/2053082219 shutdown_connections 2024-06-06T02:46:53.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.553+0000 7fe6ab200640 1 -- 172.21.15.82:0/2053082219 wait complete. 2024-06-06T02:46:53.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 Processor -- start 2024-06-06T02:46:53.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 -- start start 2024-06-06T02:46:53.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 0x7fe6a419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a410aa40 0x7fe6a41a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4114b00 con 0x7fe6a410a0f0 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4114980 con 0x7fe6a4108fd0 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.555+0000 7fe6ab200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4114c80 con 0x7fe6a410aa40 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 0x7fe6a419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53920/0 (socket says 172.21.15.82:53920) 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9400640 1 -- 172.21.15.82:0/100409549 learned_addr learned my addr 172.21.15.82:0/100409549 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6aa800640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a410aa40 0x7fe6a41a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 -- 172.21.15.82:0/100409549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a410aa40 msgr2=0x7fe6a41a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:53.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a410aa40 0x7fe6a41a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 -- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 msgr2=0x7fe6a419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:53.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9e00640 1 -- 172.21.15.82:0/100409549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a41a7280 con 0x7fe6a4108fd0 2024-06-06T02:46:53.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.556+0000 7fe6a9400640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe6a9e00640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 0x7fe6a419f740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c004b20 con 0x7fe6a4108fd0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a41a7570 con 0x7fe6a4108fd0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe69c004cc0 con 0x7fe6a4108fd0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c010690 con 0x7fe6a4108fd0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.557+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41a7ac0 con 0x7fe6a4108fd0 2024-06-06T02:46:53.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.558+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a4110150 con 0x7fe6a4108fd0 2024-06-06T02:46:53.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.561+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe69c005020 con 0x7fe6a4108fd0 2024-06-06T02:46:53.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.562+0000 7fe69aa00640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 0x7fe6900b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:53.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.563+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe69c0e2990 con 0x7fe6a4108fd0 2024-06-06T02:46:53.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.563+0000 7fe6a9400640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 0x7fe6900b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:53.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.563+0000 7fe6a9400640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 0x7fe6900b4cf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe694031440 tx=0x7fe6940314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:53.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.564+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe69c0aa670 con 0x7fe6a4108fd0 2024-06-06T02:46:53.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.776+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6a4063360 con 0x7fe6a4108fd0 2024-06-06T02:46:53.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.778+0000 7fe69aa00640 1 -- 172.21.15.82:0/100409549 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fe69c0a9f70 con 0x7fe6a4108fd0 2024-06-06T02:46:53.779 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:46:53.779 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:46:53.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 msgr2=0x7fe6900b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:53.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 0x7fe6900b4cf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe694031440 tx=0x7fe6940314a0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 msgr2=0x7fe6a419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:53.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 0x7fe6a419f740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005fd0 tx=0x7fe69c00ef90 comp rx=0 tx=0).stop 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 shutdown_connections 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe6900b27e0 0x7fe6900b4cf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6a410aa40 0x7fe6a41a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6a410a0f0 0x7fe6a419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 --2- 172.21.15.82:0/100409549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6a4108fd0 0x7fe6a419f740 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 >> 172.21.15.82:0/100409549 conn(0x7fe6a4078200 msgr2=0x7fe6a410d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:53.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.782+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 shutdown_connections 2024-06-06T02:46:53.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:53.783+0000 7fe6ab200640 1 -- 172.21.15.82:0/100409549 wait complete. 2024-06-06T02:46:53.813 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-06T02:28:46.735414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-06T02:33:55.297725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-06T02:33:59.381038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-06T02:46:53.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-06T02:46:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 -- 172.21.15.82:0/118616554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48075090 msgr2=0x7f1f48075500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 --2- 172.21.15.82:0/118616554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48075090 0x7f1f48075500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009860 tx=0x7f1f3402a340 comp rx=0 tx=0).stop 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 -- 172.21.15.82:0/118616554 shutdown_connections 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 --2- 172.21.15.82:0/118616554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f48111410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 --2- 172.21.15.82:0/118616554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48075090 0x7f1f48075500 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 --2- 172.21.15.82:0/118616554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48076690 0x7f1f48074b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 -- 172.21.15.82:0/118616554 >> 172.21.15.82:0/118616554 conn(0x7f1f480fe1d0 msgr2=0x7f1f48100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 -- 172.21.15.82:0/118616554 shutdown_connections 2024-06-06T02:46:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.099+0000 7f1f4e800640 1 -- 172.21.15.82:0/118616554 wait complete. 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.100+0000 7f1f4e800640 1 Processor -- start 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 -- start start 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48075090 0x7f1f4819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48076690 0x7f1f4819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48114af0 con 0x7f1f4810eff0 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48114970 con 0x7f1f48075090 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4e800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f1f48114c70 con 0x7f1f48076690 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4de00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53944/0 (socket says 172.21.15.82:53944) 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4de00640 1 -- 172.21.15.82:0/1290616731 learned_addr learned my addr 172.21.15.82:0/1290616731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4ca00640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48076690 0x7f1f4819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.101+0000 7f1f4d400640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48075090 0x7f1f4819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 -- 172.21.15.82:0/1290616731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48076690 msgr2=0x7f1f4819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48076690 0x7f1f4819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 -- 172.21.15.82:0/1290616731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48075090 msgr2=0x7f1f4819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48075090 0x7f1f4819f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 -- 172.21.15.82:0/1290616731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f481a7260 con 0x7f1f4810eff0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.102+0000 7f1f4de00640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000efc0 tx=0x7f1f4000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.103+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40003970 con 0x7f1f4810eff0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.103+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f481a7550 con 0x7f1f4810eff0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.103+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f481a7a70 con 0x7f1f4810eff0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.103+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f40009880 con 0x7f1f4810eff0 2024-06-06T02:46:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.103+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000b890 con 0x7f1f4810eff0 2024-06-06T02:46:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.104+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f280052c0 con 0x7f1f4810eff0 2024-06-06T02:46:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.107+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1f4001d020 con 0x7f1f4810eff0 2024-06-06T02:46:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.108+0000 7f1f46000640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 0x7f1f300b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.109+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f1f400e1fe0 con 0x7f1f4810eff0 2024-06-06T02:46:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.109+0000 7f1f4d400640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 0x7f1f300b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.110+0000 7f1f4d400640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 0x7f1f300b4d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f48076380 tx=0x7f1f3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:54.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.120+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1f400a9ce0 con 0x7f1f4810eff0 2024-06-06T02:46:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.330+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1f28005880 con 0x7f1f4810eff0 2024-06-06T02:46:54.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.331+0000 7f1f46000640 1 -- 172.21.15.82:0/1290616731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f1f400a95e0 con 0x7f1f4810eff0 2024-06-06T02:46:54.331 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-06-06T02:46:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 msgr2=0x7f1f300b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 0x7f1f300b4d70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1f48076380 tx=0x7f1f3c005f90 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 msgr2=0x7f1f481a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000efc0 tx=0x7f1f4000c800 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 shutdown_connections 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f4810eff0 0x7f1f481a6bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f1f300b2860 0x7f1f300b4d70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f48076690 0x7f1f4819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 --2- 172.21.15.82:0/1290616731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f48075090 0x7f1f4819f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 >> 172.21.15.82:0/1290616731 conn(0x7f1f480fe1d0 msgr2=0x7f1f48102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 shutdown_connections 2024-06-06T02:46:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.334+0000 7f1f4e800640 1 -- 172.21.15.82:0/1290616731 wait complete. 2024-06-06T02:46:54.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-06T02:46:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 -- 172.21.15.82:0/3721733701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0103ad0 msgr2=0x7fc0b0103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 --2- 172.21.15.82:0/3721733701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0103ee0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc098009900 tx=0x7fc09802a410 comp rx=0 tx=0).stop 2024-06-06T02:46:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 -- 172.21.15.82:0/3721733701 shutdown_connections 2024-06-06T02:46:54.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 --2- 172.21.15.82:0/3721733701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b0104420 0x7fc0b010ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 --2- 172.21.15.82:0/3721733701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0103ee0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 --2- 172.21.15.82:0/3721733701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b01029b0 0x7fc0b0102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 -- 172.21.15.82:0/3721733701 >> 172.21.15.82:0/3721733701 conn(0x7fc0b00fe1d0 msgr2=0x7fc0b0100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:54.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 -- 172.21.15.82:0/3721733701 shutdown_connections 2024-06-06T02:46:54.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.636+0000 7fc0afe00640 1 -- 172.21.15.82:0/3721733701 wait complete. 2024-06-06T02:46:54.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 Processor -- start 2024-06-06T02:46:54.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 -- start start 2024-06-06T02:46:54.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b01029b0 0x7fc0b01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 0x7fc0b01a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b010e4f0 con 0x7fc0b0103ad0 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b010e370 con 0x7fc0b01029b0 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.638+0000 7fc0afe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b010e670 con 0x7fc0b0104420 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0ae000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 0x7fc0b01a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0ae000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53970/0 (socket says 172.21.15.82:53970) 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0aea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b01029b0 0x7fc0b01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0ae000640 1 -- 172.21.15.82:0/7302138 learned_addr learned my addr 172.21.15.82:0/7302138 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 -- 172.21.15.82:0/7302138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b01029b0 msgr2=0x7fc0b01990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b01029b0 0x7fc0b01990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 -- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 msgr2=0x7fc0b0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 -- 172.21.15.82:0/7302138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b01a0c10 con 0x7fc0b0104420 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.639+0000 7fc0af400640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 0x7fc0b01a05a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e970 tx=0x7fc0a800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.640+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800ccc0 con 0x7fc0b0104420 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.640+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0a8005020 con 0x7fc0b0104420 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.640+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b01a0f00 con 0x7fc0b0104420 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.640+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8004a00 con 0x7fc0b0104420 2024-06-06T02:46:54.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.640+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b01a1360 con 0x7fc0b0104420 2024-06-06T02:46:54.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.641+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b0109ba0 con 0x7fc0b0104420 2024-06-06T02:46:54.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.644+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fc0a8004ba0 con 0x7fc0b0104420 2024-06-06T02:46:54.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.646+0000 7fc0a7400640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 0x7fc0940b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.646+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fc0a80e21d0 con 0x7fc0b0104420 2024-06-06T02:46:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.646+0000 7fc0aea00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 0x7fc0940b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.647+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc0a80a9f40 con 0x7fc0b0104420 2024-06-06T02:46:54.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.647+0000 7fc0aea00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 0x7fc0940b4cf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc0b01039d0 tx=0x7fc0a0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:54.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.852+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc0b002de90 con 0x7fc0b0104420 2024-06-06T02:46:54.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.854+0000 7fc0a7400640 1 -- 172.21.15.82:0/7302138 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) ==== 104+0+11 (secure 0 0 0) 0x7fc0a80a9840 con 0x7fc0b0104420 2024-06-06T02:46:54.853 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-06-06T02:46:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.856+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 msgr2=0x7fc0940b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.856+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 0x7fc0940b4cf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc0b01039d0 tx=0x7fc0a0009500 comp rx=0 tx=0).stop 2024-06-06T02:46:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.856+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 msgr2=0x7fc0b01a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.856+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 0x7fc0b01a05a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e970 tx=0x7fc0a800ee30 comp rx=0 tx=0).stop 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 shutdown_connections 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fc0940b27e0 0x7fc0940b4cf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0b0104420 0x7fc0b01a05a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0b0103ad0 0x7fc0b0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 --2- 172.21.15.82:0/7302138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0b01029b0 0x7fc0b01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 >> 172.21.15.82:0/7302138 conn(0x7fc0b00fe1d0 msgr2=0x7fc0b0106d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 shutdown_connections 2024-06-06T02:46:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:54.857+0000 7fc0afe00640 1 -- 172.21.15.82:0/7302138 wait complete. 2024-06-06T02:46:54.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-06T02:46:55.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:54 smithi103 ceph-mon[36349]: pgmap v719: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:55.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:54 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/100409549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:46:55.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:54 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1290616731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:46:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:54 smithi082 ceph-mon[31579]: pgmap v719: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:54 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/100409549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:46:55.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:54 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1290616731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:46:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:54 smithi184 ceph-mon[36922]: pgmap v719: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:46:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:54 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/100409549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:46:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:54 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1290616731' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 -- 172.21.15.82:0/232687342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 msgr2=0x7f543c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 --2- 172.21.15.82:0/232687342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c102d90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f542c009900 tx=0x7f542c02a410 comp rx=0 tx=0).stop 2024-06-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 -- 172.21.15.82:0/232687342 shutdown_connections 2024-06-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 --2- 172.21.15.82:0/232687342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c1043f0 0x7f543c10acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 --2- 172.21.15.82:0/232687342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c103aa0 0x7f543c103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 --2- 172.21.15.82:0/232687342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c102d90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.153+0000 7f5441c00640 1 -- 172.21.15.82:0/232687342 >> 172.21.15.82:0/232687342 conn(0x7f543c0fe180 msgr2=0x7f543c100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:55.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.154+0000 7f5441c00640 1 -- 172.21.15.82:0/232687342 shutdown_connections 2024-06-06T02:46:55.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.154+0000 7f5441c00640 1 -- 172.21.15.82:0/232687342 wait complete. 2024-06-06T02:46:55.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 Processor -- start 2024-06-06T02:46:55.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 -- start start 2024-06-06T02:46:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 0x7f543c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c1043f0 0x7f543c1a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f543c10e4c0 con 0x7f543c102980 2024-06-06T02:46:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f543c10e340 con 0x7f543c103aa0 2024-06-06T02:46:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.155+0000 7f5441c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f543c10e640 con 0x7f543c1043f0 2024-06-06T02:46:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53992/0 (socket says 172.21.15.82:53992) 2024-06-06T02:46:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543be00640 1 -- 172.21.15.82:0/2720884479 learned_addr learned my addr 172.21.15.82:0/2720884479 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 0x7f543c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f5441200640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c1043f0 0x7f543c1a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 -- 172.21.15.82:0/2720884479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c1043f0 msgr2=0x7f543c1a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c1043f0 0x7f543c1a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 -- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 msgr2=0x7f543c199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.156+0000 7f543b400640 1 -- 172.21.15.82:0/2720884479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c1a0b90 con 0x7f543c103aa0 2024-06-06T02:46:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f543b400640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 0x7f543c199590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f542400e9f0 tx=0x7f542400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542400ccc0 con 0x7f543c103aa0 2024-06-06T02:46:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54240108e0 con 0x7f543c103aa0 2024-06-06T02:46:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543c1a0e80 con 0x7f543c103aa0 2024-06-06T02:46:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424018840 con 0x7f543c103aa0 2024-06-06T02:46:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.157+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543c1a1340 con 0x7f543c103aa0 2024-06-06T02:46:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.158+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543c109b00 con 0x7f543c103aa0 2024-06-06T02:46:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.161+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5424010430 con 0x7f543c103aa0 2024-06-06T02:46:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.162+0000 7f5438c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 0x7f54200b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.162+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f54240e2920 con 0x7f543c103aa0 2024-06-06T02:46:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.163+0000 7f543be00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 0x7f54200b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.163+0000 7f543be00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 0x7f54200b4d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f542c0096c0 tx=0x7f542c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.164+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f54240aa600 con 0x7f543c103aa0 2024-06-06T02:46:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.373+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f543c02de90 con 0x7f543c103aa0 2024-06-06T02:46:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.373+0000 7f5438c00640 1 -- 172.21.15.82:0/2720884479 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) ==== 100+0+11 (secure 0 0 0) 0x7f54240cc0a0 con 0x7f543c103aa0 2024-06-06T02:46:55.373 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-06-06T02:46:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 msgr2=0x7f54200b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 0x7f54200b4d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f542c0096c0 tx=0x7f542c0314a0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 msgr2=0x7f543c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 0x7f543c199590 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f542400e9f0 tx=0x7f542400edf0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 shutdown_connections 2024-06-06T02:46:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f54200b2870 0x7f54200b4d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f543c1043f0 0x7f543c1a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f543c103aa0 0x7f543c199590 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 --2- 172.21.15.82:0/2720884479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f543c102980 0x7f543c199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 >> 172.21.15.82:0/2720884479 conn(0x7f543c0fe180 msgr2=0x7f543c106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 shutdown_connections 2024-06-06T02:46:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.376+0000 7f5441c00640 1 -- 172.21.15.82:0/2720884479 wait complete. 2024-06-06T02:46:55.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 -- 172.21.15.82:0/1363832712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc104420 msgr2=0x7fe4fc10ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 --2- 172.21.15.82:0/1363832712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc104420 0x7fe4fc10ad20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009be0 tx=0x7fe4f402a6c0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 -- 172.21.15.82:0/1363832712 shutdown_connections 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 --2- 172.21.15.82:0/1363832712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc104420 0x7fe4fc10ad20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 --2- 172.21.15.82:0/1363832712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc103ad0 0x7fe4fc103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 --2- 172.21.15.82:0/1363832712 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 -- 172.21.15.82:0/1363832712 >> 172.21.15.82:0/1363832712 conn(0x7fe4fc0fe1d0 msgr2=0x7fe4fc100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:55.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 -- 172.21.15.82:0/1363832712 shutdown_connections 2024-06-06T02:46:55.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.676+0000 7fe501600640 1 -- 172.21.15.82:0/1363832712 wait complete. 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.677+0000 7fe501600640 1 Processor -- start 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.677+0000 7fe501600640 1 -- start start 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc103ad0 0x7fe4fc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 0x7fe4fc1a2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10e4e0 con 0x7fe4fc104420 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10e360 con 0x7fe4fc103ad0 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe501600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fe4fc10e660 con 0x7fe4fc1029b0 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe4fbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe500c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 0x7fe4fc1a2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe4fbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:56082/0 (socket says 172.21.15.82:56082) 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe500c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 0x7fe4fc1a2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54018/0 (socket says 172.21.15.82:54018) 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe4fbe00640 1 -- 172.21.15.82:0/4279632868 learned_addr learned my addr 172.21.15.82:0/4279632868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.678+0000 7fe4fb400640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc103ad0 0x7fe4fc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 -- 172.21.15.82:0/4279632868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc103ad0 msgr2=0x7fe4fc19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc103ad0 0x7fe4fc19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 -- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 msgr2=0x7fe4fc1a2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 0x7fe4fc1a2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 -- 172.21.15.82:0/4279632868 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4fc1a2da0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4fbe00640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e9f0 tx=0x7fe4ec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00ccc0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4fc1a3090 con 0x7fe4fc1029b0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4ec0054d0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec010430 con 0x7fe4fc1029b0 2024-06-06T02:46:55.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.679+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4fc1a3590 con 0x7fe4fc1029b0 2024-06-06T02:46:55.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.680+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4fc1a3850 con 0x7fe4fc1029b0 2024-06-06T02:46:55.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.683+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe4ec0046c0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.684+0000 7fe4f8c00640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 0x7fe4e00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:46:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.685+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fe4ec0e27e0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.685+0000 7fe4fb400640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 0x7fe4e00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:46:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.685+0000 7fe4fb400640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 0x7fe4e00b4cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc19c300 tx=0x7fe4e8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:46:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.686+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe4ec054df0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.941+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fe4fc1a3a20 con 0x7fe4fc1029b0 2024-06-06T02:46:55.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.953+0000 7fe4f8c00640 1 -- 172.21.15.82:0/4279632868 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+815640 (secure 0 0 0) 0x7fe4ec0aa4c0 con 0x7fe4fc1029b0 2024-06-06T02:46:55.971 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 20, 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 14150, 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2024-06-06T02:46:55.972 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 664220961 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 664220961 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/664220961", 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2024-06-06T02:25:14.582326+0000", 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540701547738038271, 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2024-06-06T02:46:55.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24112, 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:55.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-06-06T02:46:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-06-06T02:46:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-06-06T02:46:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-06-06T02:46:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T02:46:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-06-06T02:46:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-06-06T02:46:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-06-06T02:46:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-06-06T02:46:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T02:46:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T02:46:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T02:46:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-06-06T02:46:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-06-06T02:46:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-06-06T02:46:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-06-06T02:46:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-06-06T02:46:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T02:46:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-06-06T02:46:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-06-06T02:46:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T02:46:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-06-06T02:46:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-06-06T02:46:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T02:46:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T02:46:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-06-06T02:46:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T02:46:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-06-06T02:46:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T02:46:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T02:46:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T02:46:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-06-06T02:46:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T02:46:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T02:46:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T02:46:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T02:46:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-06-06T02:46:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-06-06T02:46:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-06-06T02:46:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T02:46:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T02:46:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-06-06T02:46:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-06-06T02:46:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T02:46:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-06-06T02:46:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-06-06T02:46:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-06-06T02:46:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-06-06T02:46:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-06-06T02:46:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-06-06T02:46:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-06-06T02:46:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T02:46:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-06-06T02:46:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-06-06T02:46:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-06-06T02:46:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-06-06T02:46:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-06-06T02:46:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-06-06T02:46:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-06-06T02:46:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T02:46:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-06-06T02:46:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-06-06T02:46:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-06-06T02:46:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-06-06T02:46:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T02:46:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-06-06T02:46:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T02:46:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-06-06T02:46:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24113, 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-06-06T02:46:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T02:46:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T02:46:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-06-06T02:46:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-06-06T02:46:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-06-06T02:46:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-06-06T02:46:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-06-06T02:46:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-06-06T02:46:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-06-06T02:46:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T02:46:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-06-06T02:46:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-06-06T02:46:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T02:46:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-06-06T02:46:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T02:46:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-06-06T02:46:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T02:46:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-06-06T02:46:56.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:56.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T02:46:56.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-06-06T02:46:56.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.653 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.654 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.657 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-06-06T02:46:56.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-06-06T02:46:56.662 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.667 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.676 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T02:46:56.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-06-06T02:46:56.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-06-06T02:46:56.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.693 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T02:46:56.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T02:46:56.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.695 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.698 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.706 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.709 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-06-06T02:46:56.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:56.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.723 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.727 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.728 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.736 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:56.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.742 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.746 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.748 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-06-06T02:46:56.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T02:46:56.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.756 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.768 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.769 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.775 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.776 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-06-06T02:46:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-06-06T02:46:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-06-06T02:46:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T02:46:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-06-06T02:46:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-06-06T02:46:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-06-06T02:46:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-06-06T02:46:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-06-06T02:46:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-06-06T02:46:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-06-06T02:46:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-06-06T02:46:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-06-06T02:46:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-06-06T02:46:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-06-06T02:46:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-06-06T02:46:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "restful" 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-06-06T02:46:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-06-06T02:46:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-06-06T02:46:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-06-06T02:46:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-06T02:46:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-06T02:46:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-06-06T02:46:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-06T02:46:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-06-06T02:46:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-06-06T02:46:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-06T02:46:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-06-06T02:46:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-06T02:46:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-06T02:46:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-06-06T02:46:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-06T02:46:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-06-06T02:46:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-06-06T02:46:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-06-06T02:46:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-06-06T02:46:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-06-06T02:46:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-06-06T02:46:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-06-06T02:46:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-06-06T02:46:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-06-06T02:46:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-06-06T02:46:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-06-06T02:46:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-06-06T02:46:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-06-06T02:46:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-06-06T02:46:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-06-06T02:46:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-06-06T02:46:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-06T02:46:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-06T02:46:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-06-06T02:46:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-06T02:46:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-06-06T02:46:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-06-06T02:46:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-06T02:46:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-06T02:46:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-06-06T02:46:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-06T02:46:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-06T02:46:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-06T02:46:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-06T02:46:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-06-06T02:46:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-06T02:46:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-06T02:46:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-06T02:46:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-06-06T02:46:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-06-06T02:46:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-06-06T02:46:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-06-06T02:46:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-06-06T02:46:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-06-06T02:46:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-06-06T02:46:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-06-06T02:46:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-06-06T02:46:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-06-06T02:46:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-06-06T02:46:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-06-06T02:46:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-06-06T02:46:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-06-06T02:46:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-06-06T02:46:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-06-06T02:46:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-06-06T02:46:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-06-06T02:46:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-06-06T02:46:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-06-06T02:46:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-06-06T02:46:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-06-06T02:46:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-06-06T02:46:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-06-06T02:46:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-06-06T02:46:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-06-06T02:46:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-06-06T02:46:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-06-06T02:46:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-06-06T02:46:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-06-06T02:46:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-06-06T02:46:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-06-06T02:46:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "squid": [ 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-06-06T02:46:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 3, 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2468762628 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2356205372 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2135326991 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3546514714 2024-06-06T02:46:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:46:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-06-06T02:46:57.631 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:46:57.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:55 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/7302138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:55 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2720884479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:56 smithi184 ceph-mon[36922]: pgmap v720: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:57.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:56 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4279632868' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T02:46:57.632 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:46:57.633 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:55 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/7302138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.633 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:55 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2720884479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.633 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:56 smithi103 ceph-mon[36349]: pgmap v720: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:57.633 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:56 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4279632868' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T02:46:57.633 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 msgr2=0x7fe4e00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 0x7fe4e00b4cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc19c300 tx=0x7fe4e8009260 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 msgr2=0x7fe4fc19b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00e9f0 tx=0x7fe4ec00edf0 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 shutdown_connections 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4fc104420 0x7fe4fc1a2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4fc103ad0 0x7fe4fc19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fe4e00b27e0 0x7fe4e00b4cf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 --2- 172.21.15.82:0/4279632868 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4fc1029b0 0x7fe4fc19b260 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:46:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 >> 172.21.15.82:0/4279632868 conn(0x7fe4fc0fe1d0 msgr2=0x7fe4fc074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:46:57.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.969+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 shutdown_connections 2024-06-06T02:46:57.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:46:55.970+0000 7fe501600640 1 -- 172.21.15.82:0/4279632868 wait complete. 2024-06-06T02:46:57.696 DEBUG:tasks.check_counter:Getting stats from a 2024-06-06T02:46:57.696 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-06T02:46:57.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:55 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/7302138' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:55 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2720884479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-06T02:46:57.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:56 smithi082 ceph-mon[31579]: pgmap v720: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:57.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:56 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4279632868' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-06T02:46:57.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:46:58.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: pgmap v721: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:58.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.150 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:58 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:46:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: pgmap v721: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:58 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: pgmap v721: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:46:58.372 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:58 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:59 smithi082 ceph-mon[31579]: pgmap v722: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-06-06T02:47:00.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.083 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:46:59 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:59 smithi184 ceph-mon[36922]: pgmap v722: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-06-06T02:47:00.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:46:59 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:59 smithi103 ceph-mon[36349]: pgmap v722: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-06-06T02:47:00.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:00.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:46:59 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1089, 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1091, 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 4534511, 2024-06-06T02:47:01.087 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 346312, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.223415511, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.065867227, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.065648735, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.065428434, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1089, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.156930853, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000144105 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.088 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 491, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 653, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 811940, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 516766, 2024-06-06T02:47:01.089 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.130117065, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.046482531, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.022180272, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.047371240, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 651, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.141080266, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000216713 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:01.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 360880 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:01.091 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1020, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1006, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 5253239, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 382481, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 3, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.246711117, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.070774228, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.117887062, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.064809270, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1006, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.175499903, 2024-06-06T02:47:01.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000174453 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 859648, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 133168 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.093 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3844, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.242526925, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000063092 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.094 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.095 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 819, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 492, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 327, 2024-06-06T02:47:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 115, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-06-06T02:47:01.097 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-06-06T02:47:01.098 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:01.099 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:01.100 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-06-06T02:47:01.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-06-06T02:47:01.102 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 3818, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 36, 2024-06-06T02:47:01.103 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 13189418, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 13272728, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 13272129, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 3818 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 18, 2024-06-06T02:47:01.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 780, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 762, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 13, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 120, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 107, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 819, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1294, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 475, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 118496, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215344 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.105 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.106 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-06-06T02:47:01.108 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.109 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.110 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.111 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.112 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.113 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-06-06T02:47:01.114 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.115 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-06-06T02:47:01.116 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-06-06T02:47:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.118 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.119 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.120 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.121 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 2, 2024-06-06T02:47:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 3357, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 190414, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 51, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 156, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 633450, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 3510, 2024-06-06T02:47:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2363, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 26, 2024-06-06T02:47:01.130 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 4, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2363, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2363, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 14.642732446, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.006196670 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2363, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2364 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2363, 2024-06-06T02:47:01.131 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2363, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1476, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 884, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-06-06T02:47:01.132 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 2, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:01.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-06-06T02:47:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 5, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 5, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-06-06T02:47:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-06-06T02:47:01.136 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:01.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2596, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 10351071, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2596, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2596, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 10351071, 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:01.138 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2363, 2024-06-06T02:47:01.139 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 9078434, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2363, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 9078434, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:01.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2363, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2363, 2024-06-06T02:47:01.141 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2363, 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2363, 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.142 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55d34b5ea8f0": { 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:01.145 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:01.146 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:01.147 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:47:02.058 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-06-06T02:47:02.058 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-06-06T02:47:02.058 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-06-06T02:47:02.059 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-06-06T02:47:02.059 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-06-06T02:47:02.059 DEBUG:tasks.check_counter:Getting stats from d 2024-06-06T02:47:02.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-06T02:47:02.485 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: pgmap v723: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:47:02.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: pgmap v723: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:47:02.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: pgmap v723: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-06-06T02:47:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:47:02.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:47:02.899 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:47:04.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:04 smithi082 ceph-mon[31579]: pgmap v724: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:04.863 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:47:04.863 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:04.863 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 226, 2024-06-06T02:47:04.863 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 221, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 814688, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 136224, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.089900702, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.039029864, 2024-06-06T02:47:04.864 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.062327776, 2024-06-06T02:47:04.865 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:04.865 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:04.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 220, 2024-06-06T02:47:04.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.062033660, 2024-06-06T02:47:04.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000281971 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:04.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 814688, 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 136224 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1, 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 168, 2024-06-06T02:47:04.867 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 160, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 108464, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 3, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.033709194, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.028030555, 2024-06-06T02:47:04.868 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002727209, 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 166, 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.031004648, 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000186774 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.869 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:04.870 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 108464 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4, 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4, 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3040, 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 448, 2024-06-06T02:47:04.871 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.005084931, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000104780, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.005153005, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:04.872 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.008541959, 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002847319 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:04.873 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-06-06T02:47:04.874 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:04.875 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:04.876 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:04.877 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:04.877 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:04.877 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:04.877 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:04.878 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:04.879 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:04.880 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 149998, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 30, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:04.881 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:04.882 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:04.883 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:04.884 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 227, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 782737, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 227, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:04.885 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 227, 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 782737, 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:04.886 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:04.887 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:04.887 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:04.887 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:47:04.888 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:04 smithi103 ceph-mon[36349]: pgmap v724: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:04.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:04 smithi184 ceph-mon[36922]: pgmap v724: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:05.727 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-06T02:47:05.727 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-06T02:47:05.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-06-06T02:47:05.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-06-06T02:47:05.727 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-06-06T02:47:05.727 DEBUG:tasks.check_counter:Getting stats from g 2024-06-06T02:47:05.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-06T02:47:06.168 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:06.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:06 smithi082 ceph-mon[31579]: pgmap v725: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:06.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:06 smithi103 ceph-mon[36349]: pgmap v725: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:06.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:06 smithi184 ceph-mon[36922]: pgmap v725: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:08.621 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:08 smithi082 ceph-mon[31579]: pgmap v726: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3424, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4581, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1725753, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 6821750, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 94, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.983022143, 2024-06-06T02:47:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.275145765, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.492905103, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.236329113, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4584, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.701082584, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000371091 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4511, 2024-06-06T02:47:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001763705, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000390 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 922560, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 149632 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 5728, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 8456, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2035441, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 7104028, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 31, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 6, 2024-06-06T02:47:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 1.463984064, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.983465061, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.456349782, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.111965393, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8454, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2.541307799, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000300604 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6230, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002649757, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000425 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 63936, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 405712 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 3873, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4826, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1085744, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 5916997, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 9, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 7, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.851151273, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.294044841, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.354276508, 2024-06-06T02:47:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.232657216, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4821, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.024312073, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000627320 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 5238, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.002106317, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000402 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2257, 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.840404095, 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001701552 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1145, 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.156643309, 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000136806 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 2232, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 2216, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2216, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 24.122447558, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.010885581 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 16, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 4, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 1, 2024-06-06T02:47:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 440, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 126, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 4, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 111, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 11, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 119, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 32, 2024-06-06T02:47:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 2, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 2, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 2980, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 2697, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 11, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 46, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 6, 2024-06-06T02:47:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 27, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 13, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 810, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-06-06T02:47:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 810, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 273, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 4, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 269, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 537, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 12, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 348, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 2059, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 6, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 1404, 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 664, 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 154, 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 1320 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-06-06T02:47:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 160, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 396, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 801, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 740, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 61, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 4, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 6, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 3818, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 3709, 2024-06-06T02:47:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 3709, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 109, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 595, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 39, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 38, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 38, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 1, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 1, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-06-06T02:47:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 2, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 13189418, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 13272728, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 660, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 16.697849596, 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.025299772 2024-06-06T02:47:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 23, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 793, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 770, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 18, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 126, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 108, 2024-06-06T02:47:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 126, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 1364, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1238, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 2, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 778, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 776, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 130592, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 231728 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-06-06T02:47:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 3182, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 258, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 2232, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 25, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 552, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 654, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.116101240, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001706576 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 84, 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.024688323, 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000293908 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 61, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.093493315, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001532677 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 123, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.069420648, 2024-06-06T02:47:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000564395 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000406984, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000406984 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-06-06T02:47:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-06-06T02:47:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 105, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.195968091, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001866362 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 49, 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.014397898, 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000293834 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 226, 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.490018602, 2024-06-06T02:47:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.006593002 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 113, 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 15.739396987, 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.139286699 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 99, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.691627951, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.037289171 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.058562559, 2024-06-06T02:47:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.008366079 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-06-06T02:47:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001688840, 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000422210 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-06-06T02:47:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8, 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.030400083, 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.003800010 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 13, 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.013799309, 2024-06-06T02:47:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001061485 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 669, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.582476728, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002365436 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 2, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 1, 2024-06-06T02:47:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 381, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 381, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 552, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 300178, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 131, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 1056, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 12, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 156, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 172050, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 1564, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-06-06T02:47:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 4063, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 10238093, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 31, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 4063, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4063, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 762.283118460, 2024-06-06T02:47:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.187615830 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4063, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 6102 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 4063, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 858, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 3205, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 345, 2024-06-06T02:47:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 565, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 39, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 695, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 145, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 1264, 2024-06-06T02:47:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 819, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 1134, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-06-06T02:47:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 6, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-06-06T02:47:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 80, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 2, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 12, 2024-06-06T02:47:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 984, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 10, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 96 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 18, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 10, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 748, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 740, 2024-06-06T02:47:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 13021, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 3714764, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 13021, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 13021, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 3714764, 2024-06-06T02:47:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 4063, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 10312773, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 4063, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 10312773, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 4063, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 4063, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 4063, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 4063, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-06-06T02:47:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 740, 2024-06-06T02:47:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 74748, 2024-06-06T02:47:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 740, 2024-06-06T02:47:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 35, 2024-06-06T02:47:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 74748, 2024-06-06T02:47:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55cae34ec5b0": { 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 3818, 2024-06-06T02:47:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 9078424, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 3818, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 660, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 9078424, 2024-06-06T02:47:08.709 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:08.710 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:47:08.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:08 smithi103 ceph-mon[36349]: pgmap v726: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:08.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:08 smithi184 ceph-mon[36922]: pgmap v726: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-06-06T02:47:09.673 INFO:tasks.check_counter:Daemon mds.g mds.exported=6 2024-06-06T02:47:09.673 INFO:tasks.check_counter:Daemon mds.g mds.imported=13 2024-06-06T02:47:09.673 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=160 2024-06-06T02:47:09.673 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-06-06T02:47:09.673 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-06-06T02:47:09.673 DEBUG:tasks.check_counter:Getting stats from j 2024-06-06T02:47:09.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-06T02:47:10.121 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:10.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:10 smithi103 ceph-mon[36349]: pgmap v727: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:10 smithi082 ceph-mon[31579]: pgmap v727: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:10.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:10 smithi184 ceph-mon[36922]: pgmap v727: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:12.549 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-06-06T02:47:12.549 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:12.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-06-06T02:47:12.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-06-06T02:47:12.549 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.003426240, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000733380, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:12.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1, 2024-06-06T02:47:12.551 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 171, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 160, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 108992, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 3, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.028601452, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.023063530, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002278749, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 169, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.035968936, 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000212833 2024-06-06T02:47:12.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 108992 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 233, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 226, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 818544, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 138592, 2024-06-06T02:47:12.553 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.093344926, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.040893431, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.070963542, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 226, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.058207897, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000257557 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:12.554 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 818544, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 138592 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:12.555 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:12.556 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:12.557 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 149998, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 30, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-06-06T02:47:12.558 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-06-06T02:47:12.559 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 230, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 783127, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 230, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 230, 2024-06-06T02:47:12.560 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 783127, 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-06-06T02:47:12.561 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-06-06T02:47:12.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:12 smithi103 ceph-mon[36349]: pgmap v728: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:12.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:12 smithi082 ceph-mon[31579]: pgmap v728: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:12 smithi184 ceph-mon[36922]: pgmap v728: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:13.479 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-06T02:47:13.480 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-06T02:47:13.480 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-06-06T02:47:13.480 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-06-06T02:47:13.480 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-06-06T02:47:13.480 DEBUG:tasks.check_counter:Getting stats from b 2024-06-06T02:47:13.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-06T02:47:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:47:14.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:14 smithi103 ceph-mon[36349]: pgmap v729: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:14.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:14 smithi082 ceph-mon[31579]: pgmap v729: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:14.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:14 smithi184 ceph-mon[36922]: pgmap v729: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 3190, 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 1914, 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1124446, 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 510619, 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 11, 2024-06-06T02:47:15.770 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.200574834, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.072727075, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.169523578, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.005782208, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1912, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.105213252, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000055027 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4939, 2024-06-06T02:47:15.771 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000857632, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000173 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 309, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 293, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 881741, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 282094, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 18, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 5, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.045877540, 2024-06-06T02:47:15.772 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.016008989, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037820635, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000597320, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 293, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.032129925, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000109658 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 17, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000002725, 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000160 2024-06-06T02:47:15.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 874272, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 142992 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 46, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 213, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 12851, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 460148, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 8, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 5, 2024-06-06T02:47:15.774 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.018565917, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.009799691, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.006681206, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000439783, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 211, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.019719249, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000093456 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 31, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000021077, 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000679 2024-06-06T02:47:15.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 447488 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 1, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-MDSRank": { 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-06-06T02:47:15.776 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 84, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.004694795, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000055890 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "queue_len": 0, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "complete_latency": { 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 16, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000381174, 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000023823 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": { 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "request": 18, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "reply": 4, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "reply_latency": { 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 4, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.011335250, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.002833812 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_reply": 0, 2024-06-06T02:47:15.778 INFO:teuthology.orchestra.run.smithi103.stdout: "forward": 14, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_complete": 0, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_fetch_keys": 0, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_commit": 11, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_split": 0, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_merge": 0, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes": 19, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_top": 2, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_bottom": 17, 2024-06-06T02:47:15.779 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pin_tail": 0, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_pinned": 13, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_expired": 172, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "inodes_with_caps": 1, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": 1, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "subtrees": 3, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse": 268, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_hit": 164, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_forward": 14, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_discover": 87, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "traverse_lock": 0, 2024-06-06T02:47:15.780 INFO:teuthology.orchestra.run.smithi103.stdout: "load_cent": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "q": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "exported": 1, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "exported_inodes": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "imported": 1, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "imported_inodes": 2, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_backtrace_fetch": 3, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rfiles": 325, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rbytes": 13424230507, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "root_rsnaps": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_fetch": 3, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:15.781 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_inodes": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_file_inodes": 3, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_inode_file_caps": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_revoke": 2, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_grant": 2, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps": 3, 2024-06-06T02:47:15.782 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_caps_dirty": 0, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_cap_release": 1, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "process_request_cap_release": 3 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_cache": { 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update": 2, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_update_receipt": 391, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_try_discover": 239, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_send_discover": 305, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "dir_handle_discover": 2, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays": 0, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:15.783 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_created": 1, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_enqueued": 1, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_reintegrated": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "strays_migrated": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_started": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "recovery_completed": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_exportdir": 1, 2024-06-06T02:47:15.784 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_flush": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragmentdir": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "ireq_inodestats": 0 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_log": { 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evlrg": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evadd": 17, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evex": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evtrm": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "ev": 17, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evexg": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "evexd": 0, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "segadd": 2, 2024-06-06T02:47:15.785 INFO:teuthology.orchestra.run.smithi103.stdout: "segex": 0, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "segtrm": 0, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "seg": 2, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "segmjr": 2, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "segexg": 0, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "segexd": 0, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "expos": 4194304, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "wrpos": 4219287, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "rdpos": 0, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "jlat": { 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 13, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.042525455, 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.003271188 2024-06-06T02:47:15.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "replayed": 0 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_mem": { 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 23, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "ino+": 110, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "ino-": 87, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dir": 22, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dir+": 181, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dir-": 159, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dn": 19, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dn+": 194, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "dn-": 175, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "cap": 1, 2024-06-06T02:47:15.787 INFO:teuthology.orchestra.run.smithi103.stdout: "cap+": 3, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "cap-": 2, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "rss": 122468, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "heap": 223536 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_server": { 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_client_request": 21, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "dispatch_server_request": 9, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_request": 18, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_client_session": 12, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "handle_peer_request": 20, 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "req_create_latency": { 2024-06-06T02:47:15.788 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getattr_latency": { 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "req_link_latency": { 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookup_latency": { 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:15.790 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupino_latency": { 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000179714, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000179714 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupname_latency": { 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "req_lssnap_latency": { 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.792 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.793 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mkdir_latency": { 2024-06-06T02:47:15.793 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.793 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.793 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mknod_latency": { 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "req_mksnap_latency": { 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.794 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "req_open_latency": { 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "req_readdir_latency": { 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 2, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000969810, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000484905 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.795 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rename_latency": { 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.796 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmdir_latency": { 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.797 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setattr_latency": { 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.798 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setlayout_latency": { 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "req_setxattr_latency": { 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.799 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "req_symlink_latency": { 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "req_unlink_latency": { 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 1, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.010185726, 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.010185726 2024-06-06T02:47:15.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_sessions": { 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "session_count": 1, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "session_add": 2, 2024-06-06T02:47:15.801 INFO:teuthology.orchestra.run.smithi103.stdout: "session_remove": 1, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_open": 1, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "sessions_stale": 0, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "total_load": 2, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "average_load": 2, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "avg_session_uptime": 542, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:15.802 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:15.803 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:15.804 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 308756, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 108, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:15.805 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 156, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:15.806 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 93901, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 367, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "objecter": { 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "op_active": 0, 2024-06-06T02:47:15.807 INFO:teuthology.orchestra.run.smithi103.stdout: "op_laggy": 0, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send": 71, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_send_bytes": 37377, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_resend": 28, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_reply": 71, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_latency": { 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 71, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.722986516, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.010182908 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "op_inflight": 0, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "oplen_avg": { 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 71, 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 99 2024-06-06T02:47:15.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "op": 71, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "op_r": 4, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "op_w": 67, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "op_rmw": 0, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "op_pg": 0, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_stat": 0, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_create": 10, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_read": 1, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_write": 14, 2024-06-06T02:47:15.809 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writefull": 12, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_writesame": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_append": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_zero": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_truncate": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_delete": 13, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_mapext": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_getxattr": 3, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_setxattr": 20, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:15.810 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_call": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_watch": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_notify": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "osdop_other": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_active": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_send": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_resend": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "linger_ping": 0, 2024-06-06T02:47:15.811 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_active": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_send": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "poolop_resend": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_active": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_send": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "poolstat_resend": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_active": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_send": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "statfs_resend": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "command_active": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "command_send": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "command_resend": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "map_epoch": 0, 2024-06-06T02:47:15.812 INFO:teuthology.orchestra.run.smithi103.stdout: "map_full": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "map_inc": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_sessions": 10, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_open": 10, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_session_close": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_laggy": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_wr": 22, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_rd": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_del": 4 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "oft": { 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_objs": 1, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_updates": 0, 2024-06-06T02:47:15.813 INFO:teuthology.orchestra.run.smithi103.stdout: "omap_total_removes": 0 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "osd-slow-ops": { 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "slow_ops_count": 0 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "purge_queue": { 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_ops_high_water": 1, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing": 0, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executing_high_water": 1, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed_ops": 1, 2024-06-06T02:47:15.814 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_executed": 1, 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:15.815 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 3541, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1683922, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 3541, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 3541, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1683922, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 71, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 37478, 2024-06-06T02:47:15.817 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 71, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 37478, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 1024, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:15.818 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 0, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 0, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 71, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 71, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 71, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 71, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 1, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 101, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 1, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 1, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 101, 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:15.820 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-write_buf_throttle-0x563682dbe680": { 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 3758096384, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 17, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 24983, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 17, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:15.821 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 13, 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 24983, 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:15.822 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-06-06T02:47:16.458 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-06-06T02:47:16.458 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-06-06T02:47:16.458 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2 2024-06-06T02:47:16.458 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=391 2024-06-06T02:47:16.458 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-06-06T02:47:16.459 DEBUG:tasks.check_counter:Getting stats from e 2024-06-06T02:47:16.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-06T02:47:16.700 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:47:16.822 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:16 smithi103 ceph-mon[36349]: pgmap v730: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:16.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:16 smithi082 ceph-mon[31579]: pgmap v730: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:16.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:16 smithi184 ceph-mon[36922]: pgmap v730: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:18.427 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001039217, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000174816, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:18.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 232, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 225, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 818272, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 137952, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.038340049, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.014617855, 2024-06-06T02:47:18.429 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.031495308, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 225, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.017354808, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000077132 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.430 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 818272, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 137952 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 1, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 171, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 160, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 188240, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.010396280, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.007544520, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001004747, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:18.431 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 169, 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.013072536, 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000077352 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:18.432 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 188240 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-06-06T02:47:18.433 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:18.434 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:18.435 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:18.436 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:18.437 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:18.438 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-06-06T02:47:18.439 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148945, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 29, 2024-06-06T02:47:18.440 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:18.441 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:18.442 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-06-06T02:47:18.443 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-06-06T02:47:18.444 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:18.445 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 229, 2024-06-06T02:47:18.445 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 782997, 2024-06-06T02:47:18.445 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:18.445 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 229, 2024-06-06T02:47:18.445 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 229, 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 782997, 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:18.446 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:18.447 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:18.447 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:18.447 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:18.447 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-06-06T02:47:18.749 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:18 smithi103 ceph-mon[36349]: pgmap v731: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:18.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:18 smithi082 ceph-mon[31579]: pgmap v731: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:18.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:18 smithi184 ceph-mon[36922]: pgmap v731: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:19.094 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-06-06T02:47:19.094 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-06-06T02:47:19.095 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2024-06-06T02:47:19.095 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2024-06-06T02:47:19.095 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-06-06T02:47:19.095 DEBUG:tasks.check_counter:Getting stats from h 2024-06-06T02:47:19.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-06T02:47:19.331 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:47:20.869 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:20 smithi103 ceph-mon[36349]: pgmap v732: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:20.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:20 smithi082 ceph-mon[31579]: pgmap v732: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:20.893 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-06-06T02:47:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-06-06T02:47:20.894 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-06-06T02:47:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-06-06T02:47:20.895 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-06-06T02:47:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001284361, 2024-06-06T02:47:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T02:47:20.896 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000245911, 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.897 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.898 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-06-06T02:47:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 171, 2024-06-06T02:47:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-06-06T02:47:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 188064, 2024-06-06T02:47:20.899 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.010145549, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.007361541, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001191776, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:20.900 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 168, 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.009086361, 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000054085 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:20.901 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 188064 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 231, 2024-06-06T02:47:20.902 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 224, 2024-06-06T02:47:20.903 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 818000, 2024-06-06T02:47:20.903 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 137312, 2024-06-06T02:47:20.903 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:20.903 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:20.903 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.039199545, 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.014790740, 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.032132080, 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 224, 2024-06-06T02:47:20.904 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.017245094, 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000076987 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:20.905 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:20.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.906 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 818000, 2024-06-06T02:47:20.906 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 137312 2024-06-06T02:47:20.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.906 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-06-06T02:47:20.907 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-06-06T02:47:20.907 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-06-06T02:47:20.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.907 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-06-06T02:47:20.907 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:20.908 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:20.909 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:20.910 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:20.910 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:20.910 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:20.910 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:20.910 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:20.911 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:20.912 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:20.913 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148962, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:20.914 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:20.915 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-06-06T02:47:20.916 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-06-06T02:47:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:20.917 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-06-06T02:47:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 229, 2024-06-06T02:47:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 782894, 2024-06-06T02:47:20.918 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 229, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 229, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 782894, 2024-06-06T02:47:20.919 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:20.920 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-06-06T02:47:20.921 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:20 smithi184 ceph-mon[36922]: pgmap v732: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:21.501 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.h 2024-06-06T02:47:21.501 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.h 2024-06-06T02:47:21.501 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.h 2024-06-06T02:47:21.501 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.h 2024-06-06T02:47:21.501 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-06-06T02:47:21.501 DEBUG:tasks.check_counter:Getting stats from k 2024-06-06T02:47:21.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-06T02:47:21.748 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.b/config 2024-06-06T02:47:22.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:22 smithi103 ceph-mon[36349]: pgmap v733: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:22.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:22 smithi082 ceph-mon[31579]: pgmap v733: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:22.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:22 smithi184 ceph-mon[36922]: pgmap v733: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:23.460 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-06-06T02:47:23.460 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001074690, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000236859, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:23.461 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:23.462 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 1, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 174, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 160, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 109520, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 3, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.011147554, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.008516417, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000673702, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 172, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.010546496, 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000061316 2024-06-06T02:47:23.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 109520 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 237, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 230, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 819632, 2024-06-06T02:47:23.464 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 141152, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.038798026, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.014998491, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.032158079, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 230, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.017207849, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000074816 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:23.465 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 819632, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 141152 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:23.466 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:23.467 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:23.468 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148985, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-06-06T02:47:23.469 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-06-06T02:47:23.470 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 234, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 783647, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 234, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-06-06T02:47:23.471 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 234, 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 783647, 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-06-06T02:47:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-06-06T02:47:24.246 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-06-06T02:47:24.246 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-06-06T02:47:24.246 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-06-06T02:47:24.246 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-06-06T02:47:24.246 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-06-06T02:47:24.247 DEBUG:tasks.check_counter:Getting stats from c 2024-06-06T02:47:24.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-06T02:47:24.546 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:47:24.846 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:24 smithi184 ceph-mon[36922]: pgmap v734: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:24.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:24 smithi103 ceph-mon[36349]: pgmap v734: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:24.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:24 smithi082 ceph-mon[31579]: pgmap v734: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1790, 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1790, 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 16458458, 2024-06-06T02:47:26.489 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 568403, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 6, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.184757829, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.055015733, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.056017110, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.059878509, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1789, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.080843664, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000045189 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.490 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 369, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 357, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 5085680, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 179742, 2024-06-06T02:47:26.491 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 3, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.054548058, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.017785088, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.039987797, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.005623637, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 356, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.027300469, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000076686 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.492 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 859168, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 138976 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 167, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 337, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 41018, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 423156, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-06-06T02:47:26.493 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.028727976, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.011601294, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.004998961, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.006892046, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 335, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.016877929, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000050381 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.494 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 370368 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3688, 2024-06-06T02:47:26.495 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.104661681, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000028378 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-06-06T02:47:26.496 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-06-06T02:47:26.497 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 133, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 133, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 133, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 1, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-06-06T02:47:26.498 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2024-06-06T02:47:26.499 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T02:47:26.500 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-06-06T02:47:26.501 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:26.502 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 16916, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-06-06T02:47:26.503 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 20, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 3, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 24324106, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 24322455, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.504 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 16916 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 4, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 156, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 152, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 2, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 31, 2024-06-06T02:47:26.505 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 29, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 133, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 292, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 159, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 119292, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215344 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-06-06T02:47:26.506 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.507 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.508 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.509 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-06-06T02:47:26.510 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.511 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.512 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.513 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.514 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-06-06T02:47:26.515 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.516 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.517 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.518 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 2229, 2024-06-06T02:47:26.519 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:26.520 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:26.521 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:26.522 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 199009, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 58, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 156, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:26.523 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 105680, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 560, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-06-06T02:47:26.524 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 2080, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 2080, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2080, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 59.228809576, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.028475389 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2080, 2024-06-06T02:47:26.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2081 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 2080, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 2080, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 1160, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 918, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-06-06T02:47:26.526 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-06-06T02:47:26.527 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-06-06T02:47:26.528 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 0, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 6, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 6, 2024-06-06T02:47:26.529 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-06-06T02:47:26.530 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:26.531 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 2322, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 21360723, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 2322, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2322, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 21360723, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.532 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2080, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 20133222, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2080, 2024-06-06T02:47:26.533 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 20133222, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:26.534 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 2080, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 2080, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2080, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 2080, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:26.535 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.536 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x5647788108f0": { 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-06-06T02:47:26.537 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:26.538 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-06T02:47:26.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:26 smithi103 ceph-mon[36349]: pgmap v735: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:26.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:26 smithi082 ceph-mon[31579]: pgmap v735: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:26.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:26 smithi184 ceph-mon[36922]: pgmap v735: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:27.256 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-06T02:47:27.256 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-06-06T02:47:27.256 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-06-06T02:47:27.256 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-06-06T02:47:27.256 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-06-06T02:47:27.256 DEBUG:tasks.check_counter:Getting stats from f 2024-06-06T02:47:27.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-06T02:47:27.503 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:47:28.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:28 smithi103 ceph-mon[36349]: pgmap v736: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:28.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:28 smithi082 ceph-mon[31579]: pgmap v736: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:28.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:28 smithi184 ceph-mon[36922]: pgmap v736: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 244, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 232, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 859958, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 140579, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.038737683, 2024-06-06T02:47:29.562 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.014711804, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.032618312, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000025171, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 231, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.012034572, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000052097 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.563 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 859712, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 140256 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 3, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 174, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1262, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 372802, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.010093836, 2024-06-06T02:47:29.564 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.007267669, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.001332933, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000056814, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 172, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.011038041, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000064174 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.565 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 372160 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1898, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 1898, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 568034, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 602798, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 5, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 4, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.189178118, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.048490974, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.054761980, 2024-06-06T02:47:29.566 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.071861698, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1897, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.085707193, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000045180 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-06-06T02:47:29.567 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 448 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3297, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.103454343, 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000031378 2024-06-06T02:47:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 0, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 0, 2024-06-06T02:47:29.569 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 2, 2024-06-06T02:47:29.570 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 2, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 2, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 1, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:29.571 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-06-06T02:47:29.572 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:29.573 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 0 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-06-06T02:47:29.574 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T02:47:29.575 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 17, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-06-06T02:47:29.576 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 2, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 2, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 4219287, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 4217636, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.577 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 17 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 4, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 17, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 13, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 2, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 15, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 13, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 2, 2024-06-06T02:47:29.578 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 16, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 14, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 119564, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 215344 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 0, 2024-06-06T02:47:29.579 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 0, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.580 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:29.581 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.582 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.583 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.584 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.584 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-06-06T02:47:29.584 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.584 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.584 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.585 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.586 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.587 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.588 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.589 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-06-06T02:47:29.590 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:29.591 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 2, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 1, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 2, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 0, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 0, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 3895, 2024-06-06T02:47:29.592 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:29.593 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:29.594 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:29.595 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 198225, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 56, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 156, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:29.596 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 13456, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 36, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 1897, 2024-06-06T02:47:29.597 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 21, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 3, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 1897, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1897, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 88.202227414, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.046495639 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-06-06T02:47:29.598 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-06-06T02:47:29.601 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1897, 2024-06-06T02:47:29.601 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 1898 2024-06-06T02:47:29.601 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.601 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 1897, 2024-06-06T02:47:29.601 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 1897, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 1184, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 711, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 0, 2024-06-06T02:47:29.602 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 1, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-06-06T02:47:29.603 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-06-06T02:47:29.604 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 6, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 6, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-06-06T02:47:29.605 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 0, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 2, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 0 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 0, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-06-06T02:47:29.606 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 0, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:29.607 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 2141, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 1221007, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 2141, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 2141, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1221007, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.608 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1897, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 24988, 2024-06-06T02:47:29.609 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1897, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 24988, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:29.610 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 1897, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 1897, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1897, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 1897, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.611 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.612 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55e5a5bd2c30": { 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:29.613 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 0, 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 0, 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:29.614 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-06T02:47:30.460 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-06T02:47:30.461 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-06T02:47:30.461 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-06-06T02:47:30.461 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-06-06T02:47:30.461 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-06-06T02:47:30.461 DEBUG:tasks.check_counter:Getting stats from i 2024-06-06T02:47:30.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-06T02:47:30.705 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:47:30.830 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:30 smithi184 ceph-mon[36922]: pgmap v737: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:30.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:30 smithi103 ceph-mon[36349]: pgmap v737: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:30.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:30 smithi082 ceph-mon[31579]: pgmap v737: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:32.524 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-06T02:47:32.524 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:32.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 20158, 2024-06-06T02:47:32.524 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 21427, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 7505416, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 23451424, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 19, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 1.161347139, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.461702886, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.982255474, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.069375262, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 21424, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2.540224763, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000118569 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.525 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 13196, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.005108163, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000387 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 876544, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 148624 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 2093, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2285, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 545676, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 1183057, 2024-06-06T02:47:32.526 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 8, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 6, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.192928115, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.055036204, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.057587422, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.067615818, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2284, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.103316232, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000045234 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.527 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 375040 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 4382, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 3441, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 1446988, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 5021854, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 10, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 5, 2024-06-06T02:47:32.528 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.322463067, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.113374816, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.197517997, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.049595715, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3441, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.190040911, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000055228 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5480, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.001003931, 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000183 2024-06-06T02:47:32.529 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 1, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-MDSRank": { 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 2993, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 2.709333241, 2024-06-06T02:47:32.530 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000905223 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "finisher-PurgeQueue": { 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "queue_len": 0, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "complete_latency": { 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 3431, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.115004728, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000033519 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "mds": { 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "request": 538, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "reply": 522, 2024-06-06T02:47:32.531 INFO:teuthology.orchestra.run.smithi184.stdout: "reply_latency": { 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 522, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.922673299, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.001767573 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_reply": 0, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "forward": 16, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_complete": 0, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_fetch_keys": 0, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_commit": 20, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_split": 1, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_merge": 0, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes": 19, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_top": 2, 2024-06-06T02:47:32.532 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_bottom": 17, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pin_tail": 0, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_pinned": 13, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_expired": 172, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "inodes_with_caps": 0, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "caps": 0, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "subtrees": 3, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse": 1185, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_hit": 821, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_forward": 16, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_discover": 87, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_dir_fetch": 0, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_remote_ino": 0, 2024-06-06T02:47:32.533 INFO:teuthology.orchestra.run.smithi184.stdout: "traverse_lock": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "load_cent": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "q": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "exported": 12, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "exported_inodes": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "imported": 5, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "imported_inodes": 25, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_dir_fetch": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_backtrace_fetch": 262, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "openino_peer_discover": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rfiles": 325, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rbytes": 13424230507, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "root_rsnaps": 0, 2024-06-06T02:47:32.534 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_fetch": 262, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_set_tag": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_backtrace_repaired": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_inotable_repaired": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_inodes": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dir_base_inodes": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_dirfrag_rstats": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "scrub_file_inodes": 262, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_inode_file_caps": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_revoke": 8, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_grant": 1974, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_trunc": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-06T02:47:32.535 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps": 16472, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_caps_dirty": 15496, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_cap_release": 10, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "process_request_cap_release": 284 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_cache": { 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update": 72, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_update_receipt": 250, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_try_discover": 168, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_send_discover": 165, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "dir_handle_discover": 72, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays": 0, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_delayed": 0, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "num_strays_enqueuing": 0, 2024-06-06T02:47:32.536 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_created": 132, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_enqueued": 132, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_reintegrated": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "strays_migrated": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_processing": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_enqueued": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "num_recovering_prioritized": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_started": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "recovery_completed": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_path": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_quiesce_inode": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_enqueue_scrub": 0, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_exportdir": 12, 2024-06-06T02:47:32.537 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_flush": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragmentdir": 1, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_fragstats": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "ireq_inodestats": 0 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_log": { 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evlrg": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evadd": 16916, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evex": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evtrm": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "ev": 16916, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evexg": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "evexd": 0, 2024-06-06T02:47:32.538 INFO:teuthology.orchestra.run.smithi184.stdout: "segadd": 20, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "segex": 0, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "segtrm": 0, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "seg": 20, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "segmjr": 3, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "segexg": 0, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "segexd": 0, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "expos": 4194304, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "wrpos": 24324106, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "rdpos": 0, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "jlat": { 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 1235, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 39.006572827, 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.031584269 2024-06-06T02:47:32.539 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "replayed": 0 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_mem": { 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "ino": 23, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "ino+": 241, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "ino-": 218, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dir": 22, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dir+": 120, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dir-": 98, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dn": 19, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dn+": 459, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "dn-": 440, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "cap": 0, 2024-06-06T02:47:32.540 INFO:teuthology.orchestra.run.smithi184.stdout: "cap+": 194, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "cap-": 194, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "rss": 129840, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "heap": 223536 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_server": { 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_client_request": 799, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "dispatch_server_request": 9, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_request": 538, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_client_session": 8, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "handle_peer_request": 274, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "req_create_latency": { 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 111, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.223275064, 2024-06-06T02:47:32.541 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002011487 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getattr_latency": { 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getfilelock_latency": { 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "req_link_latency": { 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.542 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookup_latency": { 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 208, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.137518407, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000661146 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookuphash_latency": { 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupino_latency": { 2024-06-06T02:47:32.543 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupname_latency": { 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupparent_latency": { 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lookupsnap_latency": { 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "req_lssnap_latency": { 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.545 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mkdir_latency": { 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mknod_latency": { 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.546 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_mksnap_latency": { 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_open_latency": { 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 47, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.204613194, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.004353472 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "req_readdir_latency": { 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 24, 2024-06-06T02:47:32.547 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.012177518, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000507396 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rename_latency": { 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_renamesnap_latency": { 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.548 INFO:teuthology.orchestra.run.smithi184.stdout: "req_snapdiff_latency": { 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmdir_latency": { 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmsnap_latency": { 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.549 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "req_rmxattr_latency": { 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setattr_latency": { 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setdirlayout_latency": { 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.550 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setfilelock_latency": { 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setlayout_latency": { 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.551 INFO:teuthology.orchestra.run.smithi184.stdout: "req_setxattr_latency": { 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "req_symlink_latency": { 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "req_unlink_latency": { 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 132, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.345089116, 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.002614311 2024-06-06T02:47:32.552 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_revoke_eviction": 0, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "cap_acquisition_throttle": 0, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "req_getvxattr_latency": { 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_sessions": { 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "session_count": 1, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "session_add": 1, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "session_remove": 0, 2024-06-06T02:47:32.553 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_open": 1, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "sessions_stale": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "total_load": 280, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "average_load": 280, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "avg_session_uptime": 497, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "mdthresh_evicted": 0 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:32.554 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:32.555 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-06-06T02:47:32.556 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 291014, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 107, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:32.557 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 7592, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 156, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 93525, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 364, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "objecter": { 2024-06-06T02:47:32.558 INFO:teuthology.orchestra.run.smithi184.stdout: "op_active": 0, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_laggy": 0, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send": 5032, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_send_bytes": 20339854, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_resend": 30, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_reply": 5032, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_latency": { 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5032, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 877.540385243, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.174391968 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "op_inflight": 0, 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "oplen_avg": { 2024-06-06T02:47:32.559 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 5032, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 5367 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "op": 5032, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "op_r": 265, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "op_w": 4767, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "op_rmw": 0, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "op_pg": 0, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_stat": 0, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_create": 10, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_read": 3, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_write": 1238, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writefull": 35, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_writesame": 0, 2024-06-06T02:47:32.560 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_append": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_zero": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_truncate": 1, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_delete": 3220, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_mapext": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_sparse_read": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_clonerange": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_getxattr": 262, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_setxattr": 20, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_cmpxattr": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_rmxattr": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_resetxattrs": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_call": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_watch": 0, 2024-06-06T02:47:32.561 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_notify": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_src_cmpxattr": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_pgls_filter": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "osdop_other": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_active": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_send": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_resend": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "linger_ping": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_active": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_send": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "poolop_resend": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_active": 0, 2024-06-06T02:47:32.562 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_send": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "poolstat_resend": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_active": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_send": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "statfs_resend": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "command_active": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "command_send": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "command_resend": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "map_epoch": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "map_full": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "map_inc": 0, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_sessions": 12, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_open": 12, 2024-06-06T02:47:32.563 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_session_close": 0, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_laggy": 0, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_wr": 408, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_rd": 0, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_del": 170 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "oft": { 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_objs": 1, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_kv_pairs": 0, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_updates": 0, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "omap_total_removes": 0 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "osd-slow-ops": { 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: "slow_ops_count": 0 2024-06-06T02:47:32.564 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "purge_queue": { 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops": 0, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_ops_high_water": 25, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing": 0, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executing_high_water": 4, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed_ops": 3204, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_executed": 132, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "pq_item_in_journal": 0 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:32.565 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 26629, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 7370265, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 26629, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 26629, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 7370265, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.566 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_bytes": { 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 5032, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 20353186, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 5032, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 20353186, 2024-06-06T02:47:32.567 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-objecter_ops": { 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 1024, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 0, 2024-06-06T02:47:32.568 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 5032, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 5032, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 5032, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 5032, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle": { 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:32.569 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 132, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 13332, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 132, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 3, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 13332, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:32.570 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-write_buf_throttle-0x55a0998c6680": { 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 3758096384, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 16916, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 20129802, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 16916, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 1235, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 20129802, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:32.571 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:32.572 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:32.572 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.572 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:32.572 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-06T02:47:32.870 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:32 smithi103 ceph-mon[36349]: pgmap v738: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:32.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:32 smithi082 ceph-mon[31579]: pgmap v738: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:32.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:32 smithi184 ceph-mon[36922]: pgmap v738: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-06-06T02:47:33.201 INFO:tasks.check_counter:Daemon mds.i mds.exported=12 2024-06-06T02:47:33.201 INFO:tasks.check_counter:Daemon mds.i mds.imported=5 2024-06-06T02:47:33.201 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=72 2024-06-06T02:47:33.201 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=250 2024-06-06T02:47:33.201 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-06-06T02:47:33.201 DEBUG:tasks.check_counter:Getting stats from l 2024-06-06T02:47:33.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-06T02:47:33.440 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.c/config 2024-06-06T02:47:34.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:34 smithi103 ceph-mon[36349]: pgmap v739: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:34.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:34 smithi082 ceph-mon[31579]: pgmap v739: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:34.872 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:34 smithi184 ceph-mon[36922]: pgmap v739: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-0": { 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 0, 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 2, 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 0, 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 0, 2024-06-06T02:47:35.389 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 4, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 0, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.000946033, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.000000000, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.000111244, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:35.390 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 0 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-1": { 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 240, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 233, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 820448, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 143072, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 2, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 1, 2024-06-06T02:47:35.391 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.040819246, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.015409918, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.035883021, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 233, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.016886873, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000072475 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:35.392 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 820448, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 143072 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "AsyncMessenger::Worker-2": { 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_messages": 1, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages": 177, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_bytes": 160, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_bytes": 110048, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_created_connections": 3, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_active_connections": 2, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_total_time": 0.010298091, 2024-06-06T02:47:35.393 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_send_time": 0.008080724, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_recv_time": 0.000465612, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_messages_queue_lat": { 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 175, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.014348470, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000081991 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_handle_ack_lat": { 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.394 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "msgr_send_encrypted_bytes": 110048 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "cct": { 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "total_workers": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "unhealthy_workers": 0 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "mempool": { 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_bytes": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bloom_filter_items": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_bytes": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_alloc_items": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_bytes": 0, 2024-06-06T02:47:35.395 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_data_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_onode_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_meta_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_other_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_cache_buffer_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_extent_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_bytes": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_blob_items": 0, 2024-06-06T02:47:35.396 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_shared_blob_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_inline_bl_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_fsck_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_txc_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_deferred_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluestore_writing_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_bytes": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_items": 0, 2024-06-06T02:47:35.397 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_bytes": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_reader_items": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_bytes": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "bluefs_file_writer_items": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_bytes": 148945, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_anon_items": 29, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_bytes": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "buffer_meta_items": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_bytes": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_items": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_bytes": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_mapbl_items": 0, 2024-06-06T02:47:35.398 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_pglog_items": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_items": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "osdmap_mapping_items": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "pgmap_items": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_bytes": 928, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_co_items": 2, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_1_items": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_bytes": 0, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "unittest_2_items": 0 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-06-06T02:47:35.399 INFO:teuthology.orchestra.run.smithi184.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "val": 0, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "max": 104857600, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "get_started": 0, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "get": 237, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "get_sum": 784037, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_fail": 0, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "get_or_fail_success": 237, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "take": 0, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "take_sum": 0, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "put": 237, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "put_sum": 784037, 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "wait": { 2024-06-06T02:47:35.400 INFO:teuthology.orchestra.run.smithi184.stdout: "avgcount": 0, 2024-06-06T02:47:35.401 INFO:teuthology.orchestra.run.smithi184.stdout: "sum": 0.000000000, 2024-06-06T02:47:35.401 INFO:teuthology.orchestra.run.smithi184.stdout: "avgtime": 0.000000000 2024-06-06T02:47:35.401 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:35.401 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-06-06T02:47:35.401 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-06-06T02:47:36.094 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-06-06T02:47:36.094 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-06-06T02:47:36.094 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-06-06T02:47:36.094 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-06-06T02:47:36.094 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-06-06T02:47:36.095 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-06T02:47:36.107 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-06T02:47:36.107 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:47:36.108 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T02:47:36.192 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-06-06T02:47:36.192 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-06T02:47:36.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd blocklist ls 2024-06-06T02:47:36.693 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:36.867 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:36 smithi103 ceph-mon[36349]: pgmap v740: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:36.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:36 smithi082 ceph-mon[31579]: pgmap v740: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:36.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:36 smithi184 ceph-mon[36922]: pgmap v740: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:38.862 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:38 smithi082 ceph-mon[31579]: pgmap v741: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:38.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:38 smithi184 ceph-mon[36922]: pgmap v741: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2502940005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010dc40 msgr2=0x7ff9c010e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2502940005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010dc40 0x7ff9c010e050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009960 tx=0x7ff9ac02a460 comp rx=0 tx=0).stop 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2502940005 shutdown_connections 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2502940005 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c010e590 0x7ff9c0115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2502940005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010dc40 0x7ff9c010e050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2502940005 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c0109310 0x7ff9c0109720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2502940005 >> 172.21.15.82:0/2502940005 conn(0x7ff9c0078a80 msgr2=0x7ff9c0107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2502940005 shutdown_connections 2024-06-06T02:47:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.073+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2502940005 wait complete. 2024-06-06T02:47:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.074+0000 7ff9c4a00640 1 Processor -- start 2024-06-06T02:47:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.074+0000 7ff9c4a00640 1 -- start start 2024-06-06T02:47:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 0x7ff9c019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c010dc40 0x7ff9c01a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 0x7ff9c01a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0119290 con 0x7ff9c010e590 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0119110 con 0x7ff9c010dc40 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9c4a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0119410 con 0x7ff9c0109310 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9bf200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 0x7ff9c01a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9bde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c010dc40 0x7ff9c01a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9be800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 0x7ff9c019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9bf200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 0x7ff9c01a4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37394/0 (socket says 172.21.15.82:37394) 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.075+0000 7ff9bf200640 1 -- 172.21.15.82:0/2865577640 learned_addr learned my addr 172.21.15.82:0/2865577640 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 -- 172.21.15.82:0/2865577640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c010dc40 msgr2=0x7ff9c01a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c010dc40 0x7ff9c01a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 -- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 msgr2=0x7ff9c01a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:39.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 0x7ff9c01a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 -- 172.21.15.82:0/2865577640 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c01a4ba0 con 0x7ff9c0109310 2024-06-06T02:47:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9be800640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 0x7ff9c019fd30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000ea20 tx=0x7ff9b000eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000cd50 con 0x7ff9c0109310 2024-06-06T02:47:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9b00035f0 con 0x7ff9c0109310 2024-06-06T02:47:39.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0010690 con 0x7ff9c0109310 2024-06-06T02:47:39.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c01a4e90 con 0x7ff9c0109310 2024-06-06T02:47:39.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.076+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c01a5350 con 0x7ff9c0109310 2024-06-06T02:47:39.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.077+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c010a7c0 con 0x7ff9c0109310 2024-06-06T02:47:39.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.080+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff9b00037a0 con 0x7ff9c0109310 2024-06-06T02:47:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.081+0000 7ff9b7400640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 0x7ff9a40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.082+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7ff9b00e2610 con 0x7ff9c0109310 2024-06-06T02:47:39.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.082+0000 7ff9bde00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 0x7ff9a40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:39.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.082+0000 7ff9bde00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 0x7ff9a40b4d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:39.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.083+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff9b0054df0 con 0x7ff9c0109310 2024-06-06T02:47:39.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:38 smithi103 ceph-mon[36349]: pgmap v741: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-06-06T02:47:39.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.307+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff9c0109720 con 0x7ff9c0109310 2024-06-06T02:47:39.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.308+0000 7ff9b7400640 1 -- 172.21.15.82:0/2865577640 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v80) ==== 81+0+590 (secure 0 0 0) 0x7ff9b00aa2f0 con 0x7ff9c0109310 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1235186567 2024-06-07T02:25:14.582200+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1579417717 2024-06-07T02:25:14.582200+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1616509269 2024-06-07T02:25:14.582200+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/498850809 2024-06-07T02:24:44.429691+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3563640747 2024-06-07T02:24:44.429691+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3563640747 2024-06-07T02:24:44.429691+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1579417717 2024-06-07T02:25:14.582200+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4084733545 2024-06-07T02:25:14.582200+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1869865938 2024-06-07T02:24:44.429691+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/370056535 2024-06-07T02:24:44.429691+0000 2024-06-06T02:47:39.309 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-06-06T02:47:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.311+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 msgr2=0x7ff9a40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 0x7ff9a40b4d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009230 tx=0x7ff9ac005d50 comp rx=0 tx=0).stop 2024-06-06T02:47:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 msgr2=0x7ff9c019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 0x7ff9c019fd30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000ea20 tx=0x7ff9b000eee0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 shutdown_connections 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9c010e590 0x7ff9c01a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9c010dc40 0x7ff9c01a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7ff9a40b2870 0x7ff9a40b4d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 --2- 172.21.15.82:0/2865577640 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9c0109310 0x7ff9c019fd30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 >> 172.21.15.82:0/2865577640 conn(0x7ff9c0078a80 msgr2=0x7ff9c00791f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 shutdown_connections 2024-06-06T02:47:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:39.312+0000 7ff9c4a00640 1 -- 172.21.15.82:0/2865577640 wait complete. 2024-06-06T02:47:39.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:39 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2865577640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T02:47:40.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:39 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2865577640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T02:47:40.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:39 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2865577640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-06T02:47:40.198 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-06T02:47:40.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:47:40.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-06-06T02:47:40.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T02:47:40.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:47:40.341 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-06-06T02:47:40.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:47:40.423 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-06-06T02:47:40.546 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-06-06T02:47:40.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:47:40.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-06-06T02:47:40.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-06T02:47:40.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-06-06T02:47:40.820 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-06T02:47:40.833 INFO:tasks.cephadm:Teardown begin 2024-06-06T02:47:40.834 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-06T02:47:40.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:47:40.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:40 smithi184 ceph-mon[36922]: pgmap v742: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:40.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:40 smithi082 ceph-mon[31579]: pgmap v742: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:41.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:40 smithi103 ceph-mon[36349]: pgmap v742: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-06-06T02:47:41.235 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:42.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:42 smithi184 ceph-mon[36922]: pgmap v743: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-06-06T02:47:43.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:42 smithi082 ceph-mon[31579]: pgmap v743: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-06-06T02:47:43.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:42 smithi103 ceph-mon[36349]: pgmap v743: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 -- 172.21.15.82:0/4003679253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 msgr2=0x7f06b0109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 --2- 172.21.15.82:0/4003679253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b0109e30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f069c009930 tx=0x7f069c02a440 comp rx=0 tx=0).stop 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 -- 172.21.15.82:0/4003679253 shutdown_connections 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 --2- 172.21.15.82:0/4003679253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b010a370 0x7f06b0111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 --2- 172.21.15.82:0/4003679253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b0109e30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 --2- 172.21.15.82:0/4003679253 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b01050f0 0x7f06b0105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 -- 172.21.15.82:0/4003679253 >> 172.21.15.82:0/4003679253 conn(0x7f06b0100b90 msgr2=0x7f06b0102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 -- 172.21.15.82:0/4003679253 shutdown_connections 2024-06-06T02:47:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.627+0000 7f06b5e00640 1 -- 172.21.15.82:0/4003679253 wait complete. 2024-06-06T02:47:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.628+0000 7f06b5e00640 1 Processor -- start 2024-06-06T02:47:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 -- start start 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 0x7f06b01a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b010a370 0x7f06b019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06b0115050 con 0x7f06b010a370 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f06b0114ed0 con 0x7f06b0109a20 2024-06-06T02:47:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.629+0000 7f06b5e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f06b01151d0 con 0x7f06b01050f0 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06af400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b010a370 0x7f06b019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06aea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 0x7f06b01a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:50038/0 (socket says 172.21.15.82:50038) 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06aea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 0x7f06b01a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:56372/0 (socket says 172.21.15.82:56372) 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 -- 172.21.15.82:0/1247583894 learned_addr learned my addr 172.21.15.82:0/1247583894 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 -- 172.21.15.82:0/1247583894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 msgr2=0x7f06b01a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 0x7f06b01a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 -- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b010a370 msgr2=0x7f06b019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b010a370 0x7f06b019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.630+0000 7f06ae000640 1 -- 172.21.15.82:0/1247583894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b019bfb0 con 0x7f06b0109a20 2024-06-06T02:47:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06ae000640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f069c005940 tx=0x7f069c0319e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c03f030 con 0x7f06b0109a20 2024-06-06T02:47:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f069c0043d0 con 0x7f06b0109a20 2024-06-06T02:47:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b019c240 con 0x7f06b0109a20 2024-06-06T02:47:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c035070 con 0x7f06b0109a20 2024-06-06T02:47:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.631+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b019c770 con 0x7f06b0109a20 2024-06-06T02:47:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.633+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b01065a0 con 0x7f06b0109a20 2024-06-06T02:47:43.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.635+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f069c042030 con 0x7f06b0109a20 2024-06-06T02:47:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.636+0000 7f06b4a00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 0x7f06940b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.637+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7f069c102800 con 0x7f06b0109a20 2024-06-06T02:47:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.637+0000 7f06aea00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 0x7f06940b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.637+0000 7f06aea00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 0x7f06940b4d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06b019ca80 tx=0x7f06a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.638+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f06b019c770 con 0x7f06b0109a20 2024-06-06T02:47:43.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.885+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06b0105500 con 0x7f06b0109a20 2024-06-06T02:47:43.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.887+0000 7f06b4a00640 1 -- 172.21.15.82:0/1247583894 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11871 (secure 0 0 0) 0x7f069c0c9e90 con 0x7f06b0109a20 2024-06-06T02:47:43.887 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:47:43.887 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:46:15.533437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:47:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 msgr2=0x7f06940b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 0x7f06940b4d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f06b019ca80 tx=0x7f06a0005f90 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 msgr2=0x7f06b01a1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f069c005940 tx=0x7f069c0319e0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 shutdown_connections 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b010a370 0x7f06b019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06b0109a20 0x7f06b01a1c60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f06940b2870 0x7f06940b4d80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 --2- 172.21.15.82:0/1247583894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06b01050f0 0x7f06b01a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 >> 172.21.15.82:0/1247583894 conn(0x7f06b0100b90 msgr2=0x7f06b0102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 shutdown_connections 2024-06-06T02:47:43.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:43.890+0000 7f06b5e00640 1 -- 172.21.15.82:0/1247583894 wait complete. 2024-06-06T02:47:44.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs dump --format=json 2024-06-06T02:47:44.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:44 smithi184 ceph-mon[36922]: pgmap v744: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:44.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:44 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/1247583894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:45.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:44 smithi103 ceph-mon[36349]: pgmap v744: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:45.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:44 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/1247583894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:44 smithi082 ceph-mon[31579]: pgmap v744: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:45.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:44 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/1247583894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:45.212 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:46.840 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:46 smithi082 ceph-mon[31579]: pgmap v745: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:47.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:46 smithi103 ceph-mon[36349]: pgmap v745: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:47.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:46 smithi184 ceph-mon[36922]: pgmap v745: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 -- 172.21.15.82:0/3921936363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 msgr2=0x7fa22c10f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 --2- 172.21.15.82:0/3921936363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c10f070 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa218009900 tx=0x7fa21802a400 comp rx=0 tx=0).stop 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 -- 172.21.15.82:0/3921936363 shutdown_connections 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 --2- 172.21.15.82:0/3921936363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c10f5b0 0x7fa22c1119d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 --2- 172.21.15.82:0/3921936363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c10f070 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 --2- 172.21.15.82:0/3921936363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c101a00 0x7fa22c101e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.396+0000 7fa232200640 1 -- 172.21.15.82:0/3921936363 >> 172.21.15.82:0/3921936363 conn(0x7fa22c078a90 msgr2=0x7fa22c078ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:47.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.397+0000 7fa232200640 1 -- 172.21.15.82:0/3921936363 shutdown_connections 2024-06-06T02:47:47.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.397+0000 7fa232200640 1 -- 172.21.15.82:0/3921936363 wait complete. 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.398+0000 7fa232200640 1 Processor -- start 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.398+0000 7fa232200640 1 -- start start 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c10f5b0 0x7fa22c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c115020 con 0x7fa22c102350 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c114ea0 con 0x7fa22c10f5b0 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa232200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fa22c1151a0 con 0x7fa22c101a00 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa22b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa22aa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa22b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:56386/0 (socket says 172.21.15.82:56386) 2024-06-06T02:47:47.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa22b400640 1 -- 172.21.15.82:0/2465717569 learned_addr learned my addr 172.21.15.82:0/2465717569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.399+0000 7fa22be00640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c10f5b0 0x7fa22c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 -- 172.21.15.82:0/2465717569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c10f5b0 msgr2=0x7fa22c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:47.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c10f5b0 0x7fa22c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 -- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 msgr2=0x7fa22c1a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c1a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 -- 172.21.15.82:0/2465717569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22c19bf00 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa22b400640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9f0 tx=0x7fa21c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00cd80 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa21c0108e0 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c018980 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.400+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22c19c1f0 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.401+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa22c1a8500 con 0x7fa22c101a00 2024-06-06T02:47:47.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.402+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22c101e10 con 0x7fa22c101a00 2024-06-06T02:47:47.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.404+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa21c010430 con 0x7fa22c101a00 2024-06-06T02:47:47.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.406+0000 7fa223e00640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 0x7fa2100b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:47.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.406+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fa21c0e2a40 con 0x7fa22c101a00 2024-06-06T02:47:47.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.406+0000 7fa22aa00640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 0x7fa2100b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:47.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.407+0000 7fa22aa00640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 0x7fa2100b4d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa218031440 tx=0x7fa218009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:47.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.407+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa21c0aa0d0 con 0x7fa22c101a00 2024-06-06T02:47:47.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.659+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa22c10a740 con 0x7fa22c101a00 2024-06-06T02:47:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.661+0000 7fa223e00640 1 -- 172.21.15.82:0/2465717569 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11871 (secure 0 0 0) 0x7fa21c0ae3d0 con 0x7fa22c101a00 2024-06-06T02:47:47.661 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:47:47.661 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14487,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/2462955509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2462955509},{"type":"v1","addr":"172.21.15.82:6835","nonce":2462955509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14499,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2409954600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2409954600},{"type":"v1","addr":"172.21.15.82:6837","nonce":2409954600}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24578,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6833/2511438275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2511438275},{"type":"v1","addr":"172.21.15.103:6833","nonce":2511438275}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24598,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/660710871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":660710871},{"type":"v1","addr":"172.21.15.184:6833","nonce":660710871}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/407132761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":407132761},{"type":"v1","addr":"172.21.15.103:6835","nonce":407132761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/2953735672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":2953735672},{"type":"v1","addr":"172.21.15.103:6837","nonce":2953735672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-06T02:34:03.585827+0000","modified":"2024-06-06T02:46:15.533437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24676,"mds_1":24664,"mds_2":24659},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24643":{"gid":24643,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/1227923673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":1227923673},{"type":"v1","addr":"172.21.15.184:6835","nonce":1227923673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/387834603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":387834603},{"type":"v1","addr":"172.21.15.184:6837","nonce":387834603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"a","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/109083450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":109083450},{"type":"v1","addr":"172.21.15.82:6841","nonce":109083450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.103:6839/426995210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":426995210},{"type":"v1","addr":"172.21.15.103:6839","nonce":426995210}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.184:6839/1945283306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1945283306},{"type":"v1","addr":"172.21.15.184:6839","nonce":1945283306}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"g","rank":0,"incarnation":14,"state":"up:active","state_seq":8,"addr":"172.21.15.82:6839/3528791947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3528791947},{"type":"v1","addr":"172.21.15.82:6839","nonce":3528791947}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24676,"qdb_cluster":[24676,24664,24659]},"id":1}]} 2024-06-06T02:47:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-06-06T02:47:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.663+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 msgr2=0x7fa2100b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.663+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 0x7fa2100b4d00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa218031440 tx=0x7fa218009560 comp rx=0 tx=0).stop 2024-06-06T02:47:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.663+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 msgr2=0x7fa22c1a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e9f0 tx=0x7fa21c00eeb0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 shutdown_connections 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa22c10f5b0 0x7fa22c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa22c102350 0x7fa22c1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fa2100b27f0 0x7fa2100b4d00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 --2- 172.21.15.82:0/2465717569 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa22c101a00 0x7fa22c1a1670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 >> 172.21.15.82:0/2465717569 conn(0x7fa22c078a90 msgr2=0x7fa22c110aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 shutdown_connections 2024-06-06T02:47:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:47.664+0000 7fa232200640 1 -- 172.21.15.82:0/2465717569 wait complete. 2024-06-06T02:47:48.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-06T02:47:48.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:48 smithi082 ceph-mon[31579]: pgmap v746: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:48.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:48 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2465717569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:49.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:48 smithi103 ceph-mon[36349]: pgmap v746: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:49.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:48 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2465717569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:48 smithi184 ceph-mon[36922]: pgmap v746: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 6 op/s 2024-06-06T02:47:49.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:48 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2465717569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-06T02:47:50.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:50 smithi082 ceph-mon[31579]: pgmap v747: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:51.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:50 smithi103 ceph-mon[36349]: pgmap v747: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:51.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:50 smithi184 ceph-mon[36922]: pgmap v747: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:51.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2458193165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9810b6c0 msgr2=0x7fcf9810bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:51.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2458193165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9810b6c0 0x7fcf9810bad0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009930 tx=0x7fcf8802a440 comp rx=0 tx=0).stop 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2458193165 shutdown_connections 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2458193165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf98110940 0x7fcf981182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2458193165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf98110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2458193165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf9810b6c0 0x7fcf9810bad0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2458193165 >> 172.21.15.82:0/2458193165 conn(0x7fcf9806fee0 msgr2=0x7fcf98109760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.152+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2458193165 shutdown_connections 2024-06-06T02:47:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.153+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2458193165 wait complete. 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.154+0000 7fcf9ea00640 1 Processor -- start 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.154+0000 7fcf9ea00640 1 -- start start 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf981a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf98110940 0x7fcf981a8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9811b680 con 0x7fcf9810b6c0 2024-06-06T02:47:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9811b500 con 0x7fcf9810fff0 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ea00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9811b800 con 0x7fcf98110940 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf97e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf97e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48518/0 (socket says 172.21.15.82:48518) 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf97e00640 1 -- 172.21.15.82:0/2508725234 learned_addr learned my addr 172.21.15.82:0/2508725234 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf8f400640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf981a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.155+0000 7fcf9ca00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf98110940 0x7fcf981a8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:51.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 -- 172.21.15.82:0/2508725234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf98110940 msgr2=0x7fcf981a8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf98110940 0x7fcf981a8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 -- 172.21.15.82:0/2508725234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 msgr2=0x7fcf981a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf981a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 -- 172.21.15.82:0/2508725234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf981a91b0 con 0x7fcf9810b6c0 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf8f400640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf981a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.156+0000 7fcf97e00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009230 tx=0x7fcf88004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.157+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8803f030 con 0x7fcf9810b6c0 2024-06-06T02:47:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.157+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf981a9440 con 0x7fcf9810b6c0 2024-06-06T02:47:51.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.157+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf88004440 con 0x7fcf9810b6c0 2024-06-06T02:47:51.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.157+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88035070 con 0x7fcf9810b6c0 2024-06-06T02:47:51.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.157+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a9970 con 0x7fcf9810b6c0 2024-06-06T02:47:51.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.158+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9810bad0 con 0x7fcf9810b6c0 2024-06-06T02:47:51.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.161+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fcf88042030 con 0x7fcf9810b6c0 2024-06-06T02:47:51.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.162+0000 7fcf95600640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 0x7fcf7c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.163+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fcf88102940 con 0x7fcf9810b6c0 2024-06-06T02:47:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.163+0000 7fcf8f400640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 0x7fcf7c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.164+0000 7fcf8f400640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 0x7fcf7c0b4d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf9810a710 tx=0x7fcf80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.165+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcf880c9fd0 con 0x7fcf9810b6c0 2024-06-06T02:47:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.380+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf981b0f40 con 0x7fcf9810b6c0 2024-06-06T02:47:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.383+0000 7fcf95600640 1 -- 172.21.15.82:0/2508725234 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22701 (secure 0 0 0) 0x7fcf880ce2d0 con 0x7fcf9810b6c0 2024-06-06T02:47:51.383 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-06-06T02:47:51.386 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"b8ccb8a2-23ab-11ef-bc9b-c7b262605968","created":"2024-06-06T02:24:12.041095+0000","modified":"2024-06-06T02:34:15.831272+0000","last_up_change":"2024-06-06T02:32:53.847837+0000","last_in_change":"2024-06-06T02:32:34.745746+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-06T02:28:46.735414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-06T02:33:55.297725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-06T02:33:59.381038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"924068dd-3df9-4f5e-8793-d853e41803ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6803","nonce":1718007195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6805","nonce":1718007195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6809","nonce":1718007195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":1718007195},{"type":"v1","addr":"172.21.15.82:6807","nonce":1718007195}]},"public_addr":"172.21.15.82:6803/1718007195","cluster_addr":"172.21.15.82:6805/1718007195","heartbeat_back_addr":"172.21.15.82:6809/1718007195","heartbeat_front_addr":"172.21.15.82:6807/1718007195","state":["exists","up"]},{"osd":1,"uuid":"2cba94c6-c648-4beb-a92a-51cc809abb4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6801","nonce":496472221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6803","nonce":496472221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6807","nonce":496472221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":496472221},{"type":"v1","addr":"172.21.15.103:6805","nonce":496472221}]},"public_addr":"172.21.15.103:6801/496472221","cluster_addr":"172.21.15.103:6803/496472221","heartbeat_back_addr":"172.21.15.103:6807/496472221","heartbeat_front_addr":"172.21.15.103:6805/496472221","state":["exists","up"]},{"osd":2,"uuid":"79f93c60-64fb-4787-9060-e630dc82b86a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6801","nonce":3542247207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6803","nonce":3542247207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6807","nonce":3542247207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3542247207},{"type":"v1","addr":"172.21.15.184:6805","nonce":3542247207}]},"public_addr":"172.21.15.184:6801/3542247207","cluster_addr":"172.21.15.184:6803/3542247207","heartbeat_back_addr":"172.21.15.184:6807/3542247207","heartbeat_front_addr":"172.21.15.184:6805/3542247207","state":["exists","up"]},{"osd":3,"uuid":"3525ec4e-8aba-4b93-a2a0-53d0768d6024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6811","nonce":2283254494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6813","nonce":2283254494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6817","nonce":2283254494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2283254494},{"type":"v1","addr":"172.21.15.82:6815","nonce":2283254494}]},"public_addr":"172.21.15.82:6811/2283254494","cluster_addr":"172.21.15.82:6813/2283254494","heartbeat_back_addr":"172.21.15.82:6817/2283254494","heartbeat_front_addr":"172.21.15.82:6815/2283254494","state":["exists","up"]},{"osd":4,"uuid":"e6577bfe-f247-4018-abca-2aa1e02cd3f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6809","nonce":3776177074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6811","nonce":3776177074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6815","nonce":3776177074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3776177074},{"type":"v1","addr":"172.21.15.103:6813","nonce":3776177074}]},"public_addr":"172.21.15.103:6809/3776177074","cluster_addr":"172.21.15.103:6811/3776177074","heartbeat_back_addr":"172.21.15.103:6815/3776177074","heartbeat_front_addr":"172.21.15.103:6813/3776177074","state":["exists","up"]},{"osd":5,"uuid":"7650a94a-7c8c-4eb2-8c34-937d964e525c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6809","nonce":3267310596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6811","nonce":3267310596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6815","nonce":3267310596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3267310596},{"type":"v1","addr":"172.21.15.184:6813","nonce":3267310596}]},"public_addr":"172.21.15.184:6809/3267310596","cluster_addr":"172.21.15.184:6811/3267310596","heartbeat_back_addr":"172.21.15.184:6815/3267310596","heartbeat_front_addr":"172.21.15.184:6813/3267310596","state":["exists","up"]},{"osd":6,"uuid":"dca2a063-43f3-474f-a96d-478981f1837e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6819","nonce":1499298999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6821","nonce":1499298999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6825","nonce":1499298999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":1499298999},{"type":"v1","addr":"172.21.15.82:6823","nonce":1499298999}]},"public_addr":"172.21.15.82:6819/1499298999","cluster_addr":"172.21.15.82:6821/1499298999","heartbeat_back_addr":"172.21.15.82:6825/1499298999","heartbeat_front_addr":"172.21.15.82:6823/1499298999","state":["exists","up"]},{"osd":7,"uuid":"36f7b2c1-73e5-4ec8-b026-5c223ad9b7d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6817","nonce":293167460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6819","nonce":293167460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6823","nonce":293167460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":293167460},{"type":"v1","addr":"172.21.15.103:6821","nonce":293167460}]},"public_addr":"172.21.15.103:6817/293167460","cluster_addr":"172.21.15.103:6819/293167460","heartbeat_back_addr":"172.21.15.103:6823/293167460","heartbeat_front_addr":"172.21.15.103:6821/293167460","state":["exists","up"]},{"osd":8,"uuid":"b3b0861e-e4e4-4cd2-9a2f-4bfbd7059dd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6817","nonce":3131602198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6819","nonce":3131602198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6823","nonce":3131602198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":3131602198},{"type":"v1","addr":"172.21.15.184:6821","nonce":3131602198}]},"public_addr":"172.21.15.184:6817/3131602198","cluster_addr":"172.21.15.184:6819/3131602198","heartbeat_back_addr":"172.21.15.184:6823/3131602198","heartbeat_front_addr":"172.21.15.184:6821/3131602198","state":["exists","up"]},{"osd":9,"uuid":"4e0ab7ce-21f3-4c86-a051-c7e28dfd8069","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6827","nonce":1326866066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6829","nonce":1326866066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6833","nonce":1326866066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1326866066},{"type":"v1","addr":"172.21.15.82:6831","nonce":1326866066}]},"public_addr":"172.21.15.82:6827/1326866066","cluster_addr":"172.21.15.82:6829/1326866066","heartbeat_back_addr":"172.21.15.82:6833/1326866066","heartbeat_front_addr":"172.21.15.82:6831/1326866066","state":["exists","up"]},{"osd":10,"uuid":"077d6b20-a049-43e8-bdab-9683e568ff7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6825","nonce":667256862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6827","nonce":667256862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6831","nonce":667256862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":667256862},{"type":"v1","addr":"172.21.15.103:6829","nonce":667256862}]},"public_addr":"172.21.15.103:6825/667256862","cluster_addr":"172.21.15.103:6827/667256862","heartbeat_back_addr":"172.21.15.103:6831/667256862","heartbeat_front_addr":"172.21.15.103:6829/667256862","state":["exists","up"]},{"osd":11,"uuid":"0f20b235-215a-43d5-af49-13634a770b8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6825","nonce":3826867745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6827","nonce":3826867745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6831","nonce":3826867745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3826867745},{"type":"v1","addr":"172.21.15.184:6829","nonce":3826867745}]},"public_addr":"172.21.15.184:6825/3826867745","cluster_addr":"172.21.15.184:6827/3826867745","heartbeat_back_addr":"172.21.15.184:6831/3826867745","heartbeat_front_addr":"172.21.15.184:6829/3826867745","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:27:57.529444+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:21.570076+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:28:43.989753+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:16.433520+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:29:41.382711+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:05.450957+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:30:39.144168+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:04.017566+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:31:28.283575+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:02.141162+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:27.856195+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-06-06T02:32:52.108382+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1235186567":"2024-06-07T02:25:14.582200+0000","172.21.15.82:6801/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1616509269":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/498850809":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6801/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/3563640747":"2024-06-07T02:24:44.429691+0000","172.21.15.82:6800/1579417717":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/4084733545":"2024-06-07T02:25:14.582200+0000","172.21.15.82:0/1869865938":"2024-06-07T02:24:44.429691+0000","172.21.15.82:0/370056535":"2024-06-07T02:24:44.429691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.386+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 msgr2=0x7fcf7c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.386+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 0x7fcf7c0b4d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf9810a710 tx=0x7fcf80005f90 comp rx=0 tx=0).stop 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.386+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 msgr2=0x7fcf981a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.386+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009230 tx=0x7fcf88004040 comp rx=0 tx=0).stop 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 shutdown_connections 2024-06-06T02:47:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fcf7c0b27f0 0x7fcf7c0b4d00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf98110940 0x7fcf981a8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf9810fff0 0x7fcf981a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 --2- 172.21.15.82:0/2508725234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf9810b6c0 0x7fcf981a4340 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 >> 172.21.15.82:0/2508725234 conn(0x7fcf9806fee0 msgr2=0x7fcf980702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 shutdown_connections 2024-06-06T02:47:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:51.387+0000 7fcf9ea00640 1 -- 172.21.15.82:0/2508725234 wait complete. 2024-06-06T02:47:52.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:51 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2508725234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:47:52.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:51 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2508725234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:47:52.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:51 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2508725234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-06T02:47:52.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs fail cephfs 2024-06-06T02:47:52.659 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:53.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:52 smithi082 ceph-mon[31579]: pgmap v748: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:53.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:52 smithi103 ceph-mon[36349]: pgmap v748: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:53.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:52 smithi184 ceph-mon[36922]: pgmap v748: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-06-06T02:47:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 -- 172.21.15.82:0/1228326078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 msgr2=0x7fddec105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 --2- 172.21.15.82:0/1228326078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec105340 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009960 tx=0x7fdddc02a460 comp rx=0 tx=0).stop 2024-06-06T02:47:54.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:54 smithi082 ceph-mon[31579]: pgmap v749: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 -- 172.21.15.82:0/1228326078 shutdown_connections 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 --2- 172.21.15.82:0/1228326078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 --2- 172.21.15.82:0/1228326078 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 --2- 172.21.15.82:0/1228326078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec105340 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 -- 172.21.15.82:0/1228326078 >> 172.21.15.82:0/1228326078 conn(0x7fddec100990 msgr2=0x7fddec102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 -- 172.21.15.82:0/1228326078 shutdown_connections 2024-06-06T02:47:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.963+0000 7fddf0a00640 1 -- 172.21.15.82:0/1228326078 wait complete. 2024-06-06T02:47:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.964+0000 7fddf0a00640 1 Processor -- start 2024-06-06T02:47:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.964+0000 7fddf0a00640 1 -- start start 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec1a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec1a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fddec114ec0 con 0x7fddec104f30 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fddec114d40 con 0x7fddec109860 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddf0a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7fddec115040 con 0x7fddec10a1b0 2024-06-06T02:47:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.965+0000 7fddea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec1a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fddeb200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fddea800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec1a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57128/0 (socket says 172.21.15.82:57128) 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec1a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fddea800640 1 -- 172.21.15.82:0/2897550308 learned_addr learned my addr 172.21.15.82:0/2897550308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 -- 172.21.15.82:0/2897550308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 msgr2=0x7fddec19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 -- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 msgr2=0x7fddec1a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec1a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 -- 172.21.15.82:0/2897550308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddec19bf60 con 0x7fddec109860 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fddeb200640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.966+0000 7fdde9e00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec1a1b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fddec06bce0 tx=0x7fddd400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.967+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd400cd00 con 0x7fddec109860 2024-06-06T02:47:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.967+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddd40108e0 con 0x7fddec109860 2024-06-06T02:47:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.967+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddec19c190 con 0x7fddec109860 2024-06-06T02:47:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.967+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4018840 con 0x7fddec109860 2024-06-06T02:47:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.967+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddec1a8450 con 0x7fddec109860 2024-06-06T02:47:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.968+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddec1063e0 con 0x7fddec109860 2024-06-06T02:47:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.971+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fddd4010430 con 0x7fddec109860 2024-06-06T02:47:54.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.972+0000 7fdde3400640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 0x7fddd00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:54.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.972+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8240+0+0 (secure 0 0 0) 0x7fddd40e2aa0 con 0x7fddec109860 2024-06-06T02:47:54.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.972+0000 7fddea800640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 0x7fddd00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:54.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.973+0000 7fddea800640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 0x7fddd00b4d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdddc005ec0 tx=0x7fdddc005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:54.974+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddd40aa130 con 0x7fddec109860 2024-06-06T02:47:55.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:54 smithi103 ceph-mon[36349]: pgmap v749: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-06T02:47:55.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:54 smithi184 ceph-mon[36922]: pgmap v749: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 597 B/s wr, 7 op/s 2024-06-06T02:47:55.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.225+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fddec105340 con 0x7fddec109860 2024-06-06T02:47:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.236+0000 7fdde3400640 1 -- 172.21.15.82:0/2897550308 <== mon.2 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fddec105340 con 0x7fddec109860 2024-06-06T02:47:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-06T02:47:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.240+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 msgr2=0x7fddd00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.240+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 0x7fddd00b4d00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdddc005ec0 tx=0x7fdddc005040 comp rx=0 tx=0).stop 2024-06-06T02:47:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.240+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 msgr2=0x7fddec1a1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.240+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec1a1b30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fddec06bce0 tx=0x7fddd400ee50 comp rx=0 tx=0).stop 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.240+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 shutdown_connections 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7fddd00b27f0 0x7fddd00b4d00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddec10a1b0 0x7fddec19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddec109860 0x7fddec1a1b30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 --2- 172.21.15.82:0/2897550308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddec104f30 0x7fddec1a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 >> 172.21.15.82:0/2897550308 conn(0x7fddec100990 msgr2=0x7fddec101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 shutdown_connections 2024-06-06T02:47:55.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:55.241+0000 7fddf0a00640 1 -- 172.21.15.82:0/2897550308 wait complete. 2024-06-06T02:47:55.507 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a[31575]: 2024-06-06T02:47:55.227+0000 7ffbe5a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T02:47:55.618 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.618 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.618 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mds[66200]: -- 172.21.15.103:0/2186651491 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea9ec21c20 con 0x55eaa2dd3600 2024-06-06T02:47:55.618 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: starting mds.b at 2024-06-06T02:47:55.648 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.648 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.648 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mds[67127]: -- 172.21.15.184:0/3528521912 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641c3d1f860 con 0x5641c7ed1600 2024-06-06T02:47:55.648 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: starting mds.f at 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mds[67440]: -- 172.21.15.184:0/1985292539 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605d80e1860 con 0x5605dc293600 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: starting mds.c at 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mds[67744]: -- 172.21.15.184:0/3271020816 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565129cfb860 con 0x56512dead180 2024-06-06T02:47:55.649 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: starting mds.i at 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mds[76485]: -- 172.21.15.82:0/3649774716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a1e075c20 con 0x560a22227600 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: starting mds.a at 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/2897550308' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T02:47:55.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mon[31579]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: ignoring --setuser ceph since I am not root 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: ignoring --setgroup ceph since I am not root 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-mds[76075]: -- 172.21.15.82:0/743030449 <== mon.2 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc1a87f860 con 0x55cc1ea31600 2024-06-06T02:47:55.873 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:47:55 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: starting mds.g at 2024-06-06T02:47:56.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-06-06T02:47:56.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/2897550308' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T02:47:56.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:55 smithi103 ceph-mon[36349]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/2897550308' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: osdmap e81: 12 total, 12 up, 12 in 2024-06-06T02:47:56.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:55 smithi184 ceph-mon[36922]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-06-06T02:47:56.560 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:47:57.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: pgmap v750: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:57.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.103:6838/2257488435,v1:172.21.15.103:6839/2257488435] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6835/677906060,v1:172.21.15.184:6838/677906060] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6834/4031548667,v1:172.21.15.184:6837/4031548667] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.184:6836/673288807,v1:172.21.15.184:6839/673288807] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6838/333293828,v1:172.21.15.82:6839/333293828] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: mds.? [v2:172.21.15.82:6840/2756796209,v1:172.21.15.82:6841/2756796209] up:boot 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:47:57.047 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:47:57.048 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:56 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: pgmap v750: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.103:6838/2257488435,v1:172.21.15.103:6839/2257488435] up:boot 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6835/677906060,v1:172.21.15.184:6838/677906060] up:boot 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6834/4031548667,v1:172.21.15.184:6837/4031548667] up:boot 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.184:6836/673288807,v1:172.21.15.184:6839/673288807] up:boot 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6838/333293828,v1:172.21.15.82:6839/333293828] up:boot 2024-06-06T02:47:57.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: mds.? [v2:172.21.15.82:6840/2756796209,v1:172.21.15.82:6841/2756796209] up:boot 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:47:57.119 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:56 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: pgmap v750: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 6 op/s 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.103:6838/2257488435,v1:172.21.15.103:6839/2257488435] up:boot 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6835/677906060,v1:172.21.15.184:6838/677906060] up:boot 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6834/4031548667,v1:172.21.15.184:6837/4031548667] up:boot 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.184:6836/673288807,v1:172.21.15.184:6839/673288807] up:boot 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6838/333293828,v1:172.21.15.82:6839/333293828] up:boot 2024-06-06T02:47:57.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: mds.? [v2:172.21.15.82:6840/2756796209,v1:172.21.15.82:6841/2756796209] up:boot 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-06T02:47:57.149 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:56 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-06T02:47:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 -- 172.21.15.82:0/1142790478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf4109310 msgr2=0x7f9bf4109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 --2- 172.21.15.82:0/1142790478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf4109310 0x7f9bf4109720 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009960 tx=0x7f9bdc02a460 comp rx=0 tx=0).stop 2024-06-06T02:47:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 -- 172.21.15.82:0/1142790478 shutdown_connections 2024-06-06T02:47:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 --2- 172.21.15.82:0/1142790478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf410e590 0x7f9bf4115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 --2- 172.21.15.82:0/1142790478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf410e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:58.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 --2- 172.21.15.82:0/1142790478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf4109310 0x7f9bf4109720 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:58.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 -- 172.21.15.82:0/1142790478 >> 172.21.15.82:0/1142790478 conn(0x7f9bf4078a80 msgr2=0x7f9bf4107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:58.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 -- 172.21.15.82:0/1142790478 shutdown_connections 2024-06-06T02:47:58.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.878+0000 7f9bf9400640 1 -- 172.21.15.82:0/1142790478 wait complete. 2024-06-06T02:47:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.879+0000 7f9bf9400640 1 Processor -- start 2024-06-06T02:47:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.879+0000 7f9bf9400640 1 -- start start 2024-06-06T02:47:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf4109310 0x7f9bf419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf41a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:58.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 0x7f9bf41a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf41192b0 con 0x7f9bf410e590 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4119130 con 0x7f9bf4109310 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf9400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4119430 con 0x7f9bf410dc40 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 0x7f9bf41a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf4109310 0x7f9bf419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9beb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf41a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf8a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 0x7f9bf41a4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57182/0 (socket says 172.21.15.82:57182) 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.880+0000 7f9bf8a00640 1 -- 172.21.15.82:0/3105800428 learned_addr learned my addr 172.21.15.82:0/3105800428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 -- 172.21.15.82:0/3105800428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf4109310 msgr2=0x7f9bf419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf4109310 0x7f9bf419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 -- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 msgr2=0x7f9bf41a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:58.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 0x7f9bf41a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 -- 172.21.15.82:0/3105800428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf41a4bc0 con 0x7f9bf410dc40 2024-06-06T02:47:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9beb400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf41a02b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9be400e9c0 tx=0x7f9be400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be400cd80 con 0x7f9bf410dc40 2024-06-06T02:47:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf41a4eb0 con 0x7f9bf410dc40 2024-06-06T02:47:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9be40035f0 con 0x7f9bf410dc40 2024-06-06T02:47:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4010690 con 0x7f9bf410dc40 2024-06-06T02:47:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.881+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41ac830 con 0x7f9bf410dc40 2024-06-06T02:47:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.882+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf410a7c0 con 0x7f9bf410dc40 2024-06-06T02:47:58.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.885+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9be40037a0 con 0x7f9bf410dc40 2024-06-06T02:47:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.886+0000 7f9bf1600640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 0x7f9bd40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:47:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.887+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8498+0+0 (secure 0 0 0) 0x7f9be40e2670 con 0x7f9bf410dc40 2024-06-06T02:47:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.887+0000 7f9bf3e00640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 0x7f9bd40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:47:58.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.887+0000 7f9bf3e00640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 0x7f9bd40b4d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:47:58.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:58.888+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9be40aa2b0 con 0x7f9bf410dc40 2024-06-06T02:47:59.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:58 smithi103 ceph-mon[36349]: pgmap v752: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-06T02:47:59.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:58 smithi082 ceph-mon[31579]: pgmap v752: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-06T02:47:59.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.135+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9bf4111550 con 0x7f9bf410dc40 2024-06-06T02:47:59.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:58 smithi184 ceph-mon[36922]: pgmap v752: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-06-06T02:47:59.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.725+0000 7f9bf1600640 1 -- 172.21.15.82:0/3105800428 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f9be40b22a0 con 0x7f9bf410dc40 2024-06-06T02:47:59.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.728+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 msgr2=0x7f9bd40b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.728+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 0x7f9bd40b4d00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000c00 tx=0x7f9bdc005d50 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.728+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 msgr2=0x7f9bf41a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.728+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf41a02b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9be400e9c0 tx=0x7f9be400ee80 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 shutdown_connections 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bf410e590 0x7f9bf41a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f9bd40b27f0 0x7f9bd40b4d00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9bf410dc40 0x7f9bf41a02b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 --2- 172.21.15.82:0/3105800428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9bf4109310 0x7f9bf419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 >> 172.21.15.82:0/3105800428 conn(0x7f9bf4078a80 msgr2=0x7f9bf4079190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 shutdown_connections 2024-06-06T02:47:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:47:59.729+0000 7f9bf9400640 1 -- 172.21.15.82:0/3105800428 wait complete. 2024-06-06T02:47:59.965 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:59 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3105800428' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:47:59.965 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:47:59 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:48:00.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:59 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3105800428' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:48:00.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:47:59 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:48:00.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:59 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3105800428' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:48:00.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:47:59 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-06T02:48:00.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: pgmap v753: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: Cluster is now healthy 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:48:00.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:00 smithi082 ceph-mon[31579]: fsmap 12 up:standby 2024-06-06T02:48:01.040 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: pgmap v753: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: Cluster is now healthy 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:48:01.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:00 smithi103 ceph-mon[36349]: fsmap 12 up:standby 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: pgmap v753: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: Cluster is now healthy 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-06T02:48:01.139 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:00 smithi184 ceph-mon[36922]: fsmap 12 up:standby 2024-06-06T02:48:03.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:02 smithi082 ceph-mon[31579]: pgmap v754: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-06-06T02:48:03.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:02 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:48:03.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:02 smithi103 ceph-mon[36349]: pgmap v754: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-06-06T02:48:03.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:02 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:48:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:02 smithi184 ceph-mon[36922]: pgmap v754: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3 op/s 2024-06-06T02:48:03.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:02 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-06T02:48:03.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 -- 172.21.15.82:0/3419314404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178102aa0 msgr2=0x7f3178102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:03.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 --2- 172.21.15.82:0/3419314404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178102aa0 0x7f3178102eb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3168009900 tx=0x7f316802a3f0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 -- 172.21.15.82:0/3419314404 shutdown_connections 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 --2- 172.21.15.82:0/3419314404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f31781033f0 0x7f317810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 --2- 172.21.15.82:0/3419314404 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178102aa0 0x7f3178102eb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 --2- 172.21.15.82:0/3419314404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3178108ad0 0x7f3178108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 -- 172.21.15.82:0/3419314404 >> 172.21.15.82:0/3419314404 conn(0x7f31780fe790 msgr2=0x7f3178100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 -- 172.21.15.82:0/3419314404 shutdown_connections 2024-06-06T02:48:03.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.249+0000 7f317f200640 1 -- 172.21.15.82:0/3419314404 wait complete. 2024-06-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.251+0000 7f317f200640 1 Processor -- start 2024-06-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.251+0000 7f317f200640 1 -- start start 2024-06-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 0x7f31781a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:03.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178108ad0 0x7f317819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3178112ce0 con 0x7f3178108ad0 2024-06-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3178112b60 con 0x7f31781033f0 2024-06-06T02:48:03.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317f200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f3178112e60 con 0x7f3178102aa0 2024-06-06T02:48:03.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:03.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 0x7f31781a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:03.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.82:55438/0 (socket says 172.21.15.82:55438) 2024-06-06T02:48:03.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317d400640 1 -- 172.21.15.82:0/4028025274 learned_addr learned my addr 172.21.15.82:0/4028025274 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.252+0000 7f317e800640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178108ad0 0x7f317819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 -- 172.21.15.82:0/4028025274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 msgr2=0x7f31781a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 -- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178108ad0 msgr2=0x7f317819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178108ad0 0x7f317819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 -- 172.21.15.82:0/4028025274 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317819bed0 con 0x7f3178102aa0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317d400640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f317de00640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 0x7f31781a1650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e9c0 tx=0x7f316c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.253+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c00ccc0 con 0x7f3178102aa0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.254+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c0035f0 con 0x7f3178102aa0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.254+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c00ce60 con 0x7f3178102aa0 2024-06-06T02:48:03.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.254+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317819c1c0 con 0x7f3178102aa0 2024-06-06T02:48:03.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.254+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31781a8450 con 0x7f3178102aa0 2024-06-06T02:48:03.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.255+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3178102eb0 con 0x7f3178102aa0 2024-06-06T02:48:03.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.260+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f316c004000 con 0x7f3178102aa0 2024-06-06T02:48:03.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.262+0000 7f3172a00640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 0x7f31600b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:03.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.262+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8498+0+0 (secure 0 0 0) 0x7f316c0e2830 con 0x7f3178102aa0 2024-06-06T02:48:03.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.262+0000 7f317d400640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 0x7f31600b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:03.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.262+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f316c111e90 con 0x7f3178102aa0 2024-06-06T02:48:03.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.263+0000 7f317d400640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 0x7f31600b4d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f317810eb30 tx=0x7f31680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:48:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.471+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f317819cd40 con 0x7f3178102aa0 2024-06-06T02:48:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.729+0000 7f3172a00640 1 -- 172.21.15.82:0/4028025274 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7f316c0aa3e0 con 0x7f3178102aa0 2024-06-06T02:48:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-06-06T02:48:03.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:03 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/4028025274' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:03.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:03 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:03.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:48:03.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:48:03.731 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:03 smithi082 ceph-mon[31579]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:48:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 msgr2=0x7f31600b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 0x7f31600b4d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f317810eb30 tx=0x7f31680058d0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 msgr2=0x7f31781a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 0x7f31781a1650 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e9c0 tx=0x7f316c00ee80 comp rx=0 tx=0).stop 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 shutdown_connections 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3178108ad0 0x7f317819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31781033f0 0x7f31781a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f31600b2870 0x7f31600b4d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.734+0000 7f317f200640 1 --2- 172.21.15.82:0/4028025274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3178102aa0 0x7f31781a1650 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.735+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 >> 172.21.15.82:0/4028025274 conn(0x7f31780fe790 msgr2=0x7f317810f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:48:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.735+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 shutdown_connections 2024-06-06T02:48:03.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:03.735+0000 7f317f200640 1 -- 172.21.15.82:0/4028025274 wait complete. 2024-06-06T02:48:04.019 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:03 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/4028025274' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:04.019 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:03 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:04.019 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:48:04.019 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:48:04.019 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:03 smithi103 ceph-mon[36349]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:48:04.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:03 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/4028025274' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:04.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:03 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:04.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-06T02:48:04.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-06T02:48:04.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:03 smithi184 ceph-mon[36922]: from='mgr.14150 172.21.15.82:0/2354592941' entity='mgr.x' 2024-06-06T02:48:04.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8 shell --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-06T02:48:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:04 smithi082 ceph-mon[31579]: pgmap v755: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 2 op/s 2024-06-06T02:48:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:04 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:04.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:04 smithi082 ceph-mon[31579]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T02:48:05.031 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/mon.a/config 2024-06-06T02:48:05.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:04 smithi103 ceph-mon[36349]: pgmap v755: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 2 op/s 2024-06-06T02:48:05.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:04 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:05.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:04 smithi103 ceph-mon[36349]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T02:48:05.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:04 smithi184 ceph-mon[36922]: pgmap v755: 97 pgs: 97 active+clean; 21 MiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s rd, 2 op/s 2024-06-06T02:48:05.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:04 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:05.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:04 smithi184 ceph-mon[36922]: osdmap e82: 12 total, 12 up, 12 in 2024-06-06T02:48:07.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:06 smithi082 ceph-mon[31579]: pgmap v757: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:07.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:06 smithi103 ceph-mon[36349]: pgmap v757: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:07.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:06 smithi184 ceph-mon[36922]: pgmap v757: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:07.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 -- 172.21.15.82:0/3960762284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140104510 msgr2=0x7f814010ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 --2- 172.21.15.82:0/3960762284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140104510 0x7f814010ca60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8128009ca0 tx=0x7f812802a8c0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 -- 172.21.15.82:0/3960762284 shutdown_connections 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 --2- 172.21.15.82:0/3960762284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 0x7f814010f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 --2- 172.21.15.82:0/3960762284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140104510 0x7f814010ca60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 --2- 172.21.15.82:0/3960762284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140103bc0 0x7f8140103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 -- 172.21.15.82:0/3960762284 >> 172.21.15.82:0/3960762284 conn(0x7f8140078b00 msgr2=0x7f8140078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 -- 172.21.15.82:0/3960762284 shutdown_connections 2024-06-06T02:48:07.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.348+0000 7f8145400640 1 -- 172.21.15.82:0/3960762284 wait complete. 2024-06-06T02:48:07.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.349+0000 7f8145400640 1 Processor -- start 2024-06-06T02:48:07.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 -- start start 2024-06-06T02:48:07.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 0x7f81401996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:07.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 0x7f814019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8140112c80 con 0x7f8140103bc0 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8140112b00 con 0x7f814010d020 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.350+0000 7f8145400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 -- 0x7f8140112e00 con 0x7f8140104510 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 0x7f81401996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.82:50884/0 (socket says 172.21.15.82:50884) 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 -- 172.21.15.82:0/3163113991 learned_addr learned my addr 172.21.15.82:0/3163113991 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813fe00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 0x7f81401996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41494/0 (socket says 172.21.15.82:41494) 2024-06-06T02:48:07.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f8144a00640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 0x7f814019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 -- 172.21.15.82:0/3163113991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 msgr2=0x7f814019ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 0x7f814019ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 -- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 msgr2=0x7f81401996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 0x7f81401996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.351+0000 7f813f400640 1 -- 172.21.15.82:0/3163113991 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814019e510 con 0x7f8140104510 2024-06-06T02:48:07.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f813f400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f812802ade0 tx=0x7f81280316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128003b70 con 0x7f8140104510 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81280318e0 con 0x7f8140104510 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812802f950 con 0x7f8140104510 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814019e7a0 con 0x7f8140104510 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.352+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814019ec90 con 0x7f8140104510 2024-06-06T02:48:07.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.354+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8140103fd0 con 0x7f8140104510 2024-06-06T02:48:07.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.356+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8128004b40 con 0x7f8140104510 2024-06-06T02:48:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.358+0000 7f813cc00640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 0x7f81240b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-06T02:48:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.358+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7944+0+0 (secure 0 0 0) 0x7f8128103610 con 0x7f8140104510 2024-06-06T02:48:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.358+0000 7f813fe00640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 0x7f81240b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-06T02:48:07.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.359+0000 7f813fe00640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 0x7f81240b4d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8138009bd0 tx=0x7f8138005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-06T02:48:07.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.359+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f81280cb490 con 0x7f8140104510 2024-06-06T02:48:07.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.569+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f814019aa00 con 0x7f8140104510 2024-06-06T02:48:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.753+0000 7f813cc00640 1 -- 172.21.15.82:0/3163113991 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7f814019aa00 con 0x7f8140104510 2024-06-06T02:48:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-06-06T02:48:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.759+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 msgr2=0x7f81240b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.759+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 0x7f81240b4d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8138009bd0 tx=0x7f8138005f90 comp rx=0 tx=0).stop 2024-06-06T02:48:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.759+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 msgr2=0x7f8140199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-06T02:48:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.759+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f812802ade0 tx=0x7f81280316f0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 shutdown_connections 2024-06-06T02:48:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f814010d020 0x7f814019ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:6800/664220961,v1:172.21.15.82:6801/664220961] conn(0x7f81240b2870 0x7f81240b4d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8140104510 0x7f8140199c00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 --2- 172.21.15.82:0/3163113991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8140103bc0 0x7f81401996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-06T02:48:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.762+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 >> 172.21.15.82:0/3163113991 conn(0x7f8140078b00 msgr2=0x7f81400fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-06T02:48:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.764+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 shutdown_connections 2024-06-06T02:48:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-06-06T02:48:07.764+0000 7f8145400640 1 -- 172.21.15.82:0/3163113991 wait complete. 2024-06-06T02:48:08.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:07 smithi103 ceph-mon[36349]: from='client.? 172.21.15.82:0/3163113991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:07 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:07 smithi082 ceph-mon[31579]: from='client.? 172.21.15.82:0/3163113991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.121 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:07 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:07 smithi184 ceph-mon[36922]: from='client.? 172.21.15.82:0/3163113991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:07 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-06T02:48:08.662 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:48:08.747 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:48:08.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:48:08.812 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-06T02:48:08.812 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T02:48:08.863 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T02:48:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:08 smithi082 ceph-mon[31579]: pgmap v758: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:08 smithi082 ceph-mon[31579]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:08.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:08 smithi082 ceph-mon[31579]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T02:48:08.878 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-06T02:48:08.892 INFO:tasks.cephadm:Stopping all daemons... 2024-06-06T02:48:08.892 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-06T02:48:08.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a 2024-06-06T02:48:09.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:08 smithi103 ceph-mon[36349]: pgmap v758: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:09.117 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:08 smithi103 ceph-mon[36349]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:09.118 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:08 smithi103 ceph-mon[36349]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T02:48:09.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:08 smithi184 ceph-mon[36922]: pgmap v758: 65 pgs: 65 active+clean; 577 KiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-06T02:48:09.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:08 smithi184 ceph-mon[36922]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-06-06T02:48:09.148 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:08 smithi184 ceph-mon[36922]: osdmap e83: 12 total, 12 up, 12 in 2024-06-06T02:48:09.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:09 smithi082 systemd[1]: Stopping Ceph mon.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a[31575]: 2024-06-06T02:48:09.603+0000 7ffbec800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:09.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a[31575]: 2024-06-06T02:48:09.603+0000 7ffbec800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-06T02:48:09.872 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:09 smithi082 podman[105084]: 2024-06-06 02:48:09.677855655 +0000 UTC m=+0.362432933 container died 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.35.3) 2024-06-06T02:48:10.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:10 smithi082 podman[105084]: 2024-06-06 02:48:10.225201214 +0000 UTC m=+0.909778502 container cleanup 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-06-06T02:48:10.493 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:10 smithi082 bash[105084]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a 2024-06-06T02:48:10.871 INFO:journalctl@ceph.mon.a.smithi082.stdout:Jun 06 02:48:10 smithi082 podman[105098]: 2024-06-06 02:48:10.493190734 +0000 UTC m=+0.803736878 container remove 563b694cf93d473dc71623c1455437b3e5ed1a8633c080b38da07912b47ec08d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:48:10.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-06T02:48:11.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:11.082 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-06T02:48:11.082 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-06T02:48:11.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.b 2024-06-06T02:48:11.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:11 smithi103 systemd[1]: Stopping Ceph mon.b for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:11.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:11 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-b[36345]: 2024-06-06T02:48:11.468+0000 7f27efa71640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:11.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:11 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-b[36345]: 2024-06-06T02:48:11.468+0000 7f27efa71640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-06T02:48:11.868 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:11 smithi103 podman[70594]: 2024-06-06 02:48:11.674205067 +0000 UTC m=+0.330898154 container died 4c2c3bd7abfb2e319f96cb86340730aa2a949c36e5f7374b48d7cbbf7f8fce92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-06-06T02:48:12.367 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:12 smithi103 podman[70594]: 2024-06-06 02:48:12.079758462 +0000 UTC m=+0.736451542 container cleanup 4c2c3bd7abfb2e319f96cb86340730aa2a949c36e5f7374b48d7cbbf7f8fce92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-b, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux ) 2024-06-06T02:48:12.368 INFO:journalctl@ceph.mon.b.smithi103.stdout:Jun 06 02:48:12 smithi103 bash[70594]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-b 2024-06-06T02:48:12.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-06T02:48:12.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:12.551 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-06T02:48:12.551 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-06T02:48:12.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.c 2024-06-06T02:48:12.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:12 smithi184 systemd[1]: Stopping Ceph mon.c for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:13.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:12 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c[36918]: 2024-06-06T02:48:12.927+0000 7fee9af22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:13.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:12 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c[36918]: 2024-06-06T02:48:12.927+0000 7fee9af22640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-06T02:48:13.398 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:13 smithi184 podman[72379]: 2024-06-06 02:48:13.071343258 +0000 UTC m=+0.276821529 container died ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-06-06T02:48:13.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:13 smithi184 podman[72379]: 2024-06-06 02:48:13.604030398 +0000 UTC m=+0.809508662 container cleanup ca166eb3f8222be9c49aedc43aa0cbc0ed9dd8d89bb7687b895e0ff5189a71eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS) 2024-06-06T02:48:13.898 INFO:journalctl@ceph.mon.c.smithi184.stdout:Jun 06 02:48:13 smithi184 bash[72379]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mon-c 2024-06-06T02:48:14.120 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-06T02:48:14.161 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:14.161 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-06T02:48:14.162 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-06T02:48:14.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x 2024-06-06T02:48:14.621 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:14 smithi082 systemd[1]: Stopping Ceph mgr.x for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:15.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:14 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:48:14.751+0000 7ff1c8e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:15.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:14 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x[31812]: 2024-06-06T02:48:14.751+0000 7ff1c8e00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-06T02:48:15.121 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:14 smithi082 podman[105215]: 2024-06-06 02:48:14.857163511 +0000 UTC m=+0.277091288 container died a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_CLEAN=True) 2024-06-06T02:48:15.607 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:15 smithi082 podman[105215]: 2024-06-06 02:48:15.371666636 +0000 UTC m=+0.791594450 container cleanup a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0) 2024-06-06T02:48:15.608 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:15 smithi082 bash[105215]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x 2024-06-06T02:48:15.871 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Jun 06 02:48:15 smithi082 podman[105229]: 2024-06-06 02:48:15.60673669 +0000 UTC m=+0.726247186 container remove a95cc51a49b8571f5191fc22b2d248fd256d1dfd898bab84ac82a3ca907ae49e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3c55257c8d03a5c0d4a127fb6c81d2a35531c5d8, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2) 2024-06-06T02:48:16.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-06T02:48:16.210 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:16.213 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-06T02:48:16.213 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-06T02:48:16.213 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.y 2024-06-06T02:48:16.547 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:16 smithi103 systemd[1]: Stopping Ceph mgr.y for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:16.867 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:16 smithi103 podman[70718]: 2024-06-06 02:48:16.54797408 +0000 UTC m=+0.132136612 container died 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-06T02:48:17.333 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:16 smithi103 podman[70718]: 2024-06-06 02:48:16.912425696 +0000 UTC m=+0.496588300 container cleanup 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-06T02:48:17.333 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:16 smithi103 bash[70718]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y 2024-06-06T02:48:17.333 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:17 smithi103 podman[70730]: 2024-06-06 02:48:17.131422 +0000 UTC m=+0.579309529 container remove 4ac01346e75345d2d03c003f8e4b86bb49eb2e5c9ba72c0cdab9ede974f60f81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:48:17.333 INFO:journalctl@ceph.mgr.y.smithi103.stdout:Jun 06 02:48:17 smithi103 systemd[1]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-06T02:48:17.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-06T02:48:17.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:17.383 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-06T02:48:17.383 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-06T02:48:17.384 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.z 2024-06-06T02:48:17.720 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:48:17 smithi184 systemd[1]: Stopping Ceph mgr.z for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:18.027 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:48:17 smithi184 podman[72500]: 2024-06-06 02:48:17.72117639 +0000 UTC m=+0.137262727 container died 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:48:18.398 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:48:18 smithi184 podman[72500]: 2024-06-06 02:48:18.135015153 +0000 UTC m=+0.551101480 container cleanup 78403e9a8bb9dddfd27dce8ad0f0cd330a8aa4a5bde901bab313a3d3ecf624c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-06-06T02:48:18.398 INFO:journalctl@ceph.mgr.z.smithi184.stdout:Jun 06 02:48:18 smithi184 bash[72500]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mgr-z 2024-06-06T02:48:18.646 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-06T02:48:18.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:18.680 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-06T02:48:18.681 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-06T02:48:18.681 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.0 2024-06-06T02:48:19.120 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:18 smithi082 systemd[1]: Stopping Ceph osd.0 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:19.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:19 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0[49764]: 2024-06-06T02:48:19.249+0000 7fc417a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:19.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:19 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0[49764]: 2024-06-06T02:48:19.249+0000 7fc417a00640 -1 osd.0 83 *** Got signal Terminated *** 2024-06-06T02:48:19.621 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:19 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0[49764]: 2024-06-06T02:48:19.249+0000 7fc417a00640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:48:25.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:25 smithi082 podman[105334]: 2024-06-06 02:48:25.132871759 +0000 UTC m=+6.029764514 container died bdf069ea824da5e4a5e4b54ff8cfc7253248e95650064edfd65b666ff16d771e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.35.3, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-06T02:48:25.737 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:25 smithi082 podman[105334]: 2024-06-06 02:48:25.70150246 +0000 UTC m=+6.598395211 container cleanup bdf069ea824da5e4a5e4b54ff8cfc7253248e95650064edfd65b666ff16d771e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:48:25.737 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:25 smithi082 bash[105334]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0 2024-06-06T02:48:26.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:25 smithi082 podman[105352]: 2024-06-06 02:48:25.994822737 +0000 UTC m=+0.837493766 container remove bdf069ea824da5e4a5e4b54ff8cfc7253248e95650064edfd65b666ff16d771e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3) 2024-06-06T02:48:27.081 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:26 smithi082 podman[105438]: 2024-06-06 02:48:26.727451279 +0000 UTC m=+0.035622943 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:48:27.082 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:26 smithi082 podman[105438]: 2024-06-06 02:48:26.88816598 +0000 UTC m=+0.196337687 container create 67103c70978db559a550f81a05989dfb04552336aac48e2674dc5279bf05620b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-06T02:48:27.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:27 smithi082 podman[105438]: 2024-06-06 02:48:27.243645253 +0000 UTC m=+0.551816964 container init 67103c70978db559a550f81a05989dfb04552336aac48e2674dc5279bf05620b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-06T02:48:27.371 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:27 smithi082 podman[105438]: 2024-06-06 02:48:27.25580216 +0000 UTC m=+0.563973832 container start 67103c70978db559a550f81a05989dfb04552336aac48e2674dc5279bf05620b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, CEPH_POINT_RELEASE=) 2024-06-06T02:48:27.749 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:27 smithi082 podman[105438]: 2024-06-06 02:48:27.37379995 +0000 UTC m=+0.681971616 container attach 67103c70978db559a550f81a05989dfb04552336aac48e2674dc5279bf05620b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD) 2024-06-06T02:48:28.121 INFO:journalctl@ceph.osd.0.smithi082.stdout:Jun 06 02:48:27 smithi082 podman[105438]: 2024-06-06 02:48:27.766479185 +0000 UTC m=+1.074650896 container died 67103c70978db559a550f81a05989dfb04552336aac48e2674dc5279bf05620b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-06-06T02:48:28.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-06T02:48:28.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:28.666 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-06T02:48:28.666 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-06T02:48:28.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.1 2024-06-06T02:48:28.984 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:28 smithi103 systemd[1]: Stopping Ceph osd.1 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:29.368 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1[41015]: 2024-06-06T02:48:28.984+0000 7f4b8838a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:29.368 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1[41015]: 2024-06-06T02:48:28.984+0000 7f4b8838a640 -1 osd.1 83 *** Got signal Terminated *** 2024-06-06T02:48:29.368 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1[41015]: 2024-06-06T02:48:28.984+0000 7f4b8838a640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:48:34.744 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:34 smithi103 podman[70843]: 2024-06-06 02:48:34.441995501 +0000 UTC m=+5.576293216 container died c9072f90d1cff67f5748dbd05d6403215842fe006e629d7db9aa8a5515771116 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-06-06T02:48:35.069 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:34 smithi103 podman[70843]: 2024-06-06 02:48:34.843824905 +0000 UTC m=+5.978122621 container cleanup c9072f90d1cff67f5748dbd05d6403215842fe006e629d7db9aa8a5515771116 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD) 2024-06-06T02:48:35.069 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:34 smithi103 bash[70843]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1 2024-06-06T02:48:35.367 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70858]: 2024-06-06 02:48:35.070032925 +0000 UTC m=+0.627909211 container remove c9072f90d1cff67f5748dbd05d6403215842fe006e629d7db9aa8a5515771116 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528) 2024-06-06T02:48:35.723 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.379389281 +0000 UTC m=+0.107979034 container create 5d8e1a0d374b8c20e45eb433954f8f261694af438a9cf97a0b05417562211a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3) 2024-06-06T02:48:35.723 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.288419788 +0000 UTC m=+0.017009540 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:48:35.724 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.615560311 +0000 UTC m=+0.344150047 container init 5d8e1a0d374b8c20e45eb433954f8f261694af438a9cf97a0b05417562211a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:48:35.724 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.618536703 +0000 UTC m=+0.347126439 container start 5d8e1a0d374b8c20e45eb433954f8f261694af438a9cf97a0b05417562211a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-06-06T02:48:35.724 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.724099707 +0000 UTC m=+0.452689461 container attach 5d8e1a0d374b8c20e45eb433954f8f261694af438a9cf97a0b05417562211a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, org.label-schema.license=GPLv2) 2024-06-06T02:48:36.118 INFO:journalctl@ceph.osd.1.smithi103.stdout:Jun 06 02:48:35 smithi103 podman[70950]: 2024-06-06 02:48:35.957491467 +0000 UTC m=+0.686081201 container died 5d8e1a0d374b8c20e45eb433954f8f261694af438a9cf97a0b05417562211a14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-06-06T02:48:36.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-06T02:48:36.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:36.656 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-06T02:48:36.656 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-06T02:48:36.656 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.2 2024-06-06T02:48:36.980 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:36 smithi184 systemd[1]: Stopping Ceph osd.2 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:37.245 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2[42011]: 2024-06-06T02:48:36.979+0000 7f5ce38c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:37.245 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2[42011]: 2024-06-06T02:48:36.979+0000 7f5ce38c2640 -1 osd.2 83 *** Got signal Terminated *** 2024-06-06T02:48:37.245 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2[42011]: 2024-06-06T02:48:36.979+0000 7f5ce38c2640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:48:42.857 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:42 smithi184 podman[72625]: 2024-06-06 02:48:42.553405948 +0000 UTC m=+5.705387333 container died ae5207db7ed83163b0728341c7e4b279a2d09e84bc5500daaab2d4777243eb79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3) 2024-06-06T02:48:43.148 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:42 smithi184 podman[72625]: 2024-06-06 02:48:42.955824011 +0000 UTC m=+6.107805392 container cleanup ae5207db7ed83163b0728341c7e4b279a2d09e84bc5500daaab2d4777243eb79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2, ceph=True, io.buildah.version=1.35.3, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:48:43.148 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:42 smithi184 bash[72625]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2 2024-06-06T02:48:43.574 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72654]: 2024-06-06 02:48:43.224176731 +0000 UTC m=+0.672468068 container remove ae5207db7ed83163b0728341c7e4b279a2d09e84bc5500daaab2d4777243eb79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528) 2024-06-06T02:48:43.898 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72742]: 2024-06-06 02:48:43.477648141 +0000 UTC m=+0.017394604 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:48:43.899 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72742]: 2024-06-06 02:48:43.608641111 +0000 UTC m=+0.148387562 container create 1412bd55096f32b626bda099d55acd5c573eab775602fe48bfaecf1bc3148ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-06T02:48:43.899 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72742]: 2024-06-06 02:48:43.819726238 +0000 UTC m=+0.359472687 container init 1412bd55096f32b626bda099d55acd5c573eab775602fe48bfaecf1bc3148ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-06-06T02:48:43.899 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72742]: 2024-06-06 02:48:43.824051424 +0000 UTC m=+0.363797874 container start 1412bd55096f32b626bda099d55acd5c573eab775602fe48bfaecf1bc3148ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS) 2024-06-06T02:48:44.173 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:43 smithi184 podman[72742]: 2024-06-06 02:48:43.919739797 +0000 UTC m=+0.459486315 container attach 1412bd55096f32b626bda099d55acd5c573eab775602fe48bfaecf1bc3148ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528) 2024-06-06T02:48:44.539 INFO:journalctl@ceph.osd.2.smithi184.stdout:Jun 06 02:48:44 smithi184 podman[72742]: 2024-06-06 02:48:44.173952861 +0000 UTC m=+0.713699311 container died 1412bd55096f32b626bda099d55acd5c573eab775602fe48bfaecf1bc3148ea2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2) 2024-06-06T02:48:44.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-06T02:48:44.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:44.902 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-06T02:48:44.902 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-06T02:48:44.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.3 2024-06-06T02:48:45.371 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:45 smithi082 systemd[1]: Stopping Ceph osd.3 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:45.874 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:45 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3[56576]: 2024-06-06T02:48:45.538+0000 7f71a9400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:45.874 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:45 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3[56576]: 2024-06-06T02:48:45.538+0000 7f71a9400640 -1 osd.3 83 *** Got signal Terminated *** 2024-06-06T02:48:45.874 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:45 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3[56576]: 2024-06-06T02:48:45.538+0000 7f71a9400640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:48:51.697 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:51 smithi082 podman[105551]: 2024-06-06 02:48:51.374763273 +0000 UTC m=+5.997025708 container died 49d8d164c1e2e3e4356abfba3e7a12d753aba3c583a8a1dd30c2800084dc225a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, GIT_CLEAN=True, ceph=True) 2024-06-06T02:48:52.081 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:51 smithi082 podman[105551]: 2024-06-06 02:48:51.845901969 +0000 UTC m=+6.468164351 container cleanup 49d8d164c1e2e3e4356abfba3e7a12d753aba3c583a8a1dd30c2800084dc225a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=) 2024-06-06T02:48:52.081 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:51 smithi082 bash[105551]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3 2024-06-06T02:48:52.371 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:52 smithi082 podman[105569]: 2024-06-06 02:48:52.080414678 +0000 UTC m=+0.697440521 container remove 49d8d164c1e2e3e4356abfba3e7a12d753aba3c583a8a1dd30c2800084dc225a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-06T02:48:53.238 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:52 smithi082 podman[105654]: 2024-06-06 02:48:52.808456546 +0000 UTC m=+0.036852257 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:48:53.238 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:52 smithi082 podman[105654]: 2024-06-06 02:48:52.931715655 +0000 UTC m=+0.160111397 container create f639b63565f26640acb5bf03eba676484dd1a9d5e2aabe6a1e50d29abf8e2cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3) 2024-06-06T02:48:53.238 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:53 smithi082 podman[105654]: 2024-06-06 02:48:53.235773537 +0000 UTC m=+0.464169289 container init f639b63565f26640acb5bf03eba676484dd1a9d5e2aabe6a1e50d29abf8e2cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-06-06T02:48:53.542 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:53 smithi082 podman[105654]: 2024-06-06 02:48:53.246402617 +0000 UTC m=+0.474798334 container start f639b63565f26640acb5bf03eba676484dd1a9d5e2aabe6a1e50d29abf8e2cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.35.3) 2024-06-06T02:48:53.542 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:53 smithi082 podman[105654]: 2024-06-06 02:48:53.359566686 +0000 UTC m=+0.587962435 container attach f639b63565f26640acb5bf03eba676484dd1a9d5e2aabe6a1e50d29abf8e2cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0) 2024-06-06T02:48:53.871 INFO:journalctl@ceph.osd.3.smithi082.stdout:Jun 06 02:48:53 smithi082 podman[105654]: 2024-06-06 02:48:53.543247113 +0000 UTC m=+0.771642898 container died f639b63565f26640acb5bf03eba676484dd1a9d5e2aabe6a1e50d29abf8e2cdd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-06-06T02:48:54.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-06T02:48:54.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:48:54.404 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-06T02:48:54.405 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-06T02:48:54.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.4 2024-06-06T02:48:54.714 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:48:54 smithi103 systemd[1]: Stopping Ceph osd.4 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:48:55.117 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:48:54 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4[47502]: 2024-06-06T02:48:54.712+0000 7f9946451640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:48:55.118 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:48:54 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4[47502]: 2024-06-06T02:48:54.712+0000 7f9946451640 -1 osd.4 83 *** Got signal Terminated *** 2024-06-06T02:48:55.118 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:48:54 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4[47502]: 2024-06-06T02:48:54.712+0000 7f9946451640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:00.618 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:00 smithi103 podman[71063]: 2024-06-06 02:49:00.352113912 +0000 UTC m=+5.748299117 container died 3f8c7c59945e037292b352dfbca3b08e0ed85764360ed67c3fe13a1eff090eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T02:49:01.032 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:00 smithi103 podman[71063]: 2024-06-06 02:49:00.730633432 +0000 UTC m=+6.126818594 container cleanup 3f8c7c59945e037292b352dfbca3b08e0ed85764360ed67c3fe13a1eff090eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-06-06T02:49:01.032 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:00 smithi103 bash[71063]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4 2024-06-06T02:49:01.346 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71080]: 2024-06-06 02:49:01.032399749 +0000 UTC m=+0.674297021 container remove 3f8c7c59945e037292b352dfbca3b08e0ed85764360ed67c3fe13a1eff090eb3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:49:01.610 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.249647029 +0000 UTC m=+0.017178527 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:01.611 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.358527113 +0000 UTC m=+0.126058641 container create 94357265ea7904a46ca75facadd3c61d44cb4fa223b00a539a9523b7f16c9b2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:01.868 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.61122604 +0000 UTC m=+0.378757533 container init 94357265ea7904a46ca75facadd3c61d44cb4fa223b00a539a9523b7f16c9b2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-06T02:49:01.868 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.614586712 +0000 UTC m=+0.382118205 container start 94357265ea7904a46ca75facadd3c61d44cb4fa223b00a539a9523b7f16c9b2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:49:01.868 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.711272461 +0000 UTC m=+0.478803969 container attach 94357265ea7904a46ca75facadd3c61d44cb4fa223b00a539a9523b7f16c9b2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:01.868 INFO:journalctl@ceph.osd.4.smithi103.stdout:Jun 06 02:49:01 smithi103 podman[71171]: 2024-06-06 02:49:01.801991122 +0000 UTC m=+0.569522628 container died 94357265ea7904a46ca75facadd3c61d44cb4fa223b00a539a9523b7f16c9b2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528) 2024-06-06T02:49:02.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-06T02:49:02.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:02.467 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-06T02:49:02.467 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-06T02:49:02.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.5 2024-06-06T02:49:02.783 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:02 smithi184 systemd[1]: Stopping Ceph osd.5 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:03.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:02 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5[48491]: 2024-06-06T02:49:02.782+0000 7f9b6356b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:03.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:02 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5[48491]: 2024-06-06T02:49:02.782+0000 7f9b6356b640 -1 osd.5 83 *** Got signal Terminated *** 2024-06-06T02:49:03.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:02 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5[48491]: 2024-06-06T02:49:02.782+0000 7f9b6356b640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:08.554 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:08 smithi184 podman[72849]: 2024-06-06 02:49:08.286050748 +0000 UTC m=+5.624889992 container died 8fda6ff2a2dd6e3ccf437a1d5f0906a8ecc5fa0bab5061d40fa7c5ca9b56fc8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-06-06T02:49:08.898 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:08 smithi184 podman[72849]: 2024-06-06 02:49:08.717366617 +0000 UTC m=+6.056205865 container cleanup 8fda6ff2a2dd6e3ccf437a1d5f0906a8ecc5fa0bab5061d40fa7c5ca9b56fc8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-06-06T02:49:08.898 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:08 smithi184 bash[72849]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5 2024-06-06T02:49:09.379 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:08 smithi184 podman[72866]: 2024-06-06 02:49:08.944118844 +0000 UTC m=+0.658920679 container remove 8fda6ff2a2dd6e3ccf437a1d5f0906a8ecc5fa0bab5061d40fa7c5ca9b56fc8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-06-06T02:49:09.648 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.28261423 +0000 UTC m=+0.017089839 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:09.648 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.411754316 +0000 UTC m=+0.146229957 container create aa3e2954668d5f150b3d7003a0ca24157b1d64f740b025ed313bc607c0d4679a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-06T02:49:10.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.676786668 +0000 UTC m=+0.411262267 container init aa3e2954668d5f150b3d7003a0ca24157b1d64f740b025ed313bc607c0d4679a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:49:10.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.679974686 +0000 UTC m=+0.414450284 container start aa3e2954668d5f150b3d7003a0ca24157b1d64f740b025ed313bc607c0d4679a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:49:10.148 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.772733789 +0000 UTC m=+0.507209390 container attach aa3e2954668d5f150b3d7003a0ca24157b1d64f740b025ed313bc607c0d4679a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-06-06T02:49:10.149 INFO:journalctl@ceph.osd.5.smithi184.stdout:Jun 06 02:49:09 smithi184 podman[72955]: 2024-06-06 02:49:09.865874045 +0000 UTC m=+0.600349645 container died aa3e2954668d5f150b3d7003a0ca24157b1d64f740b025ed313bc607c0d4679a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS) 2024-06-06T02:49:10.505 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-06T02:49:10.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:10.543 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-06T02:49:10.543 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-06T02:49:10.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.6 2024-06-06T02:49:10.872 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:10 smithi082 systemd[1]: Stopping Ceph osd.6 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:11.371 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6[63093]: 2024-06-06T02:49:11.111+0000 7f3f03600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:11.372 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6[63093]: 2024-06-06T02:49:11.111+0000 7f3f03600640 -1 osd.6 83 *** Got signal Terminated *** 2024-06-06T02:49:11.372 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:11 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6[63093]: 2024-06-06T02:49:11.111+0000 7f3f03600640 -1 osd.6 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:17.305 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:16 smithi082 podman[105767]: 2024-06-06 02:49:16.931066776 +0000 UTC m=+5.938260268 container died bf08ca5b4afe7db205f0b560a321ae5dc83517669719b6a331074ca2da73a24b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T02:49:17.621 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:17 smithi082 podman[105767]: 2024-06-06 02:49:17.522117972 +0000 UTC m=+6.529311421 container cleanup bf08ca5b4afe7db205f0b560a321ae5dc83517669719b6a331074ca2da73a24b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, ceph=True) 2024-06-06T02:49:17.621 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:17 smithi082 bash[105767]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6 2024-06-06T02:49:18.121 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:17 smithi082 podman[105784]: 2024-06-06 02:49:17.773664748 +0000 UTC m=+0.829182176 container remove bf08ca5b4afe7db205f0b560a321ae5dc83517669719b6a331074ca2da73a24b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0) 2024-06-06T02:49:18.888 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:18 smithi082 podman[105872]: 2024-06-06 02:49:18.536666674 +0000 UTC m=+0.035796640 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:18.889 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:18 smithi082 podman[105872]: 2024-06-06 02:49:18.632586337 +0000 UTC m=+0.131716340 container create 586058965de430da813d87512bfb2528020248837ea335ee73d76da6dae19dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6-deactivate, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-06-06T02:49:18.889 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:18 smithi082 podman[105872]: 2024-06-06 02:49:18.887617003 +0000 UTC m=+0.386746988 container init 586058965de430da813d87512bfb2528020248837ea335ee73d76da6dae19dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:19.198 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:18 smithi082 podman[105872]: 2024-06-06 02:49:18.899439887 +0000 UTC m=+0.398569870 container start 586058965de430da813d87512bfb2528020248837ea335ee73d76da6dae19dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:49:19.198 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:18 smithi082 podman[105872]: 2024-06-06 02:49:18.995605629 +0000 UTC m=+0.494735636 container attach 586058965de430da813d87512bfb2528020248837ea335ee73d76da6dae19dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True) 2024-06-06T02:49:19.553 INFO:journalctl@ceph.osd.6.smithi082.stdout:Jun 06 02:49:19 smithi082 podman[105872]: 2024-06-06 02:49:19.198692016 +0000 UTC m=+0.697822062 container died 586058965de430da813d87512bfb2528020248837ea335ee73d76da6dae19dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3) 2024-06-06T02:49:19.945 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-06T02:49:20.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:20.050 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-06T02:49:20.051 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-06T02:49:20.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.7 2024-06-06T02:49:20.351 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:20 smithi103 systemd[1]: Stopping Ceph osd.7 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:20.611 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:20 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:49:20.350+0000 7fead9cba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:20.611 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:20 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:49:20.350+0000 7fead9cba640 -1 osd.7 83 *** Got signal Terminated *** 2024-06-06T02:49:20.611 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:20 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7[54016]: 2024-06-06T02:49:20.351+0000 7fead9cba640 -1 osd.7 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:26.276 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:25 smithi103 podman[71276]: 2024-06-06 02:49:25.994633336 +0000 UTC m=+5.752470111 container died 432935466bb40f7bdedd1afc039ae434c001def3b89953d25602508c10701e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:49:26.618 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:26 smithi103 podman[71276]: 2024-06-06 02:49:26.392880043 +0000 UTC m=+6.150716810 container cleanup 432935466bb40f7bdedd1afc039ae434c001def3b89953d25602508c10701e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD) 2024-06-06T02:49:26.618 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:26 smithi103 bash[71276]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7 2024-06-06T02:49:27.056 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:26 smithi103 podman[71306]: 2024-06-06 02:49:26.694555958 +0000 UTC m=+0.695692868 container remove 432935466bb40f7bdedd1afc039ae434c001def3b89953d25602508c10701e37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-06-06T02:49:27.364 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:26.959114022 +0000 UTC m=+0.017081792 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:27.364 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:27.095479263 +0000 UTC m=+0.153447027 container create 12f4054a31e39ed0e4b8a9e13843fec1e694927f977f3a9edef047cf2ae3b30a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T02:49:27.365 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:27.364998361 +0000 UTC m=+0.422966126 container init 12f4054a31e39ed0e4b8a9e13843fec1e694927f977f3a9edef047cf2ae3b30a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528) 2024-06-06T02:49:27.618 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:27.368199508 +0000 UTC m=+0.426167279 container start 12f4054a31e39ed0e4b8a9e13843fec1e694927f977f3a9edef047cf2ae3b30a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:49:27.618 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:27.448454722 +0000 UTC m=+0.506422499 container attach 12f4054a31e39ed0e4b8a9e13843fec1e694927f977f3a9edef047cf2ae3b30a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-06-06T02:49:27.618 INFO:journalctl@ceph.osd.7.smithi103.stdout:Jun 06 02:49:27 smithi103 podman[71394]: 2024-06-06 02:49:27.5587279 +0000 UTC m=+0.616695666 container died 12f4054a31e39ed0e4b8a9e13843fec1e694927f977f3a9edef047cf2ae3b30a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-06-06T02:49:28.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:27 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:27.703+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:28.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-06T02:49:28.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:28.190 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-06T02:49:28.190 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-06T02:49:28.190 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.8 2024-06-06T02:49:28.519 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:28 smithi184 systemd[1]: Stopping Ceph osd.8 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:28.867 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:28 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:28.488+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:28.903 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:28.699+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:28.903 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:28 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:28.469+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:28.903 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8[55301]: 2024-06-06T02:49:28.519+0000 7fb4c9768640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:28.904 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8[55301]: 2024-06-06T02:49:28.519+0000 7fb4c9768640 -1 osd.8 83 *** Got signal Terminated *** 2024-06-06T02:49:28.904 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:28 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8[55301]: 2024-06-06T02:49:28.519+0000 7fb4c9768640 -1 osd.8 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:29.868 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:29 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:29.466+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:29.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:29 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:29.486+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:30.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:29 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:29.697+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:30.867 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:30 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:30.457+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:30.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:30 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:30.453+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:31.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:30 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:30.649+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:31.867 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:31 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:31.453+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:31.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:31 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:31.410+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:31.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:31 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:31.603+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:32.868 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:32 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:32.407+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:32.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:32 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:32.397+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:32.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:32.610+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:33.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:33 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:33.355+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:33.867 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:33 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:33.393+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:33.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:33 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:33.640+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:34.495 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:34 smithi184 podman[73070]: 2024-06-06 02:49:34.1797111 +0000 UTC m=+5.796131025 container died e03e8ca5b17a5309a19695b641199e0d88d1723ff68a9f0c510fd0e7cde07cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-06-06T02:49:34.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:34 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:34.357+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:34.620 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:34 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:34.356+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:34.829 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:34 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:34.610+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:34.829 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:34 smithi184 podman[73070]: 2024-06-06 02:49:34.586397755 +0000 UTC m=+6.202817679 container cleanup e03e8ca5b17a5309a19695b641199e0d88d1723ff68a9f0c510fd0e7cde07cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3) 2024-06-06T02:49:34.829 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:34 smithi184 bash[73070]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8 2024-06-06T02:49:35.148 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:34 smithi184 podman[73087]: 2024-06-06 02:49:34.82958418 +0000 UTC m=+0.644898930 container remove e03e8ca5b17a5309a19695b641199e0d88d1723ff68a9f0c510fd0e7cde07cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3) 2024-06-06T02:49:35.449 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.059265712 +0000 UTC m=+0.017235346 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:35.449 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.18068551 +0000 UTC m=+0.138655173 container create 5da69a715f639136236b1bae54cba48b11a813e866947070b9060dcb31cfc552 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8-deactivate, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-06-06T02:49:35.449 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.449697965 +0000 UTC m=+0.407667585 container init 5da69a715f639136236b1bae54cba48b11a813e866947070b9060dcb31cfc552 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:49:35.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:35 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:35.332+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:35.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:35 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:35.377+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:35.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:35 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:35.568+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:35.898 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.452820464 +0000 UTC m=+0.410790085 container start 5da69a715f639136236b1bae54cba48b11a813e866947070b9060dcb31cfc552 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240528, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-06-06T02:49:35.898 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.541408839 +0000 UTC m=+0.499378460 container attach 5da69a715f639136236b1bae54cba48b11a813e866947070b9060dcb31cfc552 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-06-06T02:49:35.898 INFO:journalctl@ceph.osd.8.smithi184.stdout:Jun 06 02:49:35 smithi184 podman[73174]: 2024-06-06 02:49:35.650790854 +0000 UTC m=+0.608760476 container died 5da69a715f639136236b1bae54cba48b11a813e866947070b9060dcb31cfc552 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-06-06T02:49:36.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-06T02:49:36.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:36.297 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-06T02:49:36.297 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-06T02:49:36.297 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.9 2024-06-06T02:49:36.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:36 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:36.308+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:36.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:36 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:36.333+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:36.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:36 smithi082 systemd[1]: Stopping Ceph osd.9 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:36.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:36.542+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:37.363 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:36 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:36.872+0000 7fb2d7a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:37.363 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:36 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:36.872+0000 7fb2d7a00640 -1 osd.9 83 *** Got signal Terminated *** 2024-06-06T02:49:37.363 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:36 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:36.872+0000 7fb2d7a00640 -1 osd.9 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:37.364 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:37 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:37.363+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:37.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:37 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:37.279+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:37.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:37 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:37.501+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:37.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:37 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:37.501+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:38.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:38 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:38.304+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:38.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:38.331+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:38.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:38 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:38.331+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:33.379624+0000 front 2024-06-06T02:48:33.380260+0000 (oldest deadline 2024-06-06T02:49:38.079841+0000) 2024-06-06T02:49:38.799 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:38 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:38.491+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:38.799 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:38 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:38.491+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:39.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:39.341+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:39.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:39 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:39.341+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:39.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:39 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:39.341+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:39.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:39 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:39.341+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:33.379624+0000 front 2024-06-06T02:48:33.380260+0000 (oldest deadline 2024-06-06T02:49:38.079841+0000) 2024-06-06T02:49:39.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:39 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:39.538+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:39.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:39 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:39.538+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:40.868 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:40 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:40.370+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:40.868 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:40 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:40.370+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:40.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:40.379+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:40.871 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:40 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:40.379+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:33.379624+0000 front 2024-06-06T02:48:33.380260+0000 (oldest deadline 2024-06-06T02:49:38.079841+0000) 2024-06-06T02:49:40.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:40 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:40.527+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:40.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:40 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:40.527+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:41.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:41 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:41.334+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:41.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:41 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:41.334+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:41.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:41.346+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:22.877015+0000 front 2024-06-06T02:48:22.876031+0000 (oldest deadline 2024-06-06T02:49:27.576242+0000) 2024-06-06T02:49:41.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:41 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9[69629]: 2024-06-06T02:49:41.346+0000 7fb2d3400640 -1 osd.9 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:33.379624+0000 front 2024-06-06T02:48:33.380260+0000 (oldest deadline 2024-06-06T02:49:38.079841+0000) 2024-06-06T02:49:41.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:41 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:41.495+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:41.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:41 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:41.495+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:42.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:42 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:42.305+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:42.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:42 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:42.305+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:42.863 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:42 smithi082 podman[105973]: 2024-06-06 02:49:42.575832682 +0000 UTC m=+5.829307953 container died 6d73511a283f3077190b9d759ea6338a594f3bd5dfb38f01f0f7c5d5a746d074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528) 2024-06-06T02:49:42.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:42 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:42.507+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:42.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:42 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:42.507+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:43.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:43 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:43.281+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:43.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:43 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:43.281+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:43.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:43 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:43.281+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:43.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:43 smithi082 podman[105973]: 2024-06-06 02:49:43.123834712 +0000 UTC m=+6.377310027 container cleanup 6d73511a283f3077190b9d759ea6338a594f3bd5dfb38f01f0f7c5d5a746d074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:43.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:43 smithi082 bash[105973]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9 2024-06-06T02:49:43.621 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:43 smithi082 podman[105991]: 2024-06-06 02:49:43.316759411 +0000 UTC m=+0.726408897 container remove 6d73511a283f3077190b9d759ea6338a594f3bd5dfb38f01f0f7c5d5a746d074 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3) 2024-06-06T02:49:43.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:43 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:43.532+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:43.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:43 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:43.532+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:43.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:43 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:43.532+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:44.464 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.104701912 +0000 UTC m=+0.041966317 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:44.464 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.208999371 +0000 UTC m=+0.146263786 container create 0bc621819db600e24b517e7e24c7f5196ce2b5f4a38247e757f036cf75530ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:44.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:44 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:44.284+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:44.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:44 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:44.284+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:44.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:44 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:44.284+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:44.776 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.464566436 +0000 UTC m=+0.401830855 container init 0bc621819db600e24b517e7e24c7f5196ce2b5f4a38247e757f036cf75530ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-06-06T02:49:44.776 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.475022069 +0000 UTC m=+0.412286481 container start 0bc621819db600e24b517e7e24c7f5196ce2b5f4a38247e757f036cf75530ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, ceph=True, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:49:44.776 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.561521829 +0000 UTC m=+0.498786227 container attach 0bc621819db600e24b517e7e24c7f5196ce2b5f4a38247e757f036cf75530ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:49:44.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:44.576+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:44.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:44.576+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:44.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:44.576+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:45.109 INFO:journalctl@ceph.osd.9.smithi082.stdout:Jun 06 02:49:44 smithi082 podman[106077]: 2024-06-06 02:49:44.776738733 +0000 UTC m=+0.714003115 container died 0bc621819db600e24b517e7e24c7f5196ce2b5f4a38247e757f036cf75530ffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, ceph=True, org.label-schema.license=GPLv2) 2024-06-06T02:49:45.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-06T02:49:45.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:45.572 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-06T02:49:45.572 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-06T02:49:45.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.10 2024-06-06T02:49:45.598 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.290+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:45.598 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.290+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:45.598 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.290+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:45.868 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 systemd[1]: Stopping Ceph osd.10 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:45.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:45 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:45.548+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:45.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:45 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:45.548+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:45.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:45 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:45.548+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:46.292 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.929+0000 7f516ed7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:46.292 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.929+0000 7f516ed7b640 -1 osd.10 83 *** Got signal Terminated *** 2024-06-06T02:49:46.292 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:45 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:45.929+0000 7f516ed7b640 -1 osd.10 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:46.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:46 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:46.292+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:46.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:46 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:46.292+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:46.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:46 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:46.292+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:46.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:46 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:46.566+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:46.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:46 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:46.566+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:46.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:46 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:46.566+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:47.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:47 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:47.325+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:47.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:47 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:47.325+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:47.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:47 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:47.325+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:47.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:47 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:47.583+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:47.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:47 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:47.583+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:47.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:47 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:47.583+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:48.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:48 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:48.304+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:48.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:48 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:48.304+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:48.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:48 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:48.304+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:48.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:48 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:48.586+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:48.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:48 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:48.586+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:48.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:48 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:48.586+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:49.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:49 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:49.342+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:49.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:49 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:49.342+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:49.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:49 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:49.342+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:49.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:49 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:49.597+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:49.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:49 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:49.597+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:49.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:49 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:49.597+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:50.617 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:50 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:50.327+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.254936+0000 front 2024-06-06T02:48:23.255017+0000 (oldest deadline 2024-06-06T02:49:28.355956+0000) 2024-06-06T02:49:50.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:50 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:50.327+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:32.957424+0000 front 2024-06-06T02:48:32.957385+0000 (oldest deadline 2024-06-06T02:49:38.857610+0000) 2024-06-06T02:49:50.618 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:50 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10[61010]: 2024-06-06T02:49:50.327+0000 7f516b36c640 -1 osd.10 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:41.059286+0000 front 2024-06-06T02:48:41.059348+0000 (oldest deadline 2024-06-06T02:49:42.759386+0000) 2024-06-06T02:49:50.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:50 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:50.635+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:50.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:50 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:50.635+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:50.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:50 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:50.635+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:51.745 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:51 smithi103 podman[71497]: 2024-06-06 02:49:51.477045683 +0000 UTC m=+5.706144396 container died 04cda07eae23f264643aec47c550415adad406a31f176edb21ff15ccc74f8b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0) 2024-06-06T02:49:51.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:51 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:51.614+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:51.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:51 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:51.614+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:51.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:51 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:51.614+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:52.063 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:51 smithi103 podman[71497]: 2024-06-06 02:49:51.746104611 +0000 UTC m=+5.975203321 container cleanup 04cda07eae23f264643aec47c550415adad406a31f176edb21ff15ccc74f8b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, ceph=True) 2024-06-06T02:49:52.064 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:51 smithi103 bash[71497]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10 2024-06-06T02:49:52.367 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71514]: 2024-06-06 02:49:52.064391636 +0000 UTC m=+0.585166914 container remove 04cda07eae23f264643aec47c550415adad406a31f176edb21ff15ccc74f8b22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528) 2024-06-06T02:49:52.681 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.305634091 +0000 UTC m=+0.017159437 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:49:52.682 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.43191535 +0000 UTC m=+0.143440689 container create b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, ceph=True) 2024-06-06T02:49:52.682 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.682485906 +0000 UTC m=+0.394011247 container init b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:49:53.118 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.685923544 +0000 UTC m=+0.397448885 container start b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=) 2024-06-06T02:49:53.118 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.776050385 +0000 UTC m=+0.487575724 container attach b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-06-06T02:49:53.118 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:52 smithi103 podman[71609]: 2024-06-06 02:49:52.88644343 +0000 UTC m=+0.597968768 container died b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=) 2024-06-06T02:49:53.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:52 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:52.663+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:53.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:52 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:52.663+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:53.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:52 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:52.663+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:53.464 INFO:journalctl@ceph.osd.10.smithi103.stdout:Jun 06 02:49:53 smithi103 podman[71633]: 2024-06-06 02:49:53.462987229 +0000 UTC m=+0.570884575 container remove b3c9dbc5391718625c62da976fdc94391380da64fe4a54ee3ef663b461d2d839 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-06-06T02:49:53.482 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-06T02:49:53.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:49:53.560 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-06T02:49:53.560 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-06T02:49:53.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.11 2024-06-06T02:49:53.890 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 systemd[1]: Stopping Ceph osd.11 for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:49:53.890 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.612+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:53.890 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.612+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:53.890 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.612+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:54.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.889+0000 7ff36ac1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:49:54.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.889+0000 7ff36ac1d640 -1 osd.11 83 *** Got signal Terminated *** 2024-06-06T02:49:54.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:53 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:53.889+0000 7ff36ac1d640 -1 osd.11 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-06T02:49:54.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:54 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:54.567+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:54.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:54 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:54.567+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:54.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:54 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:54.567+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:55.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:55.552+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:55.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:55.552+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:55.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:55.552+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:55.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:55 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:55.552+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-06-06T02:48:50.504323+0000 front 2024-06-06T02:48:50.504408+0000 (oldest deadline 2024-06-06T02:49:55.204225+0000) 2024-06-06T02:49:56.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:56 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:56.549+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:56.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:56 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:56.549+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:56.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:56 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:56.549+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:56.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:56 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:56.549+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-06-06T02:48:50.504323+0000 front 2024-06-06T02:48:50.504408+0000 (oldest deadline 2024-06-06T02:49:55.204225+0000) 2024-06-06T02:49:57.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:57 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:57.575+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:57.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:57 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:57.575+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:57.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:57 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:57.575+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:57.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:57 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:57.575+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-06-06T02:48:50.504323+0000 front 2024-06-06T02:48:50.504408+0000 (oldest deadline 2024-06-06T02:49:55.204225+0000) 2024-06-06T02:49:58.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:58 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:58.600+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-06-06T02:48:23.199843+0000 front 2024-06-06T02:48:23.199623+0000 (oldest deadline 2024-06-06T02:49:27.299317+0000) 2024-06-06T02:49:58.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:58 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:58.600+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.103:6804 osd.1 since back 2024-06-06T02:48:31.300814+0000 front 2024-06-06T02:48:31.300950+0000 (oldest deadline 2024-06-06T02:49:36.600698+0000) 2024-06-06T02:49:58.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:58 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:58.600+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.184:6804 osd.2 since back 2024-06-06T02:48:38.802267+0000 front 2024-06-06T02:48:38.802379+0000 (oldest deadline 2024-06-06T02:49:43.502480+0000) 2024-06-06T02:49:58.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:58 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11[62301]: 2024-06-06T02:49:58.600+0000 7ff36720e640 -1 osd.11 83 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-06-06T02:48:50.504323+0000 front 2024-06-06T02:48:50.504408+0000 (oldest deadline 2024-06-06T02:49:55.204225+0000) 2024-06-06T02:49:59.723 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:59 smithi184 podman[73289]: 2024-06-06 02:49:59.424454881 +0000 UTC m=+5.665797502 container died 5dd33256de68d177ac6c56f5207926b8380722e43a821af7264445f92e406dcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, GIT_CLEAN=True) 2024-06-06T02:49:59.723 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:59 smithi184 podman[73289]: 2024-06-06 02:49:59.723378838 +0000 UTC m=+5.964721452 container cleanup 5dd33256de68d177ac6c56f5207926b8380722e43a821af7264445f92e406dcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.license=GPLv2) 2024-06-06T02:50:00.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:59 smithi184 bash[73289]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11 2024-06-06T02:50:00.148 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:49:59 smithi184 podman[73306]: 2024-06-06 02:49:59.966295394 +0000 UTC m=+0.536272202 container remove 5dd33256de68d177ac6c56f5207926b8380722e43a821af7264445f92e406dcf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-06T02:50:00.569 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.187738306 +0000 UTC m=+0.017455940 image pull 89767a4d6e8585406ab24645933c991bcff9b865e6b608caac7618a6454ec1be quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067 2024-06-06T02:50:00.569 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.292023128 +0000 UTC m=+0.121740731 container create 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True) 2024-06-06T02:50:00.898 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.569338151 +0000 UTC m=+0.399055755 container init 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-06-06T02:50:00.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.572729157 +0000 UTC m=+0.402446768 container start 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.35.3) 2024-06-06T02:50:00.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.661000807 +0000 UTC m=+0.490718449 container attach 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=) 2024-06-06T02:50:00.899 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:00 smithi184 podman[73395]: 2024-06-06 02:50:00.761846658 +0000 UTC m=+0.591564269 container died 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-06-06T02:50:01.307 INFO:journalctl@ceph.osd.11.smithi184.stdout:Jun 06 02:50:01 smithi184 podman[73419]: 2024-06-06 02:50:01.289151357 +0000 UTC m=+0.520857487 container remove 43b15d40342c07c606593a75eab2248225ef27c541214aa4b0a22e09eb2ff544 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.35.3) 2024-06-06T02:50:01.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-06T02:50:01.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:01.348 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-06T02:50:01.349 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-06T02:50:01.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.a 2024-06-06T02:50:01.871 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:01 smithi082 systemd[1]: Stopping Ceph mds.a for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:02.371 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:01 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: 2024-06-06T02:50:01.871+0000 7f61dc600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:02.371 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:01 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a[76481]: 2024-06-06T02:50:01.871+0000 7f61dc600640 -1 mds.a *** got signal Terminated *** 2024-06-06T02:50:03.820 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:03 smithi082 podman[106189]: 2024-06-06 02:50:03.565795533 +0000 UTC m=+1.818632142 container died 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.35.3, GIT_CLEAN=True) 2024-06-06T02:50:04.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:04 smithi082 podman[106189]: 2024-06-06 02:50:04.006499887 +0000 UTC m=+2.259336511 container cleanup 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, CEPH_POINT_RELEASE=) 2024-06-06T02:50:04.121 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:04 smithi082 bash[106189]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a 2024-06-06T02:50:04.621 INFO:journalctl@ceph.mds.a.smithi082.stdout:Jun 06 02:50:04 smithi082 podman[106203]: 2024-06-06 02:50:04.23287519 +0000 UTC m=+0.648636257 container remove 6e8a2d8509c5aebeb9c46fe1177ed0c4e04327ffd780f68e8498cf1651f20241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-a, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:50:04.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-06T02:50:04.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:04.886 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-06T02:50:04.887 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-06T02:50:04.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.d 2024-06-06T02:50:05.121 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:05 smithi082 systemd[1]: Stopping Ceph mds.d for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:05.871 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:05 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d[75296]: 2024-06-06T02:50:05.432+0000 7fb08e000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:05.871 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:05 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d[75296]: 2024-06-06T02:50:05.432+0000 7fb08e000640 -1 mds.d *** got signal Terminated *** 2024-06-06T02:50:08.324 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:08 smithi082 podman[106309]: 2024-06-06 02:50:08.011872477 +0000 UTC m=+2.705082958 container died 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-06-06T02:50:08.621 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:08 smithi082 podman[106309]: 2024-06-06 02:50:08.461091399 +0000 UTC m=+3.154301874 container cleanup 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, org.label-schema.license=GPLv2, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-06-06T02:50:08.621 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:08 smithi082 bash[106309]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d 2024-06-06T02:50:09.121 INFO:journalctl@ceph.mds.d.smithi082.stdout:Jun 06 02:50:08 smithi082 podman[106333]: 2024-06-06 02:50:08.662240945 +0000 UTC m=+0.627919444 container remove 7213d19da9f9144d1c442ab35211abc6733edb3532849fd0bc27572fd7c48be9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True) 2024-06-06T02:50:09.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-06T02:50:09.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:09.274 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-06T02:50:09.274 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-06T02:50:09.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.g 2024-06-06T02:50:09.871 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:09 smithi082 systemd[1]: Stopping Ceph mds.g for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:10.371 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: 2024-06-06T02:50:09.925+0000 7ff11d800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:10.371 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:09 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g[76059]: 2024-06-06T02:50:09.925+0000 7ff11d800640 -1 mds.g *** got signal Terminated *** 2024-06-06T02:50:11.871 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:11 smithi082 podman[106442]: 2024-06-06 02:50:11.571582786 +0000 UTC m=+1.801730942 container died 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.35.3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528) 2024-06-06T02:50:12.341 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:12 smithi082 podman[106442]: 2024-06-06 02:50:12.08110943 +0000 UTC m=+2.311257588 container cleanup 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.build-date=20240528, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:50:12.341 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:12 smithi082 bash[106442]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g 2024-06-06T02:50:12.621 INFO:journalctl@ceph.mds.g.smithi082.stdout:Jun 06 02:50:12 smithi082 podman[106455]: 2024-06-06 02:50:12.34041942 +0000 UTC m=+0.754307846 container remove 65108066dde0b51b4034e237a35f8b72374cc06e99d61e4ccc5e27b0c5fa555d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux ) 2024-06-06T02:50:12.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-06T02:50:12.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:12.949 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-06T02:50:12.949 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-06T02:50:12.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.j 2024-06-06T02:50:13.371 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:13 smithi082 systemd[1]: Stopping Ceph mds.j for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:13.871 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j[74910]: 2024-06-06T02:50:13.531+0000 7fbe7c800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:13.871 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:13 smithi082 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j[74910]: 2024-06-06T02:50:13.531+0000 7fbe7c800640 -1 mds.j *** got signal Terminated *** 2024-06-06T02:50:15.963 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:15 smithi082 podman[106562]: 2024-06-06 02:50:15.651540054 +0000 UTC m=+2.237615609 container died 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:50:16.269 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:16 smithi082 podman[106562]: 2024-06-06 02:50:16.076649654 +0000 UTC m=+2.662725236 container cleanup 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e) 2024-06-06T02:50:16.269 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:16 smithi082 bash[106562]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j 2024-06-06T02:50:16.621 INFO:journalctl@ceph.mds.j.smithi082.stdout:Jun 06 02:50:16 smithi082 podman[106577]: 2024-06-06 02:50:16.268802904 +0000 UTC m=+0.578411002 container remove 048a7ba5f6919b3970df361b31f533924441402fe504efdc2e39c7a7534ad06a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-06-06T02:50:16.754 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-06T02:50:16.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:16.856 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-06T02:50:16.856 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-06T02:50:16.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.b 2024-06-06T02:50:17.147 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:16 smithi103 systemd[1]: Stopping Ceph mds.b for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:17.617 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:17 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: 2024-06-06T02:50:17.147+0000 7fba35874640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:17.618 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:17 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b[66196]: 2024-06-06T02:50:17.147+0000 7fba35874640 -1 mds.b *** got signal Terminated *** 2024-06-06T02:50:19.617 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:19 smithi103 podman[71713]: 2024-06-06 02:50:19.335979043 +0000 UTC m=+2.279739324 container died 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.35.3, org.label-schema.build-date=20240528) 2024-06-06T02:50:20.031 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:19 smithi103 podman[71713]: 2024-06-06 02:50:19.697373328 +0000 UTC m=+2.641133608 container cleanup 594c98f72ece9c56f584efa21fb877a1332aac6894e0dab74db466545f2dcb0a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, ceph=True) 2024-06-06T02:50:20.031 INFO:journalctl@ceph.mds.b.smithi103.stdout:Jun 06 02:50:19 smithi103 bash[71713]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-b 2024-06-06T02:50:20.186 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-06T02:50:20.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:20.220 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-06T02:50:20.220 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-06T02:50:20.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.e 2024-06-06T02:50:20.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:20 smithi103 systemd[1]: Stopping Ceph mds.e for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:20.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:20 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e[65581]: 2024-06-06T02:50:20.526+0000 7f299ad80640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:20.618 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:20 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e[65581]: 2024-06-06T02:50:20.526+0000 7f299ad80640 -1 mds.e *** got signal Terminated *** 2024-06-06T02:50:22.785 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:22 smithi103 podman[71835]: 2024-06-06 02:50:22.555760637 +0000 UTC m=+2.115280278 container died 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e, maintainer=Guillaume Abrioux , io.buildah.version=1.35.3, org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.license=GPLv2) 2024-06-06T02:50:23.086 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:22 smithi103 podman[71835]: 2024-06-06 02:50:22.843701773 +0000 UTC m=+2.403221414 container cleanup 5e2fab446b1a07caa4729f821077a05f5653432ba86e74e1f8f4b40df9006b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.35.3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-06-06T02:50:23.086 INFO:journalctl@ceph.mds.e.smithi103.stdout:Jun 06 02:50:22 smithi103 bash[71835]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-e 2024-06-06T02:50:23.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-06T02:50:23.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:23.302 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-06T02:50:23.302 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-06T02:50:23.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.h 2024-06-06T02:50:23.618 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:23 smithi103 systemd[1]: Stopping Ceph mds.h for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:24.118 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:23 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h[65882]: 2024-06-06T02:50:23.622+0000 7f942c31c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:24.118 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:23 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h[65882]: 2024-06-06T02:50:23.622+0000 7f942c31c640 -1 mds.h *** got signal Terminated *** 2024-06-06T02:50:26.868 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:26 smithi103 podman[71966]: 2024-06-06 02:50:26.578478014 +0000 UTC m=+3.059852894 container died b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-06-06T02:50:27.174 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:26 smithi103 podman[71966]: 2024-06-06 02:50:26.956411989 +0000 UTC m=+3.437786854 container cleanup b55638e53048bd4e7ec1818a6b2cff9c8e038eaa4befece0548577b583b3e39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, io.buildah.version=1.35.3, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.build-date=20240528, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-06-06T02:50:27.174 INFO:journalctl@ceph.mds.h.smithi103.stdout:Jun 06 02:50:26 smithi103 bash[71966]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-h 2024-06-06T02:50:27.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-06T02:50:27.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:27.339 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-06T02:50:27.339 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-06T02:50:27.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.k 2024-06-06T02:50:27.618 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:27 smithi103 systemd[1]: Stopping Ceph mds.k for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:28.118 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:27 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k[65264]: 2024-06-06T02:50:27.642+0000 7f908a3ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:28.118 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:27 smithi103 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k[65264]: 2024-06-06T02:50:27.642+0000 7f908a3ae640 -1 mds.k *** got signal Terminated *** 2024-06-06T02:50:31.618 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:31 smithi103 podman[72087]: 2024-06-06 02:50:31.241125121 +0000 UTC m=+3.685933576 container died 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240528, GIT_BRANCH=HEAD, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-06-06T02:50:31.974 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:31 smithi103 podman[72087]: 2024-06-06 02:50:31.743246985 +0000 UTC m=+4.188055485 container cleanup 73278f10d54ff56e9a41b6fff5e7daa1d3a5a7f7bbe94a0785d1ba8ee4193a7d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3) 2024-06-06T02:50:31.974 INFO:journalctl@ceph.mds.k.smithi103.stdout:Jun 06 02:50:31 smithi103 bash[72087]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-k 2024-06-06T02:50:32.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-06T02:50:32.200 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:32.200 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-06T02:50:32.200 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-06T02:50:32.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.c 2024-06-06T02:50:32.496 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:32 smithi184 systemd[1]: Stopping Ceph mds.c for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:32.898 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: 2024-06-06T02:50:32.496+0000 7f5de9bed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:32.898 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:32 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c[67436]: 2024-06-06T02:50:32.496+0000 7f5de9bed640 -1 mds.c *** got signal Terminated *** 2024-06-06T02:50:35.648 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:35 smithi184 podman[73499]: 2024-06-06 02:50:35.383330763 +0000 UTC m=+2.980469612 container died 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True) 2024-06-06T02:50:36.013 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:35 smithi184 podman[73499]: 2024-06-06 02:50:35.762747631 +0000 UTC m=+3.359886472 container cleanup 3169eebc007f882a5746bfea46394728e0f1481190059d9764777f2c817b806d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.35.3, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240528, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-06-06T02:50:36.013 INFO:journalctl@ceph.mds.c.smithi184.stdout:Jun 06 02:50:35 smithi184 bash[73499]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-c 2024-06-06T02:50:36.187 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-06T02:50:36.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:36.221 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-06T02:50:36.222 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-06T02:50:36.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.f 2024-06-06T02:50:36.550 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:36 smithi184 systemd[1]: Stopping Ceph mds.f for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:36.898 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: 2024-06-06T02:50:36.549+0000 7f74bafc4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:36.898 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:36 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f[67123]: 2024-06-06T02:50:36.549+0000 7f74bafc4640 -1 mds.f *** got signal Terminated *** 2024-06-06T02:50:39.648 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:39 smithi184 podman[73632]: 2024-06-06 02:50:39.387828792 +0000 UTC m=+2.944626327 container died e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240528, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3) 2024-06-06T02:50:40.026 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:39 smithi184 podman[73632]: 2024-06-06 02:50:39.749721735 +0000 UTC m=+3.306519262 container cleanup e032381c4358545ed51babef0001442e41602090bbfd4370a395ba52c44c26d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f, io.buildah.version=1.35.3, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240528, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-06-06T02:50:40.026 INFO:journalctl@ceph.mds.f.smithi184.stdout:Jun 06 02:50:39 smithi184 bash[73632]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-f 2024-06-06T02:50:40.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-06T02:50:40.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:40.213 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-06T02:50:40.213 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-06T02:50:40.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.i 2024-06-06T02:50:40.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:40 smithi184 systemd[1]: Stopping Ceph mds.i for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:40.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:40 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: 2024-06-06T02:50:40.528+0000 7fb43a552640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:40.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:40 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i[67740]: 2024-06-06T02:50:40.528+0000 7fb43a552640 -1 mds.i *** got signal Terminated *** 2024-06-06T02:50:43.648 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:43 smithi184 podman[73754]: 2024-06-06 02:50:43.364067227 +0000 UTC m=+2.937303427 container died 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240528, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-06-06T02:50:44.003 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:43 smithi184 podman[73754]: 2024-06-06 02:50:43.761385206 +0000 UTC m=+3.334621404 container cleanup 069b05fc18e1aefdc13ac355905ad38469bc3e1709f3fcfc2b5e21eb9edaa932 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240528, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, org.label-schema.schema-version=1.0, io.buildah.version=1.35.3, org.label-schema.license=GPLv2) 2024-06-06T02:50:44.004 INFO:journalctl@ceph.mds.i.smithi184.stdout:Jun 06 02:50:43 smithi184 bash[73754]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-i 2024-06-06T02:50:44.139 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-06T02:50:44.170 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:44.170 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-06T02:50:44.170 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-06T02:50:44.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.l 2024-06-06T02:50:44.398 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:44 smithi184 systemd[1]: Stopping Ceph mds.l for b8ccb8a2-23ab-11ef-bc9b-c7b262605968... 2024-06-06T02:50:44.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l[66818]: 2024-06-06T02:50:44.489+0000 7fafe052c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-06T02:50:44.898 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:44 smithi184 ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l[66818]: 2024-06-06T02:50:44.489+0000 7fafe052c640 -1 mds.l *** got signal Terminated *** 2024-06-06T02:50:48.765 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:48 smithi184 podman[73875]: 2024-06-06 02:50:48.500249841 +0000 UTC m=+4.116310452 container died 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, io.buildah.version=1.35.3, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257) 2024-06-06T02:50:49.041 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:48 smithi184 podman[73875]: 2024-06-06 02:50:48.848705614 +0000 UTC m=+4.464766214 container cleanup 804892025ac2c7c281e8c4e7a58333cf42bbbbc28e215863e9681aed1392711e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:54154cffcaa205643e6c56fb241c4865d376de9cca0eae99db5e32f0f119c067, name=ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240528, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.35.3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240605.005022-debug-3c55257, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=55ad0f204a1d654ee565abf874aecad0cc209d0e, ceph=True) 2024-06-06T02:50:49.041 INFO:journalctl@ceph.mds.l.smithi184.stdout:Jun 06 02:50:48 smithi184 bash[73875]: ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968-mds-l 2024-06-06T02:50:49.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-b8ccb8a2-23ab-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-06T02:50:49.293 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-06T02:50:49.293 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-06T02:50:49.293 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T02:50:49.610 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:50:54.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T02:50:54.759 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:50:57.335 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-06T02:50:57.529 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T02:51:00.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:51:00.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:51:00.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-06T02:51:00.172 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-06T02:51:00.173 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi082/crash 2024-06-06T02:51:00.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T02:51:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T02:51:00.273 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-06-06T02:51:00.276 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi103/crash 2024-06-06T02:51:00.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T02:51:00.321 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T02:51:00.321 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-06-06T02:51:00.324 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi184/crash 2024-06-06T02:51:00.325 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash -- . 2024-06-06T02:51:00.385 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-06T02:51:00.386 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-06-06T02:51:00.387 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-06T02:51:00.387 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-06T02:51:00.540 INFO:teuthology.orchestra.run.smithi082.stdout:2024-06-06T02:26:20.519047+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-06T02:51:00.541 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-06-06T02:51:00.542 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[SEC\]' /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-06T02:51:00.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]' /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-06T02:51:00.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[WRN\]' /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-06-06T02:51:00.815 INFO:teuthology.orchestra.run.smithi082.stdout:2024-06-06T02:26:20.519047+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-06T02:51:00.816 INFO:tasks.cephadm:Compressing logs... 2024-06-06T02:51:00.816 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T02:51:00.820 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T02:51:00.823 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-06-06T02:51:00.860 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-06T02:51:00.860 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T02:51:00.860 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T02:51:00.860 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.f.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.c.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.z.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.i.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.11.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.8.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T02:51:00.861 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.l.log 2024-06-06T02:51:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.b.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.h.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.10.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.e.log 2024-06-06T02:51:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T02:51:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-06-06T02:51:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.k.log 2024-06-06T02:51:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.b.log: /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.k.log: 94.5% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.h.log.gz 2024-06-06T02:51:00.880 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-06T02:51:00.880 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-06-06T02:51:00.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log 2024-06-06T02:51:00.882 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log 2024-06-06T02:51:00.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.g.log 2024-06-06T02:51:00.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.j.log 2024-06-06T02:51:00.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-06-06T02:51:00.887 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.j.log: 87.1% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T02:51:00.888 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-06-06T02:51:00.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-06-06T02:51:00.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-06-06T02:51:00.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-06-06T02:51:00.889 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.a.log: 94.5% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.j.log.gz 2024-06-06T02:51:00.889 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-06-06T02:51:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.a.log 2024-06-06T02:51:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log 2024-06-06T02:51:00.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.d.log 2024-06-06T02:51:00.892 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.9.log 2024-06-06T02:51:00.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.d.log: /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.9.log: 94.4% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.d.log.gz 2024-06-06T02:51:00.936 INFO:teuthology.orchestra.run.smithi082.stderr: 90.2% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T02:51:00.957 INFO:teuthology.orchestra.run.smithi103.stderr: 81.8% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T02:51:00.964 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log: /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.l.log: 81.7% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T02:51:00.993 INFO:teuthology.orchestra.run.smithi184.stderr: 93.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.z.log.gz 2024-06-06T02:51:01.012 INFO:teuthology.orchestra.run.smithi082.stderr: 82.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-06-06T02:51:01.018 INFO:teuthology.orchestra.run.smithi103.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T02:51:01.019 INFO:teuthology.orchestra.run.smithi103.stderr: 87.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T02:51:01.065 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T02:51:01.066 INFO:teuthology.orchestra.run.smithi184.stderr: 94.5% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.l.log.gz 2024-06-06T02:51:01.068 INFO:teuthology.orchestra.run.smithi103.stderr: 92.9% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-06-06T02:51:01.070 INFO:teuthology.orchestra.run.smithi184.stderr: 87.1% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.log.gz 2024-06-06T02:51:01.071 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T02:51:01.071 INFO:teuthology.orchestra.run.smithi184.stderr: 90.4% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T02:51:01.075 INFO:teuthology.orchestra.run.smithi103.stderr: 94.4% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.k.log.gz 2024-06-06T02:51:01.075 INFO:teuthology.orchestra.run.smithi103.stderr: 94.4% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.e.log.gz 2024-06-06T02:51:01.116 INFO:teuthology.orchestra.run.smithi082.stderr: 90.9% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T02:51:01.120 INFO:teuthology.orchestra.run.smithi184.stderr: 91.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-06-06T02:51:01.208 INFO:teuthology.orchestra.run.smithi082.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-06-06T02:51:01.220 INFO:teuthology.orchestra.run.smithi103.stderr: 90.3% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-06-06T02:51:01.409 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.f.log.gz 2024-06-06T02:51:01.673 INFO:teuthology.orchestra.run.smithi103.stderr: 93.4% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.b.log.gz 2024-06-06T02:51:02.973 INFO:teuthology.orchestra.run.smithi082.stderr: 94.5% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.a.log.gz 2024-06-06T02:51:02.975 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-06-06T02:51:03.021 INFO:teuthology.orchestra.run.smithi082.stderr: 90.2% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-06-06T02:51:04.068 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-06-06T02:51:07.361 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-06-06T02:51:26.951 INFO:teuthology.orchestra.run.smithi082.stderr: 93.5% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.g.log.gz 2024-06-06T02:51:28.491 INFO:teuthology.orchestra.run.smithi184.stderr: 96.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.c.log.gz 2024-06-06T02:53:22.672 INFO:teuthology.orchestra.run.smithi184.stderr: 95.6% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-mds.i.log.gz 2024-06-06T02:55:21.316 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-06-06T02:55:23.574 INFO:teuthology.orchestra.run.smithi184.stderr: 91.9% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-06-06T03:00:07.043 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.10.log.gz 2024-06-06T03:00:41.109 INFO:teuthology.orchestra.run.smithi184.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.8.log.gz 2024-06-06T03:01:00.630 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-06-06T03:01:09.308 INFO:teuthology.orchestra.run.smithi184.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.11.log.gz 2024-06-06T03:01:14.431 INFO:teuthology.orchestra.run.smithi184.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-06-06T03:01:14.433 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-06-06T03:01:14.433 INFO:teuthology.orchestra.run.smithi184.stderr:real 10m13.595s 2024-06-06T03:01:14.433 INFO:teuthology.orchestra.run.smithi184.stderr:user 6m42.840s 2024-06-06T03:01:14.433 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m16.969s 2024-06-06T03:01:41.072 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-06-06T03:01:41.073 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-06-06T03:01:41.073 INFO:teuthology.orchestra.run.smithi103.stderr:real 10m40.236s 2024-06-06T03:01:41.073 INFO:teuthology.orchestra.run.smithi103.stderr:user 6m50.964s 2024-06-06T03:01:41.073 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m17.085s 2024-06-06T03:01:50.560 INFO:teuthology.orchestra.run.smithi082.stderr: 92.0% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.9.log.gz 2024-06-06T03:03:15.490 INFO:teuthology.orchestra.run.smithi082.stderr: 91.9% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-06-06T03:03:42.312 INFO:teuthology.orchestra.run.smithi082.stderr: 91.8% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-06-06T03:03:47.903 INFO:teuthology.orchestra.run.smithi082.stderr: 91.8% -- replaced with /var/log/ceph/b8ccb8a2-23ab-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-06-06T03:03:47.910 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-06-06T03:03:47.910 INFO:teuthology.orchestra.run.smithi082.stderr:real 12m47.057s 2024-06-06T03:03:47.911 INFO:teuthology.orchestra.run.smithi082.stderr:user 17m7.866s 2024-06-06T03:03:47.911 INFO:teuthology.orchestra.run.smithi082.stderr:sys 2m8.652s 2024-06-06T03:03:47.911 INFO:tasks.cephadm:Archiving logs... 2024-06-06T03:03:47.915 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi082/log 2024-06-06T03:03:47.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:04:56.814 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi103/log 2024-06-06T03:04:56.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:06:05.283 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi184/log 2024-06-06T03:06:05.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-06T03:07:12.456 INFO:tasks.cephadm:Removing cluster... 2024-06-06T03:07:12.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force 2024-06-06T03:07:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T03:07:14.843 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force 2024-06-06T03:07:15.220 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T03:07:15.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid b8ccb8a2-23ab-11ef-bc9b-c7b262605968 --force 2024-06-06T03:07:16.246 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: b8ccb8a2-23ab-11ef-bc9b-c7b262605968 2024-06-06T03:07:16.989 INFO:tasks.cephadm:Removing cephadm ... 2024-06-06T03:07:16.990 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:07:17.050 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:07:17.068 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-06T03:07:17.084 INFO:tasks.cephadm:Teardown complete 2024-06-06T03:07:17.085 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-06T03:07:17.160 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-06T03:07:17.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:07:17.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:07:17.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-06T03:07:17.362 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-06T03:07:17.372 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-06T03:07:17.372 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:07:17.380 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:07:17.383 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-06T03:07:17.397 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:07:17.397 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 +569us[ +576us] +/- 55ms 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -978us[ -971us] +/- 66ms 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +352us[ +352us] +/- 73ms 2024-06-06T03:07:17.424 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:07:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-06-06T03:07:17.433 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:07:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-06-06T03:07:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +581us[ +581us] +/- 55ms 2024-06-06T03:07:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -977us[ -977us] +/- 66ms 2024-06-06T03:07:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +364us[ +364us] +/- 73ms 2024-06-06T03:07:17.434 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:07:17.553 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-06T03:07:17.553 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-06-06T03:07:17.553 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +546us[ +550us] +/- 55ms 2024-06-06T03:07:17.553 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 -981us[ -976us] +/- 66ms 2024-06-06T03:07:17.553 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +326us[ +331us] +/- 73ms 2024-06-06T03:07:17.554 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-06T03:07:17.557 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-06T03:07:17.754 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-06T03:07:17.754 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-06T03:07:17.797 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:07:18.089 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:07:18.233 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-06T03:07:18.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:18.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:18.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:18.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:18.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-06-06T03:07:18.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:18.463 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-06T03:07:18.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-06T03:07:18.532 INFO:teuthology.task.internal:Duration was 3143.334639 seconds 2024-06-06T03:07:18.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-06T03:07:18.556 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-06T03:07:18.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:07:18.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:07:18.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-06T03:07:18.635 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:18.639 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:18.732 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-06T03:07:19.266 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-06T03:07:19.266 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-06-06T03:07:19.266 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:07:19.337 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-06-06T03:07:19.337 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:07:19.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-06-06T03:07:19.377 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-06T03:07:19.417 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-06T03:07:19.417 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:07:19.425 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:07:19.428 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-06T03:07:19.506 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-06T03:07:19.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:07:19.511 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:07:19.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-06T03:07:20.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-06T03:07:20.307 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-06T03:07:20.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:07:20.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:07:20.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-06T03:07:20.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-06T03:07:20.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.524 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-06-06T03:07:20.542 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-06-06T03:07:20.592 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-06-06T03:07:20.639 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:20.687 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:20.702 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-06T03:07:20.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-06T03:07:20.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-06T03:07:20.789 INFO:teuthology.task.internal:Transferring archived files... 2024-06-06T03:07:20.791 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi082 2024-06-06T03:07:20.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:07:20.973 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi103 2024-06-06T03:07:20.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:07:21.010 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-06-06_01:29:47-fs-wip-pdonnell-testing-20240605.005022-debug-distro-default-smithi/7743666/remote/smithi184 2024-06-06T03:07:21.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-06T03:07:21.104 INFO:teuthology.task.internal:Removing archive directory... 2024-06-06T03:07:21.104 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:21.112 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:21.114 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-06T03:07:21.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-06T03:07:21.535 INFO:teuthology.task.internal:Not uploading archives. 2024-06-06T03:07:21.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-06T03:07:21.574 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-06T03:07:21.574 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:07:21.582 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:07:21.585 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-06T03:07:21.602 INFO:teuthology.orchestra.run.smithi103.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:07 /home/ubuntu/cephtest 2024-06-06T03:07:21.603 INFO:teuthology.orchestra.run.smithi184.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:07 /home/ubuntu/cephtest 2024-06-06T03:07:21.633 INFO:teuthology.orchestra.run.smithi082.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 6 03:07 /home/ubuntu/cephtest 2024-06-06T03:07:21.637 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-06T03:07:21.653 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-06T03:07:21.719 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/ffsb}} duration: 3143.334639072418 failure_reason: '"2024-06-06T02:26:20.519047+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log' flavor: default owner: scheduled_pdonnell@vossi04.front.sepia.ceph.com success: false 2024-06-06T03:07:21.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-06T03:07:21.797 INFO:teuthology.run:FAIL